Remove duplicates values across the multi-dimensional array in python

Question

How to remove duplicates across the multi-dimensional array: example:

[
[125.25,129,128,129],
[124.25,127,130,131],
[126,126,125,124],
[126,124,130,124]
]

and I want, the output should be:

[
[125.25,129,128],
[124.25,127,130,131],
[126,125,124]
]

Possible duplicate of Remove Duplicates in two-dimensional array while maintaining sequence — arshbot
– arshbot, Commented Oct 22, 2018 at 17:50
No, I need each element of all arrays should be unique, no duplication of values across the array. — Zee Junaid Ahmed
– Zee Junaid Ahmed, Commented Oct 22, 2018 at 17:54
It looks like you want us to write some code for you. While many users are willing to produce code for a coder in distress, they usually only help when the poster has already tried to solve the problem individually. A good way to show this effort is to include a Minimal, complete, verifiable example. Check the intro tour you finished before posting, especially How to Ask. — Prune
– Prune, Commented Oct 22, 2018 at 17:55

Mark · Accepted Answer · 2018-10-22 17:53:37Z

1

Maybe not the shortest but something like this would work:

arrs = [
[125.25,129,128,129],
[124.25,127,130,131],
[126,126,125,124],
[126,124,130,124]
]

alreadyExisting = []
removedDuplicatesArr = []

for arr in arrs:
    newArr = []
    for i in arr:
        if i not in alreadyExisting:
            alreadyExisting.append(i)
            newArr.append(i)
    if newArr:
        removedDuplicatesArr.append(newArr)

print(removedDuplicatesArr)

answered Oct 22, 2018 at 17:53

Mark

5,2592 gold badges22 silver badges32 bronze badges

Sign up to request clarification or add additional context in comments.

1 Comment

slider Over a year ago

I'd make alreadyExisting a set to make the if i not in alreadyExisting check O(1).

nosklo · Accepted Answer · 2018-10-22 17:54:17Z

0

yourlist = [
    [125.25,129,128,129],
    [124.25,127,130,131],
    [126,126,125,124],
    [126,124,130,124]
]
def seen(element, _cache=set()):
    result = element in _cache
    _cache.add(element)
    return result

filtered = ([x for x in sublist if not seen(x)] for sublist in yourlist)
filtered = [sublist for sublist in filtered if sublist] # filter out empty lists

edited Oct 22, 2018 at 17:54

answered Oct 22, 2018 at 17:52

nosklo

224k58 gold badges300 silver badges299 bronze badges

1 Comment

Owen Over a year ago

Almost - what about empty lists? In his example, these are removed

vash_the_stampede · Accepted Answer · 2018-10-22 18:06:20Z

0

Use set to eliminate the duplicates in sublists , then check if item of sublist exists in res if not append those values to a tmp list and then append that list to your res

res = []
lst = [set(i) for i in lst]

for i in lst:
    tmp = []
    for j in i:
        if not any(j in i for i in res):
            tmp.append(j)
    if tmp:
        res.append(sorted(tmp))

print(res)
# [[125.25, 128, 129], [124.25, 127, 130, 131], [124, 125, 126]]

answered Oct 22, 2018 at 18:06

vash_the_stampede

4,5861 gold badge11 silver badges20 bronze badges

Collectives™ on Stack Overflow

Remove duplicates values across the multi-dimensional array in python

3 Answers 3

1 Comment

1 Comment

Comments

Your Answer

Linked

Hot Network Questions

Collectives™ on Stack Overflow

3 Answers 3

1 Comment

1 Comment

Comments

Your Answer

Sign up or log in

Post as a guest

Linked

Related