Finding Duplicate Values in a Dictionary

Question

I'm writing a script to find duplicated values in a dictionary. My dictionary duties has an integer key and a list as a value. My task is to make a new dictionary duties_without_duplicates without duplicate values.

duties = { 
    0: ["Submit an assignment","Submit an assignment"],
    1: ["Submit an assignment", "Finish a book review"]
}

duties_without_duplicates = {
    0: ["Submit an assignment"],
    1: ["Submit an assignment", "Finish a book review"]
}

Can anyone help me how to solve this problem?

Does this answer your question? How do I remove duplicates from a list, while preserving order? — Kraigolas
– Kraigolas, Commented Sep 14, 2022 at 15:29

Mortz · Accepted Answer · 2022-09-14 15:29:54Z

1

If the order of items in your lists is not important, you can simply pass the lists to a set constructor -

duties = { 
    0: ["Submit an assignment","Submit an assignment"],
    1: ["Submit an assignment", "Finish a book review"]
}
duties_without_duplicates = {k: list(set(v)) for k, v in duties.items()}

Output

{0: ['Submit an assignment'],
 1: ['Submit an assignment', 'Finish a book review']}

answered Sep 14, 2022 at 15:29

Mortz

4,9591 gold badge23 silver badges39 bronze badges

Sign up to request clarification or add additional context in comments.

Comments

ThePyGuy · Accepted Answer · 2022-09-14 15:39:49Z

1

You can use grouby from itertools, and use the keys provided by groupby iterator for the unique values in the list, and you can implement a dictionary comprehension to achieve that:

>>> from itertools import groupby
>>> {key:[k for k,v in groupby(values)] for key,values in duties.items()}

{0: ['Submit an assignment'], 1: ['Submit an assignment', 'Finish a book review']}

As I've mentioned in comments as well, above solution will work only if the values list is sorted, otherwise, you can use following method:

result = {}
for key,values in duties.items():
    temp = []
    for v in values:
        if v not in temp:
            temp.append(v)
    result[key]=temp

# result: 
{0: ['Submit an assignment'], 1: ['Submit an assignment', 'Finish a book review']}

edited Sep 14, 2022 at 15:39

answered Sep 14, 2022 at 15:30

ThePyGuy

18.5k5 gold badges24 silver badges55 bronze badges

4 Comments

Mortz Over a year ago

Depending on the lists - itertools.groupby might not remove all duplicates.

ThePyGuy Over a year ago

@Mortz, you are right, it'll work only if the list is sorted else it will not work. But since the data mentioned by OP is sorted, so I didn't think in that direction.

Mortz Over a year ago

Yes - just wanted to call it out as the results of groupby on an unsorted list might be surprising

ThePyGuy Over a year ago

@Mortz, thanks for the comment, I've added alternate solution as well.

Collectives™ on Stack Overflow

Finding Duplicate Values in a Dictionary

2 Answers 2

Comments

4 Comments

Your Answer

Linked

Hot Network Questions

Collectives™ on Stack Overflow

2 Answers 2

Comments

4 Comments

Your Answer

Sign up or log in

Post as a guest

Linked

Related