Identify & store the values that appear multiple times in a dictionary (Python)

Question

I have a list of dictionaries, where some "term" values are repeated:

terms_dict = [{'term': 'potato', 'cui': '123AB'}, {'term': 'carrot', 'cui': '222AB'}, {'term': 'potato', 'cui': '456AB'}]

As you can see the term 'potato' value appears more than once. I would like to store this 'term' for future reference as a variable. Then, remove all of those repeated terms from the terms_dict, leaving only the term 'carrot' dictionary in the list.

Desired output:

repeated_terms = ['potato'] ## identified and stored terms that are repeated in terms_dict. 

new_terms_dict = [{'term': 'carrot', 'cui': '222AB'}] ## new dict with the unique term.

Idea:

I can certainly create a new dictionary with unique terms, however, I am stuck with actually identifying the "term" that is repeated and storing it in a list.

Is there a pythonic way of finding/printing/storing the repeated values ?

Step 1: make a list of all "terms". Step 2: stackoverflow.com/questions/9835762/… Step 3: remove dictionaries with terms found in step 2: stackoverflow.com/questions/7623715/… — mkrieger1
– mkrieger1, Commented Aug 26, 2021 at 17:24

Andrej Kesely · Accepted Answer · 2021-08-26 17:22:40Z

2

You can use collections.Counter for the task:

from collections import Counter

terms_dict = [
    {"term": "potato", "cui": "123AB"},
    {"term": "carrot", "cui": "222AB"},
    {"term": "potato", "cui": "456AB"},
]

c = Counter(d["term"] for d in terms_dict)

repeated_terms = [k for k, v in c.items() if v > 1]
new_terms_dict = [d for d in terms_dict if c[d["term"]] == 1]

print(repeated_terms)
print(new_terms_dict)

Prints:

['potato']
[{'term': 'carrot', 'cui': '222AB'}]

answered Aug 26, 2021 at 17:22

Andrej Kesely

196k15 gold badges60 silver badges105 bronze badges

Sign up to request clarification or add additional context in comments.

Comments

Sayandip Dutta · Accepted Answer · 2021-08-26 17:29:31Z

1

You can use drop_duplicates and duplicated from pandas:

>>> import pandas as pd
>>> df = pd.DataFrame(terms_dict)
>>> df.term[df.term.duplicated()].tolist() # repeats
['potato']
>>> df.drop_duplicates('term', keep=False).to_dict('records') # without repeats
[{'term': 'carrot', 'cui': '222AB'}]

edited Aug 26, 2021 at 17:29

answered Aug 26, 2021 at 17:24

Sayandip Dutta

15.9k4 gold badges27 silver badges57 bronze badges

Collectives™ on Stack Overflow

Identify & store the values that appear multiple times in a dictionary (Python)

2 Answers 2

Comments

Comments

Your Answer

Linked

Hot Network Questions

Collectives™ on Stack Overflow

2 Answers 2

Comments

Comments

Your Answer

Sign up or log in

Post as a guest

Linked

Related