How to groupby and filter for strings in python pandas dataframe

Question

I would like to filter based on a string condition.

My dataframe looks like this:

I want to group by Id, and filter for groups that consist of both words: "add" and "set". Additional elements like close do not matter. I only want to filter groups with "set" and "add.

My final output should look like this:

I've tried this:

df = df.groupby(['id']).filter(lambda x: (x.mode == "set" & x.mode == "add").all())

But this wil give me an error message: unsupported operand type(s) for &: 'str' and 'method'

Let me know of other solutions. Thanks!

You should probably start off reading a simple tutorial like pandas.pydata.org/pandas-docs/stable/10min.html . I don't think you understand what groupby does — Josh Friedlander
– Josh Friedlander, Commented Apr 4, 2019 at 9:42
Please take a look at How to make a good reproducible pandas example. The data should be included as a formatted code, not as a screenshot. — w-m
– w-m, Commented Apr 4, 2019 at 9:49

w-m · Accepted Answer · 2019-04-04 09:46:08Z

5

The error you get is because .mode is a method on the DataFrame. Use ["mode"] instead.

To filter the groups correctly you want to test whether "set" is appears in the list of modes and "add" appears in the list of modes. The code should look like this:

df.groupby("id").filter(lambda x: (x["mode"] == "set").any() & (x["mode"] == "add").any())

answered Apr 4, 2019 at 9:46

w-m

11.3k1 gold badge46 silver badges51 bronze badges

Sign up to request clarification or add additional context in comments.

Collectives™ on Stack Overflow

How to groupby and filter for strings in python pandas dataframe

1 Answer 1

Comments

Your Answer

Linked

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

Comments

Your Answer

Sign up or log in

Post as a guest

Linked

Related