How to filter a list column in a dataframe?

Question

I have a data frame like this:

df:
ID    Names
3    [Ally, Ben, Cris]
5    [Bruno, Coleen, Flyn]
2    [Dave, Bob]
7    [Rob, Ally, Bob]
11   [Jill, Tom, Sal]

The Names column is a list of names. Some of them could be repeated.

I want to filter the data frame on Names columns where the names start with either A or B or D.

So my output should look like this:

ID    Names
3    [Ally, Ben]
5    [Bruno]
2    [Dave, Bob]
7    [Ally, Bob]

Reproducible input:

df = pd.DataFrame({'ID': [3, 5, 2, 7, 11],
                   'Names': [['Ally', 'Ben', 'Cris'],
                             ['Bruno', 'Coleen', 'Flyn'],
                             ['Dave', 'Bob'],
                             ['Rob', 'Ally', 'Bob'],
                             ['Jill', 'Tom', 'Sal']]
                  })

mozway · Accepted Answer · 2022-09-13 04:09:56Z

4

You can use a list comprehension to filter the names, and boolean indexing to filter the rows:

target = {'A', 'B', 'D'}
df['Names'] = [[n for n in l if n[0] in target] for l in df['Names']]

df = df[df['Names'].str.len().gt(0)]

Or using explode, and groupby.agg:

s = (df['Names']
     .explode()
     .loc[lambda x: x.str[0].isin(['A', 'B', 'D'])]
     .groupby(level=0).agg(list)
    )

df = df.loc[s.index].assign(Names=s)

output:

   ID        Names
0   3  [Ally, Ben]
1   5      [Bruno]
2   2  [Dave, Bob]
3   7  [Ally, Bob]

edited Sep 13, 2022 at 4:09

answered Sep 13, 2022 at 3:57

mozway

267k13 gold badges56 silver badges106 bronze badges

Sign up to request clarification or add additional context in comments.

Comments

SergFSM · Accepted Answer · 2022-09-13 07:32:26Z

0

just a slight variance of this solution:

df = (df.explode('Names').
      query("Names.str[0].isin(['A','B','D'])",engine='python').
      groupby('ID').
      agg(list).
      reset_index())

print(df)
'''
   ID        Names
0   2  [Dave, Bob]
1   3  [Ally, Ben]
2   5      [Bruno]
3   7  [Ally, Bob]

answered Sep 13, 2022 at 7:32

SergFSM

1,4991 gold badge6 silver badges9 bronze badges

Collectives™ on Stack Overflow

How to filter a list column in a dataframe?

2 Answers 2

Comments

Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

2 Answers 2

Comments

Comments

Your Answer

Sign up or log in

Post as a guest

Related