How to filter rows containing empty lists in a pandas DataFrame?

Question

I have a DataFrame that looks like this:

A    B    C    D
foo  foo  foo  ['list_value']
bar  bar  bar  ['list_value', 'another_list_value']
baz  baz  baz  []

How can I filter out the empty list? I'm trying .isin but it throws me an error:

df[df['D'].isin([])]

SystemError: <built-in method view of numpy.ndarray object at 0x0000017ECA74BF30> returned a result with an error set

I also checked this question but couldn't figure out how to implement in a DataFrame context.

Any help would be very appreciated.

jezrael · Accepted Answer · 2019-03-13 13:12:15Z

6

Convert lists to boolean by astype, empty lists return Falses, so filtering working nice:

df1 = df[df['D'].astype(bool)]
print (df1)
     A    B    C                                 D
0  foo  foo  foo                      [list_value]
1  bar  bar  bar  [list_value, another_list_value]

Another solution is filter by length with Series.str.len - it working with all iterables:

df1 = df[df['D'].str.len() != 0]

answered Mar 13, 2019 at 13:12

jezrael

868k103 gold badges1.4k silver badges1.3k bronze badges

Sign up to request clarification or add additional context in comments.

Collectives™ on Stack Overflow

How to filter rows containing empty lists in a pandas DataFrame?

1 Answer 1

Comments

Your Answer

Linked

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

Comments

Your Answer

Sign up or log in

Post as a guest

Linked

Related