Pandas: Split a Dataframe into separate Dataframes based on certain Column's string values

Question

Haven't found any answers that I could apply to my problem so here it goes:

I have an initial dataframe of images that I would like to split into two, based on the description of that image, which is a string in the "Description" column.

My problem issue is that not all descriptions are equally written. Here's an example of what I mean:

Some images are accelerated and others aren't. That's the criteria I want to use to split the dataset.

However even accelerated and non-accelerated image descriptions vary among them.

My strategy would be to rename every string that has "ACC" in it - this would cover all accelerated images - to "ACCELERATED IMAGE".

Then I could do:

df_Accl = df[df.Description == "ACCELERATED IMAGE"]
df_NonAccl = df[df.Description != "ACCELERATED IMAGE"]

How can I achieve this? This was just a strategy that I came up with, if there's any other more efficient way of doing this feel free to speak it.

Please try to avoid images and put some data that can be easily loaded next time.. — Franco Piccolo
– Franco Piccolo, Commented Nov 18, 2018 at 17:58

jezrael · Accepted Answer · 2018-11-18 17:56:48Z

8

You can use str.contains for boolean mask - then filter by boolean indexing.

For invert mask is use ~, filter rows not contains ACC:

mask = df.Description.str.contains("ACC")
df_Accl = df[mask]
df_NonAccl = df[~mask]

answered Nov 18, 2018 at 17:56

jezrael

868k103 gold badges1.4k silver badges1.3k bronze badges

Sign up to request clarification or add additional context in comments.

1 Comment

J. Devez Over a year ago

This works (plus it's much more efficient than the strategy I was thinking)!

Franco Piccolo · Accepted Answer · 2018-11-18 17:56:56Z

0

You can use contains to find the rows that contain the substring ACC:

df['Description'].str.contains('ACC')

answered Nov 18, 2018 at 17:56

Franco Piccolo

7,4909 gold badges42 silver badges57 bronze badges

Collectives™ on Stack Overflow

Pandas: Split a Dataframe into separate Dataframes based on certain Column's string values

2 Answers 2

1 Comment

Comments

Your Answer

Linked

Hot Network Questions

Collectives™ on Stack Overflow

2 Answers 2

1 Comment

Comments

Your Answer

Sign up or log in

Post as a guest

Linked

Related