Python Pandas: Skip rows by particular pattern (not row number) using pd.read_csv

Question

I'm trying to import the csv file into the Pandas DataFrame. However, here is the challenge, for example, I cannot use skiprows=9, because the csv format is inconsistent from time to time, it will contain some useless information before the actual table begins.

Fortunately, before the table starts, there will always have a single row with the string "report field", and then the real table starts from the next line.

Is there any way I can skip all the rows until it catches the pattern "report field"?

Thanks.

Venkatesh Durgumahanthi · Accepted Answer · 2017-06-28 11:01:01Z

1

df= pandas.read_csv("file.csv",header= None)
df_2= df.iloc[(df.loc[df[0]=='report field'].index[0]+1):, :].reset_index(drop = True)

So, the above line searches for "report field" value in "0" column of "df" dataframe and then picks up data from the next row to the last row in the "file.csv" file

answered Jun 28, 2017 at 11:01

Venkatesh Durgumahanthi

9152 gold badges8 silver badges12 bronze badges

Sign up to request clarification or add additional context in comments.

Collectives™ on Stack Overflow

Python Pandas: Skip rows by particular pattern (not row number) using pd.read_csv

1 Answer 1

Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

Comments

Your Answer

Sign up or log in

Post as a guest

Related