Pandas read_csv incorrectly reading headers

Question

I am reading a csv file using 'pd.read_csv' and writing it to another csv using 'file.to_csv'. It is incorrectly displaying the headers in the output file. For example,

input:

ABC | 20151004 | 1900 | 0000000002 | MUPPETS SP 1-10/4, THE |  |  | R|RS

0

0

0

0

0

2993

script:

data = pd.read_csv(r'filepath/input.csv')

print data

Input header: ABC | 20151004 | 1900 | 0000000002 | MUPPETS SP 1-10/4, THE | | | R|RS

Output header: ABC | 20151004 | 1900 | 0000000002 | MUPPETS SP 1-10/4, THE | | | R|RS.1

Not sure why it is adding '.1' to the end of some of the headers.

Possible duplicate of stackoverflow.com/questions/20845213/… — Kartik
– Kartik, Commented Aug 6, 2016 at 5:15
Better duplicate question: stackoverflow.com/questions/26786960/… — Kartik
– Kartik, Commented Aug 6, 2016 at 5:16
I tried using index=False param. I am receiving below error. TypeError: parser_f() got an unexpected keyword argument 'index' — naveen ch
– naveen ch, Commented Aug 6, 2016 at 5:22

Merlin · Accepted Answer · 2016-08-06 16:30:23Z

0

Try this:

data = pd.read_csv(r'filepath/input.csv',sep='|')

The rs.1 is likely indicative of duplicate 'rs' columns

answered Aug 6, 2016 at 16:30

Merlin

25.9k44 gold badges141 silver badges213 bronze badges

Sign up to request clarification or add additional context in comments.

2 Comments

naveen ch Over a year ago

Thank you. You are right. It's a large file and I did not notice it.It is a duplicate column. Is there a way to read the column as it is without adding '.1' in the end?

Merlin Over a year ago

you need to add some columns to the question, to solve. Those dont look like headers but rather its all data. You also need to work through a tutorial before posting questions. people.duke.edu/~ccc14/sta-663/…

Collectives™ on Stack Overflow

Pandas read_csv incorrectly reading headers

1 Answer 1

2 Comments

Your Answer

Linked

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

2 Comments

Your Answer

Sign up or log in

Post as a guest

Linked

Related