ValueError when reading in fixed width file using pd.read_fwf - number of expected fields not matching number seen

Question

My current code contains the following:

columns=[(0,4), (4,8), (8,9), (9,10), (20,22), (23,24)]

header=['var1','var2','var3','var4','var5','var6']

file=pd.read_fwf('file_name.gz', compression='gzip', colspec=columns, names=header)

When I run I get the following : ValueError: Expected 8 fields in line 1, saw 3

The data contained in the input file looks as follows:

02011602160108 26 312870000

It seems to be reading the white space instead of noting the column specs

keyword is colspecs, ie. plural

Stephen Rauch
– Stephen Rauch ♦

2017-03-20 21:00:10 +00:00
Commented Mar 20, 2017 at 21:00 — Stephen Rauch
– Stephen Rauch ♦, Commented Mar 20, 2017 at 21:00

piRSquared · Accepted Answer · 2017-03-20 21:03:24Z

1

as @StephenRauch stated in his comment (while I was sluggishly compiling this answer)

from io import StringIO
import pandas as pd

txt = """02011602160108 26 312870000"""

columns=[(0,4), (4,8), (8,9), (9,10), (20,22), (23,24)]
header=['var1','var2','var3','var4','var5','var6']

pd.read_fwf(StringIO(txt), colspecs=columns, names=header)

   var1  var2  var3  var4  var5  var6
0   201  1602     1     6    28     0

answered Mar 20, 2017 at 21:03

piRSquared

296k68 gold badges509 silver badges654 bronze badges

Sign up to request clarification or add additional context in comments.

Collectives™ on Stack Overflow

ValueError when reading in fixed width file using pd.read_fwf - number of expected fields not matching number seen

1 Answer 1

Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

Comments

Your Answer

Sign up or log in

Post as a guest

Related