Data not applying separator to csv file while concatenating in Pandas

Question

I have a set of csv files that I am trying to concat. I am having issues that the concatenated file does not apply the comma separators to the content. Given below is the code:

##Location where the csv files are located
updatedfiles = glob.glob(LOCAL_PATH2 + "/*.csv")

#Applying comma separator to the concatenated output
df_v1 = [pd.read_csv(fp, sep=',', delim_whitespace=True).assign(FileName=os.path.basename(fp)) for fp in updatedfiles]

Could anyone guide me on this. Thanks

Community · Accepted Answer · 2020-06-20 09:12:55Z

1

I believe need to remove delim_whitespace=True, because 2 separators , and whitespace. If need both sep='\s+|,' should working or parameter skipinitialspace=True it need remove trailing whitespaces.

read_csv:

delim_whitespace : boolean, default False

Specifies whether or not whitespace (e.g. ' ' or '\t') will be used as the sep. Equivalent to setting sep='\s+'. If this option is set to True, nothing should be passed in for the delimiter parameter.

edited Jun 20, 2020 at 9:12

CommunityBot

11 silver badge

answered Oct 26, 2018 at 5:19

jezrael

868k103 gold badges1.4k silver badges1.3k bronze badges

Sign up to request clarification or add additional context in comments.

Collectives™ on Stack Overflow

Data not applying separator to csv file while concatenating in Pandas

1 Answer 1

Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

Comments

Your Answer

Sign up or log in

Post as a guest

Related