Error when trying to import multipe csv files into pandas

Question

I am trying to read several csv files from a directory into pandas and concatenate them into one big DataFrame but I have this error:

OSError: Initializing from file failed

Here is my code

import pandas as pd
import glob

path = r'C:/Users/chris/Downloads/Séance2/horodateurs-transactions-de-  paiement' 
all_files = glob.glob(path + "/*.csv")
transac = pd.DataFrame()
li = []

for filename in all_files:
   df = pd.read_csv(filename, index_col=None, header=0)
   li.append(df)

transac = pd.concat(li, axis=0, ignore_index=True)

I don't know why it doesn't work. I tried to solve the problem by using chmod but anything has changed

Possible duplicate of OSError: Initializing from file failed on csv in Pandas — asongtoruin
– asongtoruin, Commented Mar 6, 2019 at 11:47

sambit9238 · Accepted Answer · 2019-11-06 16:11:20Z

0

I also ran into same kind of problem. It turned out the files didn't have any permission and pandas was not showing proper error message.

ls -lh total 152M -rw-rw-r-- 1 iamsam iamsam 3.4K Nov 6 21:34 quora_insincere_question_GUSE+LSTM.ipynb ---------- 1 iamsam iamsam 34M Feb 6 2019 test.csv ---------- 1 iamsam iamsam 119M Oct 30 2018 train.csv

Once I gave the read permission the, it did work well.

run this command on linux : chmod 700 filename OR chmod 700 -R directoryname (to change for all the files in that directory.)

After this pd.read_csv() should work fine.

answered Nov 6, 2019 at 16:11

sambit9238

3215 silver badges8 bronze badges

Sign up to request clarification or add additional context in comments.

Collectives™ on Stack Overflow

Error when trying to import multipe csv files into pandas

1 Answer 1

Comments

Your Answer

Linked

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

Comments

Your Answer

Sign up or log in

Post as a guest

Linked

Related