how to read files from multiple folders in python

Question

my folder organization looks like below. Type 1 and Type 2 folders contains same files but I want to only read the files from 'type 2' folder. Is there any simple way to do that?

I have used this code but not able to read:

for file in os.listdir('Type 2'):
    print file

your help will be highly appreciated!

jezrael · Accepted Answer · 2016-06-09 07:57:43Z

12

IIUC you need read_csv in folders Type 2, use glob:

files = glob.glob('main/**/Type 2/*.csv')
dfs = [pd.read_csv(fp) for fp in files]
df = pd.concat(dfs)

edited Jun 9, 2016 at 7:57

answered Jun 9, 2016 at 7:52

jezrael

868k103 gold badges1.4k silver badges1.3k bronze badges

Sign up to request clarification or add additional context in comments.

3 Comments

bikuser Over a year ago

i got this error while reading.. glob() got an unexpected keyword argument 'recursive'

jezrael Over a year ago

try remove it, solution is untested yet.

bikuser Over a year ago

yes that might be the problems, now I am using 2.7.0 , but when I remove recursive it works perfectly :).

Collectives™ on Stack Overflow

how to read files from multiple folders in python

1 Answer 1

3 Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

3 Comments

Your Answer

Sign up or log in

Post as a guest

Related