Use Every CSV file in a Folder

Question

I'm trying to have this program use all of the CSV files inside of a folder. The folder is on my desktop, and it's called "Web_Scraper" (I'm on a mac btw).

This is how the code looks; what do I replace whatever is inside of the "enumerate" with (the 1.csv, 2.csv, 3.csv, etc)?

from openpyxl import Workbook
import csv
import os

wb = Workbook()
ws = wb.worksheets[0]

header_keys = []
for n, fName in 

enumerate(['3.csv','4.csv','5.csv','6.csv','7.csv','8.csv','9.csv','10.csv','11.csv','12.csv',]):
with open(fName) as fh:
    csv_reader = csv.DictReader(fh, fieldnames=['header', 'data'], delimiter=',')
    if n == 0:
        for values in csv_reader:

I think I'm supposed to use something like os.listdir but I'm not exaclty sure what the syntax should be.

Possible duplicate of How do I list all files of a directory? — user1427026
– user1427026, Commented Aug 3, 2017 at 5:16
Possible duplicate of Find all files in a directory with extension .txt in Python — SwiftsNamesake
– SwiftsNamesake, Commented Aug 3, 2017 at 5:16

Josh Hamet · Accepted Answer · 2017-08-03 05:07:43Z

1

You can take advantage of the glob module

import glob

scraper_files = glob.glob('*.csv') //returns an array of filenames

answered Aug 3, 2017 at 5:07

Josh Hamet

9578 silver badges10 bronze badges

Sign up to request clarification or add additional context in comments.

Comments

Prakash Palnati · Accepted Answer · 2017-08-03 05:12:36Z

1

you can use something like below,

import os
from pathlib import Path

rootdir = 'xx/xx/x'

for subdir, dirs, files in os.walk(rootdir):
    for file in files:
        if ('.csv' in Path.suffix)
            csv_reader = csv.DictReader(file, fieldnames=['header', 'data'], delimiter=',')

answered Aug 3, 2017 at 5:12

Prakash Palnati

3,44927 silver badges36 bronze badges

Comments

viveksyngh · Accepted Answer · 2017-08-03 05:10:37Z

0

You can use os module

import os
os.listdir('~/Desktop/Web_Scraper') # Returns list of files or directory  names inside that dir

And you can apply filter on file name extension to filter out only csv files

answered Aug 3, 2017 at 5:10

viveksyngh

7877 silver badges15 bronze badges

Comments

Om Prakash · Accepted Answer · 2017-08-03 05:25:07Z

0

You can use python's inbuilt os module.

import os
os.listdir("this-directory")  # returns list of files in this-directory

E.g.

import os
for file in os.listdir("."):  # reading from current directory, replace it with your directory.
   if file.endswith(".csv"):
      with open(file) as fh:
          csv_reader = csv.DictReader(fh, fieldnames=['header', 'data'], delimiter=',')
              if n == 0:
                  for values in csv_reader:

Hope it helps!

edited Aug 3, 2017 at 5:25

answered Aug 3, 2017 at 5:14

Om Prakash

2,9014 gold badges32 silver badges50 bronze badges

Collectives™ on Stack Overflow

Use Every CSV file in a Folder

4 Answers 4

Comments

Comments

Comments

Comments

Your Answer

Linked

Hot Network Questions

Collectives™ on Stack Overflow

4 Answers 4

Comments

Comments

Comments

Comments

Your Answer

Sign up or log in

Post as a guest

Linked

Related