Reading Specific Files from folder in Python

Question

I have folder with 12000 csv sample files and I need to read only certain files of interest from it. I have a list with filenames that I want to read from that folder. Here's my code so far

Filenames # list that contains name of filenames that I want to read 

# Import data
data_path= "/MyDataPath"
data = []

i=0
# Import csv files
#I feel I am doing a mistake here with looping Filenames[i]
for file in glob.glob(f"{data_path}/{Filenames[i]}.csv", recursive=False): 

    df = pd.read_csv(file,header=None)

    # Append dataframe
    data.append(df)
    i=i+1

This code only reads first file and ignores all other.

shuvo · Accepted Answer · 2022-03-16 20:52:53Z

1

The problem is you are not iterating over the Filenames.

Try the following:

# i=0
# Import csv files
#I feel I am doing a mistake here with looping Filenames[i]
for f in Filenames: 
    file = glob.glob(f"{data_path}/{f}.csv", recursive=False)
    df = pd.read_csv(file,header=None)
    # Append dataframe
    data.append(df)
    # i=i+1

answered Mar 16, 2022 at 20:52

shuvo

1,9745 gold badges34 silver badges42 bronze badges

Sign up to request clarification or add additional context in comments.

Comments

user27640657 · Accepted Answer · 2024-10-05 09:34:09Z

0

import pandas as pd

data = pd.read_csv('c:/users/path_name/path_name/path_name/filename.csv')

This works. When the path is copied and pasted from explorer need to change the direction of the "/". Usually when copied and pasted, its pasted as "". Changing to / works.

edited Oct 5, 2024 at 9:34

user4136999

answered Oct 5, 2024 at 9:20

user27640657

11 bronze badge

Collectives™ on Stack Overflow

Reading Specific Files from folder in Python

2 Answers 2

Comments

Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

2 Answers 2

Comments

Comments

Your Answer

Sign up or log in

Post as a guest

Related