How to read/loop through multiple .csv files in a folder using Google Colab python, then assign each file as a function parameter

Question

I'm currently using Google Colab and already mounted my Google Drive. I have a folder inside the drive that has multiple .csv files

e.g. folder name: dataset

folder content: data1.csv, data2.csv, data3.csv, and so on

I want to iterate through every file in the folder, then make the file a function parameter

Here's my code but still didn't work

from google.colab import drive
drive.mount('/content/drive/')

def myfunction(data):
###function detail here###

dir = '/content/drive/dataset'

for files in dir:
  myfunction(pd.read_csv('filename'))

Thank you

Andrew Chisholm · Accepted Answer · 2022-04-09 17:50:09Z

3

You have to iterate over files using a function like os.listdir. Here's an example that uses this function and defensively checks that what is read is a csv file. I've used Google Colab's sample_data folder so that the code is reproducible; you will need to change the dir variable to point to your Google Drive folder.

import pandas as pd
import os

def myfunction(data):
  print(data)

dir = 'sample_data'

for file in os.listdir(dir):
  if file.endswith(".csv"):
    myfunction(file)

answered Apr 9, 2022 at 17:50

Andrew Chisholm

6,5972 gold badges26 silver badges43 bronze badges

Sign up to request clarification or add additional context in comments.

Comments

Dhivya Bharkavi · Accepted Answer · 2022-07-07 10:41:36Z

0

from google.colab import drive
drive.mount('/content/drive')

#os.lis`enter code here`tdir(file_path) 
def myfunction(data):
  print(data)
file_path = 'drive/MyDrive/eeg-feature-generation-master/dataset/original_data'

for file in os.listdir(file_path):
  if file.endswith(".csv"):
    myfunction(file)

Drive already mounted at /content/drive; to attempt to forcibly remount, call drive.mount("/content/drive", force_remount=True).
subjectc-neutral-2.csv
subjectc-relaxed-2.csv
subjectd-neutral-1.csv
subjectb-neutral-1.csv
subjecta-concentrating-2.csv
subjectd-concentrating-1.csv
subjectc-concentrating-2.csv
subjectc-relaxed-1.csv
subjectb-relaxed-2.csv
subjectc-neutral-1.csv
subjecta-relaxed-2.csv
subjectd-relaxed-1.csv
subjectd-neutral-2.csv

edited Jul 7, 2022 at 10:41

answered Jul 7, 2022 at 9:01

Dhivya Bharkavi

254 bronze badges

1 Comment

Community Over a year ago

Your answer could be improved with additional supporting information. Please edit to add further details, such as citations or documentation, so that others can confirm that your answer is correct. You can find more information on how to write good answers in the help center.

Collectives™ on Stack Overflow

How to read/loop through multiple .csv files in a folder using Google Colab python, then assign each file as a function parameter

2 Answers 2

Comments

1 Comment

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

2 Answers 2

Comments

1 Comment

Your Answer

Sign up or log in

Post as a guest

Related