Open csv using Python using relative filepath

Question

os.chdir(r"C:\Downloads")

I'm getting stuck with reading in files in Python. Why does specifying the relative file path not work when reading the file?

files = os.listdir(r"csvfilestoimport")

files
['file1.csv', 'file2.csv']

df1 = pd.concat([pd.read_csv(f) for f in files])
FileNotFoundError: [Errno 2] File file.csv does not exist:'file1.csv'

Does the file exist? In the second case you write to another filename. — Erich
– Erich, Commented Aug 15, 2020 at 10:29
In the first case, you are reading an existing file. In the second case you are creating a file — bigbounty
– bigbounty, Commented Aug 15, 2020 at 10:30
Yes I want to read an existing file, do some analysis and export as xlsx. The file exists in the folder since the full filepath works when reading the csv. — arv
– arv, Commented Aug 15, 2020 at 10:30
is the change of the current directory successful? what does os.getcwd() say after you run the command? — FObersteiner
– FObersteiner, Commented Aug 15, 2020 at 10:33

Hryhorii Pavlenko · Accepted Answer · 2020-08-15 11:36:13Z

1

os was my choice before I learned about pathlib.

from pathlib import Path


path = Path("C:\Downloads")
df = pd.concat([pd.read_csv(f) for f in path.rglob("*.csv")])

With pathlib you don't have to join directory and file manually.

answered Aug 15, 2020 at 11:36

Hryhorii Pavlenko

3,9104 gold badges21 silver badges38 bronze badges

Sign up to request clarification or add additional context in comments.

Comments

Ricardo Rendich · Accepted Answer · 2020-08-15 11:07:41Z

1

Try creating a new file with a name you are sure that doesn't exist before (in your entire computer), and check that it is created in the folder you think. Then try to read it.

Ok, now with your example. Please, note that

files = os.listdir(r"csvfilestoimport")
['file1.csv', 'file2.csv']

really means

['csvfilestoimport\file1.csv', 'csvfilestoimport\file2.csv']

So, you need to add this folder (r"csvfilestoimport"+f)

df1 = pd.concat([pd.read_csv(r"csvfilestoimport\"+f) for f in files])

edited Aug 15, 2020 at 11:07

answered Aug 15, 2020 at 11:01

Ricardo Rendich

6515 silver badges6 bronze badges

1 Comment

arv Over a year ago

I'm getting: SyntaxError: EOL while scanning string literal

Hryhorii Pavlenko · Accepted Answer · 2020-08-15 11:29:35Z

1

See this eg.

root_path = r"C:\Downloads"
filelist = glob.glob(f"{root_path}//*.csv")
df1 = pd.concat([pd.read_csv(f) for f in filelist])

edited Aug 15, 2020 at 11:29

Hryhorii Pavlenko

3,9104 gold badges21 silver badges38 bronze badges

answered Aug 15, 2020 at 11:13

Siddharth Nobell

1461 gold badge2 silver badges8 bronze badges

Comments

Harsha Varanasi · Accepted Answer · 2020-08-15 10:31:37Z

0

In OS.chdir() try giving the full path of the downloads "C:\Users\xxxx\Downloads" and try again

os.chdir(r'C:\Users\xxxxx\Downloads')

answered Aug 15, 2020 at 10:31

Harsha Varanasi

12 bronze badges

1 Comment

Harsha Varanasi Over a year ago

if your code is not in the same folder where your source file is, then while changing the directory you should mention that in full

Collectives™ on Stack Overflow

Open csv using Python using relative filepath

4 Answers 4

Comments

1 Comment

Comments

1 Comment

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

4 Answers 4

Comments

1 Comment

Comments

1 Comment

Your Answer

Sign up or log in

Post as a guest

Related