Python - Execute command line function on every file in a directory?

Question

I have a directory of CSV files that I want to import into MySQL. There are about 100 files, and doing a manual import is painful.

My command line is this:

mysqlimport -u root -ppassword --local --fields-terminated-by="|" data PUBACC_FR.dat

The files are all of type XX.dat, i.e. AC.dat, CP.dat, etc. I actually rename them first before processing them (via rename 's/^/PUBACC_/' *.dat). Ideally I'd like to be able to accomplish both tasks in one script: Rename the files, then run the command.

From what I've found reading, something like this:

for filename in os.listdir("."):
    if filename.endswith("dat"):
        os.rename(filename, filename[7:])

Can anyone help me get started with a script that will accomplish this, please? Read the file names, rename them, then for each one run the mysqlimport command?

Thanks!

Any reason why you want to do that in Python ? You can simply run ls *dat|xargs -n 1 mysqlimport -u root -ppassword --local --fields-terminated-by="|" data in your shell. — damienfrancois
– damienfrancois, Commented Oct 19, 2013 at 17:58

Xaldew · Accepted Answer · 2013-10-19 15:47:53Z

1

I suppose something like the python code below could be used:

import subprocess
import os


if __name__ == "__main__":
    for f in os.listdir("."):
        if (f.endswith(".dat")):
            subprocess.call("echo %s" % f, shell=True)

Obviously, you should change the command from echo to your command instead.

See http://docs.python.org/2/library/subprocess.html for more details of using subprocess, or see the possible duplicate.

answered Oct 19, 2013 at 15:47

Xaldew

7188 silver badges20 bronze badges

Sign up to request clarification or add additional context in comments.

Collectives™ on Stack Overflow

Python - Execute command line function on every file in a directory?

1 Answer 1

Comments

Your Answer

Linked

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

Comments

Your Answer

Sign up or log in

Post as a guest

Linked

Related