Python CSV module, special split string

Question

i had an unique problem. I have code:

with open("test.csv", "r") as csvFile:
reader = csv.reader(csvFile, skipinitialspace=True)
for row in reader:
    for obj in row:
        print(obj)

and exemplary csv file:

anotherCommand, e=5, f=6, g=7, h=9, test="aaa, bbb, ggggg"

i want split this string in this way:

anotherCommand
e=5
f=6
g=7
h=9
test="aaa, bbb, ggggg"

but code which i was presented, split these string in this way:

anotherCommand
e=5
f=6
g=7
h=9
test="aaa
bbb
ggggg"

This is wrong solution this problem. I saw topic like: Why is the Python CSV reader ignoring double-quoted fields? or How can i parse a comma delimited string into a list (caveat)?

But this example is different, and these examples not come up my expectation. Someone have idea?

@cᴏʟᴅsᴘᴇᴇᴅ doesn't work, the same situation like in linked sites :) — Robert Pawlak
– Robert Pawlak, Commented Aug 17, 2017 at 8:31
Can you please add some details? What exactly did you do, that didn't work. — cs95
– cs95, Commented Aug 17, 2017 at 8:32
i wrote: with open("test.csv", "r") as csvFile: for line in csv.reader(csvFile, quotechar='"', delimiter=',', quoting=csv.QUOTE_ALL, skipinitialspace=True): print(len(line)) ---- and i still get the same values like presented in my main answer — Robert Pawlak
– Robert Pawlak, Commented Aug 17, 2017 at 8:35
Key to your problem is that your "csv" isn't a well-formed CSV file. If you can generate it so it is valid then python csv parsing will work. Seems like for your example you need to add quotes around the test="aaa, bbb, ggggg" so it looks like "test="aaa, bbb, ggggg"", but you might get away with simply adding quotes around every value. — DisappointedByUnaccountableMod
– DisappointedByUnaccountableMod, Commented Aug 17, 2017 at 9:03

Jon Clements · Accepted Answer · 2017-08-17 08:53:42Z

1

You could possibly make use of shlex.split here:

import shlex

with open('test.csv') as fin:
    for line in fin:
        row = [col.rstrip(',') for col in shlex.split(line)]
        print(*row, sep='\n')

answered Aug 17, 2017 at 8:53

Jon Clements

143k34 gold badges254 silver badges288 bronze badges

Sign up to request clarification or add additional context in comments.

6 Comments

Robert Pawlak Over a year ago

Great man! Works! Could You explain me more Your solution? Or link sites, that should i visit to learn?

Robert Pawlak Over a year ago

This is a advantage I planed delete them in further file process

Jon Clements Over a year ago

@Robert as to references - have a look at the documentation for the shlex module - it tries to parse text as a shell would when passing command line arguments to a program... (which is what your lines looked more like to me than actual CSV data - so just thought I'd give it a go and see if it produced something workable with for your use case and it mostly did minus retaining trailing commas - hence the str.rsplit there)...

Robert Pawlak Over a year ago

this is an output with different format, which was designed on csv.

Jon Clements Over a year ago

@Robert Might make sense if you do a values = dict(col.partition('=')[::2] for col in row) to get a dict of key/values to use if that's applicable for what you want to use it for...

|

Collectives™ on Stack Overflow

Python CSV module, special split string

1 Answer 1

6 Comments

Your Answer

Linked

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

6 Comments

Your Answer

Sign up or log in

Post as a guest

Linked

Related