Saving incorrect col separator in csv file

Question

Basically I'm reading a large csv file, and it has some mistakes. Few of the columns are separated by dot instead of comma. Does anyone know of a way to still run those lines ? example mistake on line two between "test". "test":

CSV.foreach("#{Rails.root}/tmp/test.csv") do |row|

puts  "Mrs","test","test","U26453"
puts  "Mr","test"."[email protected]","U50406"  - CSV::MalformedCSVError: Missing or stray quote in line 2
end

Thank you

this is just a short example of what each row will print out. — Richardlonesteen
– Richardlonesteen, Commented Aug 11, 2015 at 12:01

alexsmn · Accepted Answer · 2015-08-11 12:21:19Z

2

You can write a small regex, which will split by different characters:

split(/[,.]/)

v = '"Mrs","test","test","U26453"'
v.split(/[,.]/)
=> ["\"Mrs\"", "\"test\"", "\"test\"", "\"U26453\""]

UPDATE:

As @gerep noticed, the above will not split correctly when . or , are inside of the substring. As a solution:

split(/"[,.]"/)

edited Aug 11, 2015 at 12:21

user745235

answered Aug 11, 2015 at 12:01

alexsmn

1,74611 silver badges18 bronze badges

Sign up to request clarification or add additional context in comments.

2 Comments

user745235 Over a year ago

It won't work in case there is a dot or comma in any element, like: "Mr","test.something"."test","U50406"

Richardlonesteen Over a year ago

i need to keep commas and clean text, and the text have some dots in there as well.

Collectives™ on Stack Overflow

Saving incorrect col separator in csv file

1 Answer 1

2 Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

2 Comments

Your Answer

Sign up or log in

Post as a guest

Related