Fixing broken umlauts from database in ruby script

Question

I'm working on a ruby script (using sequel) to transfer data from an old database to a new one. Because of an encoding problem with the old database I got values like "MÃ¼nchen" instead of "München".

DB = Sequel.mysql2 'db_name', user: 'name', password: '***', host: '127.0.0.1' # , encoding:  Encoding::CP1252.name) # doesn't work
city = DB[:users].first['city'] # => "MÃ¼nchen"
city.encoding # => #<Encoding:UTF-8>
city.encode(Encoding::UTF_8, Encoding::CP1252) # => "MÃƒÂ¼nchen"

The old db's encoding is set to CP1252, the new one is utf-8.

I tried to #gsub the broken umlauts, but that doesn't work:

umlauts = {
 'Ã¤' => 'ä',
 'Ã¶' => 'ö',
 'Ã¼' => 'ü',
 'ÃŸ' => 'ß'
}

city.gsub(/[#{umlauts.keys.join}]/, umlauts) # => "Mnchen"

I'm completely clueless how to correctly work with encoding, do you know how I can get 'München'?

What was it that didn't work about your gsub? mine works fine: string = "MÃ¼nchen";string.gsub("Ã¼", "ü");=> "München" — Mike H-R
– Mike H-R, Commented Apr 16, 2014 at 15:12

csch · Accepted Answer · 2014-04-16 15:43:01Z

1

Turns out the way I used #gsub has been wrong (thanks Mike H-R!), this works:

umlauts = {
  'Ã¤' => 'ä',
  'Ã¶' => 'ö',
  'Ã¼' => 'ü',
  'ÃŸ' => 'ß'
}

city.gsub(/#{umlauts.keys.join("|")}/, umlauts)' # => "München"

edited Apr 16, 2014 at 15:43

answered Apr 16, 2014 at 15:35

csch

4,9062 gold badges22 silver badges23 bronze badges

Sign up to request clarification or add additional context in comments.

Collectives™ on Stack Overflow

Fixing broken umlauts from database in ruby script

1 Answer 1

Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

Comments

Your Answer

Sign up or log in

Post as a guest

Related