problems with handling unicode characters in python

Question

I wrote the below code for writing the contents to the file,

   with codecs.open(name,"a","utf8") as myfile:
         myfile.write(str(eachrecord[1]).encode('utf8'))
         myfile.write(" ")
         myfile.write(str(eachrecord[0]).encode('utf8'))
         myfile.write("\n")`

The above code does not work properly when writing uni-code characters....Even though i am using codecs and doing the encoding. I keep getting the error

UnicodeEncodeError: 'ascii' codec can't encode character u'\xe1' in position 6: ordinal not in range(128)

Can anyone see where i am doing it wrong ?

Edit:

with codecs.open(name,"a","utf8") as myfile:
                    myfile.write(unicode(eachrecord[1]))
                    myfile.write(" ")
                    myfile.write(unicode(eachrecord[0]))
                    myfile.write("\n")

This worked..Thanks for all the quick comments and answers..that really helps ..I did not realize that python has 'unicode' option until you guys told me

What type is eachrecord[1]? str is making the mess I guess, use unicode instead. — Fenikso
– Fenikso, Commented Apr 26, 2012 at 16:12
And I think you do not even have to encode the unicode string, as the file opened using codecs should handle it. — Fenikso
– Fenikso, Commented Apr 26, 2012 at 16:14
TypeError: coercing to Unicode: need string or buffer, int found..any suggestions on how to resolve this — kich
– kich, Commented Apr 26, 2012 at 16:15

Avaris · Accepted Answer · 2012-04-26 16:12:28Z

2

Remove the str() calls. They are doing an implicit encoding with the default encoding (ascii in this case).

answered Apr 26, 2012 at 16:12

Avaris

36.9k7 gold badges85 silver badges72 bronze badges

Sign up to request clarification or add additional context in comments.

1 Comment

kich Over a year ago

Thank you, i keep getting this error "AttributeError: 'int' object has no attribute 'encode'" when i remove the str() calls

Collectives™ on Stack Overflow

problems with handling unicode characters in python

1 Answer 1

1 Comment

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

1 Comment

Your Answer

Sign up or log in

Post as a guest

Related