Writing Russian characters to txt file using python [duplicate]

Question

I try to write to txt file list with russian string.(I get that with unique1 = np.unique(df['search_term']), it's numpy.ndarray)

thefile = open('search_term.txt', 'w')
for item in unique1:
    thefile.write("%s\n" % item)

But in list this string looks correct. But after writing it looks like

 РїСЂРµРґРјРµС‚РѕРІ berger bg bg045-14 РѕС‚Р·С‹РІС‹
 Р·РІРµР·Рґ 
 РІРѕСЂРѕРЅРµР¶

Why a get that?

Does the data appear correct when you view it in your dataframe? — Padraic Cunningham
– Padraic Cunningham, Commented Jul 8, 2016 at 14:38

Daniel Waghorn · Accepted Answer · 2016-07-08 09:57:14Z

0

Try writing to the file like this:

import codecs

thefile = codecs.open('search_term.txt', 'w', encoding='utf-8')  
for item in unique1:
    thefile.write("%s\n" % item)

The problem is that the file likely is encoded correctly hence why the characters will display incorrectly.

answered Jul 8, 2016 at 9:57

Daniel Waghorn

2,9852 gold badges22 silver badges34 bronze badges

Sign up to request clarification or add additional context in comments.

1 Comment

UnicodeDecodeError: 'utf8' codec can't decode byte 0xd7 in position 2: invalid continuation byte