TypeError when trying to convert Python 2.7 code to Python 3.4 code

Question

I am having issues converting the code below which was written for Python 2.7 to code compatible in Python 3.4. I get the error TypeError: can't concat bytes to str in the line outfile.write(decompressedFile.read()). So I replaced the line with outfile.write(decompressedFile.read().decode("utf-8", errors="ignore")), but this resulted in the error same error.

import os
import gzip
try:
    from StirngIO import StringIO
except ImportError:
    from io import StringIO
import pandas as pd
import urllib.request
baseURL = "http://ec.europa.eu/eurostat/estat-navtree-portlet-prod/BulkDownloadListing?file="
filename = "data/irt_euryld_d.tsv.gz"
outFilePath = filename.split('/')[1][:-3]

response = urllib.request.urlopen(baseURL + filename)
compressedFile = StringIO()
compressedFile.write(response.read().decode("utf-8", errors="ignore"))

compressedFile.seek(0)

decompressedFile = gzip.GzipFile(fileobj=compressedFile, mode='rb') 

with open(outFilePath, 'w') as outfile:
    outfile.write(decompressedFile.read()) #Error

Doesn't the write mode have to be 'wb'?

TigerhawkT3
– TigerhawkT3

2015-06-23 00:46:04 +00:00
Commented Jun 23, 2015 at 0:46 — TigerhawkT3
– TigerhawkT3, Commented Jun 23, 2015 at 0:46

Kevin · Accepted Answer · 2015-06-23 01:04:30Z

3

The problem is that GzipFile needs to wrap a bytes-oriented file object, but you're passing a StringIO, which is text-oriented. Use io.BytesIO instead:

from io import BytesIO  # Works even in 2.x

# snip

response = urllib.request.urlopen(baseURL + filename)
compressedFile = BytesIO()  # change this
compressedFile.write(response.read())  # and this

compressedFile.seek(0)

decompressedFile = gzip.GzipFile(fileobj=compressedFile, mode='rb') 

with open(outFilePath, 'w') as outfile:
    outfile.write(decompressedFile.read().decode("utf-8", errors="ignore"))
    # change this too

edited Jun 23, 2015 at 1:04

answered Jun 23, 2015 at 0:52

Kevin

30.4k11 gold badges67 silver badges89 bronze badges

Sign up to request clarification or add additional context in comments.

2 Comments

user131983 Over a year ago

Thank You. But I now get the Error TypeError: 'str' does not support the buffer interface in the line compressedFile.write(response.read().decode("utf-8", errors="ignore"))

Kevin Over a year ago

@user131983: Fixed, see edit. You could probably just do compressedFile=BytesIO(response.read())...

Collectives™ on Stack Overflow

TypeError when trying to convert Python 2.7 code to Python 3.4 code

1 Answer 1

2 Comments

Your Answer

Linked

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

2 Comments

Your Answer

Sign up or log in

Post as a guest

Linked

Related