Decode JSON date from internet

Question

I am getting JSON from internet (Stackoverflow API) and trying to decode it:

import urllib.request

url = "https://api.stackexchange.com/2.2/questions?order=desc&sort=activity&site=stackoverflow"
fp = urllib.request.urlopen(url)
mybytes = fp.read()
mystr = mybytes.decode("utf8")
fp.close()

print(mystr)

I got the error:

Traceback (most recent call last): File "code.py", line 6, in mystr = mybytes.decode("utf8") UnicodeDecodeError: 'utf-8' codec can't decode byte 0x8b in position 1: invalid start byte

Why and how can I fix it?

Possible duplicate of twitter trends api UnicodeDecodeError: 'utf8' codec can't decode byte 0x8b in position 1: unexpected code byte — Jean Rostan
– Jean Rostan, Commented Apr 18, 2018 at 14:48

score 2 · Accepted Answer · 2018-04-18 14:54:14Z

2

Use requests:

import requests

url = "https://api.stackexchange.com/2.2/questions?order=desc&sort=activity&site=stackoverflow"

res = requests.get(url)
if res.status_code == 200:
    print(res.json())

edited Apr 18, 2018 at 14:54

answered Apr 18, 2018 at 14:49

user9455968

Sign up to request clarification or add additional context in comments.

Comments

ohduran · Accepted Answer · 2018-04-18 14:55:16Z

0

Encoding and decoding utf-8 seems to be tricky in python. Shall I suggest including the .encode() as well.

import urllib.request

url = "https://api.stackexchange.com/2.2/questions?order=desc&sort=activity&site=stackoverflow"
fp = urllib.request.urlopen(url)
mybytes = fp.read()
mystr = mybytes.encode().decode()
fp.close()

print(mystr)

Also, yes, do use Requests. It's fantastic: http://docs.python-requests.org/en/master/

answered Apr 18, 2018 at 14:55

ohduran

8119 silver badges15 bronze badges

Collectives™ on Stack Overflow

Decode JSON date from internet

2 Answers 2

Comments

Comments

Your Answer

Linked

Hot Network Questions

Collectives™ on Stack Overflow

2 Answers 2

Comments

Comments

Your Answer

Sign up or log in

Post as a guest

Linked

Related