urllib.error.HTTPError: HTTP Error 502: Bad Gateway PYTHON

Question

I am trying to open the Instagram URL using urllib.request.urlopen(url).read() but I am getting the error urllib.error.HTTPError: HTTP Error 502: Bad Gateway

username = input('enter the username - ')
url = "https://www.instagram.com/{}".format(username)
html = urllib.request.urlopen(url).read()
soup = BeautifulSoup(html, 'html.parser')

How can I solve this issue?

EDIT: I got the solution and I have posted it. Cheers :)

I am entering a string, typically a valid Instagram username — Debdut Goswami
– Debdut Goswami, Commented Oct 15, 2019 at 16:12
@DebdutGoswami, hey did you find a solution to this? If yes please can you share that, we are facing the same issue... — Satyen Udeshi
– Satyen Udeshi, Commented Nov 20, 2019 at 10:20

Debdut Goswami · Accepted Answer · 2019-11-28 11:40:05Z

2

First, add
req = urllib.request.Request(url, headers={'User-Agent': 'Mozilla/5.0'})
then type
html = urllib.request.urlopen(req).read()
This will solve the problem. Previously it couldn't verify the origin of the request. We tricked it into thinking that the request is made from a genuine browser, i.e. Mozilla.

answered Nov 28, 2019 at 11:40

Debdut Goswami

1,3791 gold badge14 silver badges32 bronze badges

Sign up to request clarification or add additional context in comments.

Collectives™ on Stack Overflow

urllib.error.HTTPError: HTTP Error 502: Bad Gateway PYTHON

1 Answer 1

Comments

Your Answer

Linked

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

Comments

Your Answer

Sign up or log in

Post as a guest

Linked

Related