Max retries exceeded with url error while running the code?

Question

I write this code to scrap this particular page but it constantly gave

error "requests.exceptions.SSLError: HTTPSConnectionPool(host='rcms.assam.gov.in', port=443): Max retries exceeded with url: /Show_Reports.aspx?RID=86 (Caused by SSLError(SSLCertVerificationError(1, '[SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: unable to get local issuer certificate (_ssl.c:1129)')))"

import requests
from bs4 import BeautifulSoup as bs


url = "https://rcms.assam.gov.in/Show_Reports.aspx?RID=86"
page = requests.get(url)
soup = bs(page.text,"lxml")

jackal · Accepted Answer · 2022-02-18 08:24:38Z

10

At your own risk you can do this:

page = requests.get(url, verify=False)

answered Feb 18, 2022 at 8:24

jackal

29.1k3 gold badges9 silver badges28 bronze badges

Sign up to request clarification or add additional context in comments.

5 Comments

Deepak singh Over a year ago

InsecureRequestWarning: Unverified HTTPS request is being made to host 'rcms.assam.gov.in'. Adding certificate verification is strongly advised. See: urllib3.readthedocs.io/en/1.26.x/… warnings.warn(

Deepak singh Over a year ago

it gave this error

jackal Over a year ago

That is not an error. It's a warning

Deepak singh Over a year ago

so how can i resolve that so i can scrap data from that page

jackal Over a year ago

You can disable the warning with urllib3.disable_warnings() However, that's the least of your worries. You're going to have to figure out how to bypass the Captcha

Neil · Accepted Answer · 2022-09-13 08:53:04Z

1

Download the website certificate to your local computer, and then

page = requests.get(url, verify="path to certificate")

answered Sep 13, 2022 at 8:53

Neil

336 bronze badges

1 Comment

Pfalbaum Over a year ago

And how would one go about downloading the website certificate?

Lijo Abraham · Accepted Answer · 2023-01-12 08:06:49Z

1

As said by Fred, do it at your own risk. To disable the warning along with verify=False use the below code.

from urllib3.exceptions import InsecureRequestWarning
from urllib3 import disable_warnings

disable_warnings(InsecureRequestWarning)

page = requests.get(url, verify=False)

answered Jan 12, 2023 at 8:06

Lijo Abraham

8819 silver badges32 bronze badges

Collectives™ on Stack Overflow

Max retries exceeded with url error while running the code?

3 Answers 3

5 Comments

1 Comment

Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

3 Answers 3

5 Comments

1 Comment

Comments

Your Answer

Sign up or log in

Post as a guest

Related