ConnectionError when send request to https page with python

Question

I am trying to implement program that determine, if page support tls or not and if it is needed to have prefix www. So I am testing page1.cz and check response status of this objects:

Session().get('http://page1.cz')
<Response [200]>
Session().get('http://www.page1.cz')
<Response [200]>
Session().get('https://page1.cz')
<Response [200]>
Session().get('https://www.page1.cz')
<Response [200]>

It works fine, I know that page1.cz is using https and it is always redirect to https://page1.cz. When I tried page2.cz, I recieved error when testing with https prefix. I receiving this error:

Session().get('http://page2.cz')
<Response [200]>
Session().get('http://www.page2.cz')
<Response [200]>
Session().get('https://page2.cz')
ConnectionError: HTTPSConnectionPool(host='page2.cz', port=443): Max retries exceeded with url: / (Caused by NewConnectionError('<urllib3.connection.VerifiedHTTPSConnection object at 0x7f75e85f03c8>: Failed to establish a new connection: [Errno 111] Connection refused',))
Session().get('https://www.page2.cz')
ConnectionError: HTTPSConnectionPool(host='www.page2.cz', port=443): Max retries exceeded with url: / (Caused by NewConnectionError('<urllib3.connection.VerifiedHTTPSConnection object at 0x7f75e85f03c8>: Failed to establish a new connection: [Errno 111] Connection refused',))

I know that second page does not support https but why that error? It should just return code 4xx or am I wrong? What am I doing wrong and how to check if page support http, https and www prefixes?

You made too many requests and got banned from accessing the website. It is a policy matter and has nothing to do with HTTPS or w/e. — DYZ
– DYZ, Commented Aug 23, 2018 at 22:10
@DYZ It's not a matter of being banned, it's the exception raised when a connection is refused — abc
– abc, Commented Aug 23, 2018 at 22:13
I tried it once and recieved this error. Now, after one hour I am receiving the same error. @newbie am I understand right that the connection refused is because it does not support https? — dorinand
– dorinand, Commented Aug 23, 2018 at 22:19

abc · Accepted Answer · 2018-08-23 22:21:48Z

1

The error says that the host refused the connection and an error is raised.

You can handle the exception using a try-except block.

import requests

try:
    req = requests.get(your_website)
except requests.exceptions.ConnectionError:
    print("Connection refused")

Additionally you can set a timeout for the request, e.g.,

req = requests.get(your_website, timeout=1)

Consider for instance the following website http://www.qq.com/ that does not support https.

With your_website being http://www.qq.com/ you would receive a 200 OK, while with your_website being https://www.qq.com/ an exception is raised.

edited Aug 23, 2018 at 22:21

answered Aug 23, 2018 at 22:11

abc

12k2 gold badges30 silver badges55 bronze badges

Sign up to request clarification or add additional context in comments.

3 Comments

dorinand Over a year ago

So that means, everything works as it should? I except that it will return error code other than 2xx (e.g. 404). I know I could hande excepion, but it looks very unpractical solution. Is there a better way how to check if website support https?

dorinand Over a year ago

So it is normal behaviour to raise an exception when https is not supported?

abc Over a year ago

Note that you could also receive it as a response when HTTP is not supported and a redirect has not being implemented in the server.

Collectives™ on Stack Overflow

ConnectionError when send request to https page with python

1 Answer 1

3 Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

3 Comments

Your Answer

Sign up or log in

Post as a guest

Related