Use urllib or requests to get data from URL

Question

I am trying to use urllib, urllib2 or requests in order to get specific data from a site. I use Python2.7. I keep getting an error:

requests.exceptions.SSLError: [SSL: SSLV3_ALERT_HANDSHAKE_FAILURE] sslv3 alert handshake failure (_ssl.c:590)

This is my code with requests:

  import requests
  r = requests.get("https://metoc.ndbc.noaa.gov/jtwc#_48_INSTANCE_0SiamlX2KcM6_=https%3A%2F%2Fmetoc.ndbc.noaa.gov%2FProductFeeds-portlet%2Fimg%2Fjtwc%2Fhtml%2Fcoop.jsp%3F")

I have tried everything but nothing works:

I tried to set the verification parameter to false. I get the same error. I tried to use an adaptor (as described in other answers) in order to use another SSL version. I still get the same error.

Any ideas what can the issue be? Can it be that the host has locked the access and there is no possibility to get the source for this URL?

@user1919 You get the same sslv3 error explicitly setting tls? The server will not accept any sslv3 even with ECDHE encryption — Padraic Cunningham
– Padraic Cunningham, Commented Jul 6, 2016 at 23:02
Maybe a silly question but you did use s to make the request ? i.e the session object? — Padraic Cunningham
– Padraic Cunningham, Commented Jul 6, 2016 at 23:07
One last thing what does openssl version output from bash? — Padraic Cunningham
– Padraic Cunningham, Commented Jul 6, 2016 at 23:12

Steffen Ullrich · Accepted Answer · 2016-07-06 20:57:48Z

2

All of them in macs with Yosemite or ElCapitan...

These versions still come with OpenSSL 0.9.8 so my guess is that your python is linked against this version of OpenSSL (python does not use the native TLS stack in OS X). But since the server only supports ECDHE ciphers and these are not supported by OpenSSL 0.9.8 the handshake will fail. See the report from SSLLabs for more details.

answered Jul 6, 2016 at 20:57

Steffen Ullrich

125k11 gold badges155 silver badges194 bronze badges

Sign up to request clarification or add additional context in comments.

6 Comments

user1919 Over a year ago

Thanks! So what would be my options here?

Padraic Cunningham Over a year ago

@user1919 upgrade your openssl ftp.openssl.org/source

user1919 Over a year ago

@Padraic Cunningham I have updated my openssl using brew. This didn't solve the issue!

Padraic Cunningham Over a year ago

Did you try setting the adapter using tls as per the link I added to the comments?

Steffen Ullrich Over a year ago

@user1919: it is not enough to update openssl but it has to be linked with python. To check what version of openssl your python is using check ssl.OPENSSL_VERSION. See stackoverflow.com/questions/18752409/… for more information for how to update your python to include a newer version of openssl.

|

Collectives™ on Stack Overflow

Use urllib or requests to get data from URL

1 Answer 1

6 Comments

Your Answer

Linked

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

6 Comments

Your Answer

Sign up or log in

Post as a guest

Linked

Related