ssl.SSLError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed (_ssl.c:749)

Question

I am trying to use the betbrain.py from Github (https://github.com/gto76/betbrain-scraper) that has the following code:

#!/usr/bin/python3
#
# Usage: betbrain.py [URL or FILE] [OUTPUT-FILE]
# Scrapes odds from passed betbrain page and writes them to
# stdout, or file if specified.

import os
import sys
import urllib.request


from bs4 import BeautifulSoup
from http.cookiejar import CookieJar

import parser_betbrain
import printer

DEFAULT_URL = 'https://www.betbrain.com/football/england/premier-league/#!/matches/'


# If no arguments are present, it parses the default page.
# Argument can be an URL or a local file.
def main():
  html = getHtml(sys.argv)
  soup = BeautifulSoup(html, "html.parser")
  matches = parser_betbrain.getMatches(soup)
  string = printer.matchesToString(matches)
  output(string, sys.argv)

def getHtml(argv):
  if len(argv) <= 1:
    return scrape(DEFAULT_URL)
  elif argv[1].startswith("http"):
    return scrape(argv[1])
  else:
    return readFile(argv[1])

# Returns html file located at URL.
def scrape(url):
  cj = CookieJar()
  opener = urllib.request.build_opener(urllib.request.HTTPCookieProcessor(cj))
  try:
    return opener.open(url)
  except ValueError:
    error("Invalid URL: " + url)

def readFile(path):
  try:
    return open(path, encoding='utf8')
  except IOError:
    error("Invalid input filename: " + path)

def output(string, argv):
  if len(argv) <= 2:
    print(string)
  else:
    writeFile(argv[2], string)

def writeFile(path, string):
  try:  
    fo = open(path, "w", encoding='utf8')
    fo.write(string);
    fo.close()
  except IOError:
    error("Invalid output filename: " + path)

def error(msg):
  msg = os.path.basename(__file__)+": "+msg
  print(msg, file=sys.stderr)
  sys.exit(1)

if __name__ == '__main__':
  main()

However when run it comes back with this error

Traceback (most recent call last):
  File "/Library/Frameworks/Python.framework/Versions/3.6/lib/python3.6/urllib/request.py", line 1318, in do_open
    encode_chunked=req.has_header('Transfer-encoding'))
  File "/Library/Frameworks/Python.framework/Versions/3.6/lib/python3.6/http/client.py", line 1239, in request
    self._send_request(method, url, body, headers, encode_chunked)
  File "/Library/Frameworks/Python.framework/Versions/3.6/lib/python3.6/http/client.py", line 1285, in _send_request
    self.endheaders(body, encode_chunked=encode_chunked)
  File "/Library/Frameworks/Python.framework/Versions/3.6/lib/python3.6/http/client.py", line 1234, in endheaders
    self._send_output(message_body, encode_chunked=encode_chunked)
  File "/Library/Frameworks/Python.framework/Versions/3.6/lib/python3.6/http/client.py", line 1026, in _send_output
    self.send(msg)
  File "/Library/Frameworks/Python.framework/Versions/3.6/lib/python3.6/http/client.py", line 964, in send
    self.connect()
  File "/Library/Frameworks/Python.framework/Versions/3.6/lib/python3.6/http/client.py", line 1400, in connect
    server_hostname=server_hostname)
  File "/Library/Frameworks/Python.framework/Versions/3.6/lib/python3.6/ssl.py", line 401, in wrap_socket
    _context=self, _session=session)
  File "/Library/Frameworks/Python.framework/Versions/3.6/lib/python3.6/ssl.py", line 808, in __init__
    self.do_handshake()
  File "/Library/Frameworks/Python.framework/Versions/3.6/lib/python3.6/ssl.py", line 1061, in do_handshake
    self._sslobj.do_handshake()
  File "/Library/Frameworks/Python.framework/Versions/3.6/lib/python3.6/ssl.py", line 683, in do_handshake
    self._sslobj.do_handshake()
ssl.SSLError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed (_ssl.c:749)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/Users/Daniel/Desktop/betbrain-scraper-master 2/betbrain.py", line 71, in <module>
    main()
  File "/Users/Daniel/Desktop/betbrain-scraper-master 2/betbrain.py", line 22, in main
    html = getHtml(sys.argv)
  File "/Users/Daniel/Desktop/betbrain-scraper-master 2/betbrain.py", line 30, in getHtml
    return scrape(DEFAULT_URL)
  File "/Users/Daniel/Desktop/betbrain-scraper-master 2/betbrain.py", line 41, in scrape
    return opener.open(url)
  File "/Library/Frameworks/Python.framework/Versions/3.6/lib/python3.6/urllib/request.py", line 526, in open
    response = self._open(req, data)
  File "/Library/Frameworks/Python.framework/Versions/3.6/lib/python3.6/urllib/request.py", line 544, in _open
    '_open', req)
  File "/Library/Frameworks/Python.framework/Versions/3.6/lib/python3.6/urllib/request.py", line 504, in _call_chain
    result = func(*args)
  File "/Library/Frameworks/Python.framework/Versions/3.6/lib/python3.6/urllib/request.py", line 1361, in https_open
    context=self._context, check_hostname=self._check_hostname)
  File "/Library/Frameworks/Python.framework/Versions/3.6/lib/python3.6/urllib/request.py", line 1320, in do_open
    raise URLError(err)
urllib.error.URLError: <urlopen error [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed (_ssl.c:749)>

How can I fix this problem? I am running Python 3.6.0 on MacOS 10.12.1

Community · Accepted Answer · 2017-03-09 23:17:27Z

214

Open a terminal and take a look at:

/Applications/Python 3.6/Install Certificates.command

Python 3.6 on MacOS uses an embedded version of OpenSSL, which does not use the system certificate store. More details here.

(To be explicit: MacOS users can probably resolve by opening Finder and double clicking Install Certificates.command)

edited Mar 9, 2017 at 23:17

CommunityBot

11 silver badge

answered Jan 17, 2017 at 8:51

Scovetta

3,1421 gold badge16 silver badges13 bronze badges

Sign up to request clarification or add additional context in comments.

9 Comments

Max L Over a year ago

This command fixed another one problem that described in stackoverflow.com/questions/38835270/…

sorin Over a year ago

I do have the same problem with py36 that was installed using pyenv so this command does not exist. Also, I was able to replicate the same error with python 2.7

tommy.carstensen Over a year ago

Is there a solution, if one doesn't have root access? I did pip3 install --user certifi, but it didn't solve the problem.

harijay Over a year ago

This approach helped me fix another vexing problem: github.com/fangli/django-saml2-auth/issues/24. Its strange that the default installer didnt install this command since it seems it breaks a few other python3.6 programs (canto the rss reader) in a similarly non-obvious way.

azhar22k Over a year ago

Worked for me. But not doing via double clicking gave Permision Denied What I did was cd Applications/Python\ 3.6 And then sudo ./Install\ Certificates.command This worked for me

|

Dev. R · Accepted Answer · 2021-11-05 18:46:16Z

9

In windows adding these 2 lines on the top can be a quick fix:

import ssl
ssl._create_default_https_context = ssl._create_unverified_context

answered Nov 5, 2021 at 18:46

Dev. R

4899 silver badges15 bronze badges

Comments

Joe Jadamec · Accepted Answer · 2018-04-25 19:09:44Z

3

On CentOS Linux, Python3.6, I edited this file (make a backup copy first)

/usr/lib/python3.6/site-packages/certifi/cacert.pem

to the end of the file, I added my public certificate from my .pem file. you should be able to obtain the .pem file from your ssl certificate provider.

answered Apr 25, 2018 at 19:09

Joe Jadamec

1561 silver badge8 bronze badges

Comments

Simas Joneliunas · Accepted Answer · 2021-08-16 03:27:30Z

2

I have encountered the same issue in the official Python docker and solved it by running apt-get update && apt-get install ca-certificates before running any of the nltk code.

edited Aug 16, 2021 at 3:27

answered Aug 16, 2021 at 3:20

Simas Joneliunas

3,15620 gold badges32 silver badges39 bronze badges

1 Comment

nicorellius Over a year ago

After fiddling with my situation, the problem was related to ca-certificates. I updated this package and all is well.

Below the Radar · Accepted Answer · 2025-01-15 14:20:00Z

1

I tried all other solutions but no luck until this. This may not a silver bullet but yet worth a try. Good luck.

import ssl
import urllib.request

ssl_context = ssl._create_unverified_context()
ssl_context.check_hostname = False
ssl_context.verify_mode = ssl.CERT_NONE
opener = urllib.request.build_opener(
    urllib.request.HTTPSHandler(context=ssl_context),
    urllib.request.HTTPCookieProcessor(cj),
)

edited Jan 15 at 14:20

Below the Radar

7,65511 gold badges70 silver badges146 bronze badges

answered Mar 23, 2023 at 15:35

Terry Tú Nguyễn

4304 silver badges8 bronze badges

1 Comment

Gonen Over a year ago

This should be fine when you don't really care about verifying the certificate, ignoring any risk of man-in-the-middle attacks (for sending non-sensitive info).

K.Dᴀᴠɪs · Accepted Answer · 2018-04-12 21:44:46Z

0

Here's how I fixed it:

Opened the Install Cerificates.Command.The shell script got executed.
Opened the Python 3.6.5 and typed in nltk.download().The download graphic window opened and all the packages got installed.

edited Apr 12, 2018 at 21:44

K.Dᴀᴠɪs

10.1k13 gold badges36 silver badges46 bronze badges

answered Apr 12, 2018 at 21:35

S.Harini Sudarsan

91 bronze badge

Collectives™ on Stack Overflow

ssl.SSLError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed (_ssl.c:749)

6 Answers 6

9 Comments

Comments

Comments

1 Comment

1 Comment

Comments

Linked

Hot Network Questions

Collectives™ on Stack Overflow

6 Answers 6

9 Comments

Comments

Comments

1 Comment

1 Comment

Comments

Linked

Related