Python3 error with str and byte code object

Question

So I tried to write a simple function to clean a text and summarize it:

def getTextWaPo(url):
page = urllib2.urlopen(url).read().decode('utf8')
soup = BeautifulSoup(page, "lxml")
text = ' '.join(map(lambda p: p.text, soup.find_all('article')))
return text.encode('ascii', errors='replace').replace("?"," ")

but for this piece of code I get this error :

  File "Autosummarizer.py", line 12, in getTextWaPo
  return text.encode('ascii', errors='replace').replace("?"," ")
  TypeError: a bytes-like object is required, not 'str'

  line 12 ==> text = getTextWaPo(articleURL)

what should I do?

Md Jewele Islam · Accepted Answer · 2018-12-11 18:37:36Z

0

Your are encoding data in line 12 using you have to use bytes. as replace(b"?", b" ")

The code look like

import requests
from urllib.request import urlopen
from bs4 import BeautifulSoup
def getTextWaPo(url):
    page = urlopen(url).read().decode('utf8')
    soup = BeautifulSoup(page, "lxml")
    text = ' '.join(map(lambda p: p.text, soup.find_all('article')))
    return text.encode('ascii', errors='replace').replace(b"?",b" ")
getTextWaPo("https://stackoverflow.com/")

answered Dec 11, 2018 at 18:37

Md Jewele Islam

1,0379 silver badges19 bronze badges

Sign up to request clarification or add additional context in comments.

Comments

Volker Böhm · Accepted Answer · 2018-12-11 18:31:33Z

0

You must change your last line return text.encode('ascii', errors='replace').replace("?"," ") to return text.encode('ascii', errors='replace').replace(b"?", b" ") because after the encode() you're operating on bytes, and must replace bytes with other bytes.

answered Dec 11, 2018 at 18:31

Volker Böhm

215 bronze badges

Collectives™ on Stack Overflow

Python3 error with str and byte code object

2 Answers 2

Comments

Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

2 Answers 2

Comments

Comments

Your Answer

Sign up or log in

Post as a guest

Related