How to remove html tags from strings in Python using BeautifulSoup

Question

programming newbie here :)

I'd like to print the prices from the website using BeautifulSoup. this is my code:

#!/usr/bin/env python
# -*- coding: utf-8 -*-


from bs4 import BeautifulSoup, SoupStrainer
from urllib2 import urlopen

url = "Some retailer's url"
html = urlopen(url).read()
product = SoupStrainer('span',{'style': 'color:red;'})
soup = BeautifulSoup(html, parse_only=product)
print soup.prettify()

and it prints prices in the following order:

<span style="color:red;">
 180
</span>
<span style="color:red;">
 1250
</span>
<span style="color:red;">
 380
</span>

I tried print soup.text.strip() but it returned 1801250380

Please help me to print the prices per single row :)

Many thanks!

jfs · Accepted Answer · 2014-03-11 00:19:17Z

2

>>> print "\n".join([p.get_text(strip=True) for p in soup.find_all(product)])
180
1250
380

answered Mar 11, 2014 at 0:19

jfs

417k210 gold badges1k silver badges1.7k bronze badges

Sign up to request clarification or add additional context in comments.

Comments

Steinar Lima · Accepted Answer · 2014-03-11 00:20:38Z

2

This will get you a list of strings converted to integers:

>>> [int(span.text) for span in soup.find_all('span')]
[180, 1250, 380]

answered Mar 11, 2014 at 0:20

Steinar Lima

7,8292 gold badges41 silver badges39 bronze badges

2 Comments

frbry Over a year ago

This will stop working if the markup changes from span to, let's say, div.

Steinar Lima Over a year ago

So you are saying that if the code structure changes, the web scraping code needs to be updated? That should go without saying.

Collectives™ on Stack Overflow

How to remove html tags from strings in Python using BeautifulSoup

2 Answers 2

Comments

2 Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

2 Answers 2

Comments

2 Comments

Your Answer

Sign up or log in

Post as a guest

Related