Python Web Scraping Product Price

Question

I'm trying to web scrape the product price on this site: https://www.webhallen.com/se/product/232445-Logitech-C920-HD-Pro-Webcam

I tried using

price = str(soup.find('div', {"class": "add-product-to-cart"}))

and

price = soup.find(id="add-product-to-cart").get_text()

But unfortunately, I had no luck. The item returns no price. The price/text is stored in a span class.

baduker · Accepted Answer · 2021-03-22 09:33:16Z

1

The entire website is behind JavaScript so you won't fetch anything with bs4. However, there's an API endpoint with all the data you need.

Here's how to get it:

import requests

with requests.Session() as session:
    response = session.get("https://www.webhallen.com/api/product/232445").json()
    print(response["product"]["price"]["price"])

Output:

1190.00

answered Mar 22, 2021 at 9:33

baduker

20.2k9 gold badges43 silver badges63 bronze badges

Sign up to request clarification or add additional context in comments.

Collectives™ on Stack Overflow

Python Web Scraping Product Price

1 Answer 1

Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

Comments

Your Answer

Sign up or log in

Post as a guest

Related