Scrape web pages using python

Question

I have the following web page

</div><a href="https://www.emag.ro/laptop-lenovo-thinkbook-15-iil-cu-procesor-intel-core-i7-1065g7-pana-la-3-90-ghz-15-6-full-hd-16gb-512gb-ssd-intel-iris-plus-graphics-free-dos-mineral-grey-20sm003jrm/pd/DKBK1TMBM/#reviews-section" rel="nofollow" class="star-rating-container js-product-url" data-zone="reviews"><div class="star-rating star-rating-read rated-4.02  star-rating-sm  ">
        <div class="star-rating-inner " style="width: 100%"></div>
    </div><div class="star-rating-text ">

I want to extract the rating from this product. For this product, the rating is defined here.

<div class="star-rating star-rating-read rated-4.02  star-rating-sm  ">

And i cannot extract 4.02.

My code looks like :

rating = container.find_all(class_="star-rating star-rating-read rated")[0].text

I know that the above code is not ok, I was able to extract the price and name of the product but I can't extract the rating :(

sushanth · Accepted Answer · 2021-05-15 11:00:30Z

1

Here is a solution you can try out,

import re

# regex extract the decimal digits from string
extract_ = re.compile(r"\d+.\d+") 

for div in container.find_all("div", attrs={"class": 'star-rating'}):
    for attr in div.attrs['class']:
        ratings_ = extract_.search(attr)

        if ratings_:
            print(ratings_.group())  # 4.02

answered May 15, 2021 at 11:00

sushanth

8,2923 gold badges20 silver badges31 bronze badges

Sign up to request clarification or add additional context in comments.

Comments

Orbital · Accepted Answer · 2021-05-15 11:01:59Z

0

Try something like this:

rating = str(container.find_all(class_="star-rating")[0])
rindex = rating.index("rated")
print(rating[rindex+6:rindex+10])

answered May 15, 2021 at 11:01

Orbital

5833 silver badges13 bronze badges

2 Comments

jack Over a year ago

it works but some products has after rating the word "stars" and if the rating in an integer the output will be sth like this 5 st or 4 st, if the rating is a float like 4,02 the output is great

jack Over a year ago

Solved... score=rating[rindex+6:rindex+10].replace(' st', '')

Collectives™ on Stack Overflow

Scrape web pages using python

2 Answers 2

Comments

2 Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

2 Answers 2

Comments

2 Comments

Your Answer

Sign up or log in

Post as a guest

Related