Python Selenium - How to extract element based on text inside span tag?

Question

I am extracting some data from URLhttps://blinkit.com/prn/catch-cumin-seedsjeera-whole/prid/56692 with unstructured Product Details elements.

Using this code:

 product_details = wd.find_elements(by=By.XPATH, value="//div[@class='ProductAttribute__ProductAttributesDescription-sc-dyoysr-2 lnLDYa']")
 info_shelf_life = product_details[0].text.strip()
 info_country_of_origin = product_details[1].text.strip()

As you can see the Product details elements are unstructured and this approach is not suitable when the Index gets changed from URL to URL

Hence tried this approach, which throws out a NoSuchWindowException error.

info_shelf_life = wd.find_element(By.XPATH,value= "//div[[contains(@class, 'ProductAttribute__ProductAttributesDescription-sc-dyoysr-2 lnLDYa') and contains(., 'Shelf Life')]/..")
print(info_shelf_life.text.strip())

How can I extract text inside div based on text inside span tags?

JaSON · Accepted Answer · 2022-07-07 06:35:47Z

1

Your XPath is invalid. You can try

info_shelf_life = wd.find_element(By.XPATH, '//p[span="Shelf Life"]/following-sibling::div').text
info_country_of_origin = wd.find_element(By.XPATH, '//p[span="Country of Origin"]/following-sibling::div').text

to get required data

answered Jul 7, 2022 at 6:35

JaSON

4,8912 gold badges12 silver badges18 bronze badges

Sign up to request clarification or add additional context in comments.

2 Comments

yash agarwal Over a year ago

Could you explain "following-sibling::div" part please

JaSON Over a year ago

@yashagarwal p/following-sibling::div selects div that located on the same level in DOM after p. You can chek XPath axes for more details

Collectives™ on Stack Overflow

Python Selenium - How to extract element based on text inside span tag?

1 Answer 1

2 Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

2 Comments

Your Answer

Sign up or log in

Post as a guest

Related