How to extract info within a #shadow-root (open) using Selenium Python?

Question

I got the next url related to an online store https://www.tiendasjumbo.co/buscar?q=mani and I can't extract the product label an another fields:

from selenium import webdriver
import time
from random import randint

driver = webdriver.Firefox(executable_path= "C:\Program Files (x86)\geckodriver.exe")
driver.implicitly_wait(10)
time.sleep(4)

url =  "https://www.tiendasjumbo.co/buscar?q=mani"
driver.maximize_window()
driver.get(url)
driver.find_element_by_xpath('//h1[@class="impulse-title"]')

What am I doing wrong, I also tried to switch the iframes but there is no way to achieve my goal? any help is welcome. enter image description here

What seems to be the problem?

Arundeep Chohan
– Arundeep Chohan

2020-11-28 00:55:34 +00:00
Commented Nov 28, 2020 at 0:55 — Arundeep Chohan
– Arundeep Chohan, Commented Nov 28, 2020 at 0:55
Show us what you are trying to get from the site.

Crapy
– Crapy

2020-11-28 17:12:15 +00:00
Commented Nov 28, 2020 at 17:12 — Crapy
– Crapy, Commented Nov 28, 2020 at 17:12

undetected Selenium · Accepted Answer · 2022-08-04 21:21:56Z

The products within the website https://www.tiendasjumbo.co/buscar?q=mani are located within a #shadow-root (open).

impulse-search

Solution

To extract the product label you have to use shadowRoot.querySelector() and you can use the following Locator Strategy:

Code Block:

driver.get('https://www.tiendasjumbo.co/buscar?q=mani')
item = driver.execute_script("return document.querySelector('impulse-search').shadowRoot.querySelector('div.group-name-brand h1.impulse-title span.formatted-text')")
print(item.text)

Console Output:

La especial mezcla de nueces, maní, almendras y marañones x 450 g

References

You can find a couple of relevant discussions in:

Microsoft Edge and Google Chrome version 96

Chrome v96 has changed the shadow root return values for Selenium. Some helpful links:

Collectives™ on Stack Overflow

How to extract info within a #shadow-root (open) using Selenium Python?

1 Answer 1

Solution

References

Microsoft Edge and Google Chrome version 96

Comments

Your Answer

Linked

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

Solution

References

Microsoft Edge and Google Chrome version 96

Comments

Your Answer

Sign up or log in

Post as a guest

Linked

Related