Can't find elements on web page using Selenium Python

Question

I want to find text element on the web page (address is below)

enter image description here

I am interested in reddit post title. (it is pointed out on the screen)

I use Ctrl+Shift+I and inspected element and get:

<h2 class="s1ua9il2-0 hsWiTe" data-redditstyle="true">The problems of a dutchman in China.</h2>

There is no id and name. Only tag ('h2') and class ("s1ua9il2-0 hsWiTe"), right?

My code below doesn't work:

import selenium
from selenium import webdriver
from selenium.webdriver.common.keys import Keys

options = webdriver.ChromeOptions()
options.add_argument('headless')
driver = webdriver.Chrome(r"C:\Users\vishniakov\Desktop\python bj\driver\chromedriver.exe",chrome_options=options)
driver.get("https://www.reddit.com/r/funny/comments/9kxrv6/the_problems_of_a_dutchman_in_china/")
print(driver.title)
elem = driver.find_element_by_class_name("s1ua9il2-0 hsWiTe")
#driver.quit()

ERROR:

selenium.common.exceptions.InvalidSelectorException: Message: invalid selector: Compound class names not permitted

Also, finding by css_selector doesn't work too, when I use copy click:

enter image description here

praw.readthedocs.io/en/latest/index.html ?

G_M
– G_M

2018-10-03 16:25:01 +00:00
Commented Oct 3, 2018 at 16:25 — G_M
– G_M, Commented Oct 3, 2018 at 16:25
You may want to use xpath instead of just get.

oshaiken
– oshaiken

2018-10-03 16:26:05 +00:00
Commented Oct 3, 2018 at 16:26 — oshaiken
– oshaiken, Commented Oct 3, 2018 at 16:26

oshaiken · Accepted Answer · 2018-10-03 16:28:33Z

2

then,

from selenium.webdriver.common.by import By

driver.find_element(By.XPATH, '//button[text()="Some text"]')

answered Oct 3, 2018 at 16:28

oshaiken

2,6701 gold badge19 silver badges27 bronze badges

Sign up to request clarification or add additional context in comments.

4 Comments

Кирилл Вишняков Over a year ago

I am very sorry, but this method doesn't work at next case: driver.get("youtube.com/watch?v=D1l_l_dP99Y") elem = driver.find_element(By.XPATH,'//*[@id="owner-name"]/a') # element is name of the channel "MrVinylObsessive" There is working video

Void Spirit Over a year ago

You have to use elem.getText(). If you did not miss that, what error you are getting?

Кирилл Вишняков Over a year ago

I miss that. Where should I use elem.getText().?

Majid Adibian Over a year ago

This way to get xpath helped me so much. just want to say that some websites change id of tags dinamicaly

Andrej Shulaev · Accepted Answer · 2018-10-03 16:28:01Z

0

Try to do it by xpath f12 - click on element and copy xpath for example:

browser.find_element_by_xpath('//*[@id="modal-manager"]/div/div/div[2]/div/div[3]/div[1]/button')

answered Oct 3, 2018 at 16:28

Andrej Shulaev

581 silver badge5 bronze badges

Collectives™ on Stack Overflow

Can't find elements on web page using Selenium Python

2 Answers 2

4 Comments

Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

2 Answers 2

4 Comments

Comments

Your Answer

Sign up or log in

Post as a guest

Related