Extract text from webpage with ChromeDriverManager (Python)

Question

I need to get the core question asked on this page and so far this is the code I have used. The problem is that it brings me 'to next question' instead of the expected core question.

from selenium import webdriver
from webdriver_manager.chrome import ChromeDriverManager
from selenium.webdriver.chrome.options import Options

chrome_options = Options()
chrome_options.add_argument("--window-size=1200,850")
driver = webdriver.Chrome(ChromeDriverManager().install())

url = 'http://ipaulgraham.herokuapp.com/'      
driver.get(url)

for i in driver.find_elements_by_xpath("//*[contains(text(), 'question')]"):
    print(i.text)

--to next question

Omar Aflak · Accepted Answer · 2021-05-10 22:47:23Z

2

It seems that the question is inside a div that has question as its id. I guess you can do something like:

from selenium.webdriver.common.by import By
element = browser.find_element(By.ID, "question")
print(element.text)

answered May 10, 2021 at 22:47

Omar Aflak

2,9621 gold badge24 silver badges39 bronze badges

Sign up to request clarification or add additional context in comments.

Collectives™ on Stack Overflow

Extract text from webpage with ChromeDriverManager (Python)

1 Answer 1

Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

Comments

Your Answer

Sign up or log in

Post as a guest

Related