Python selenium get page title

Question

from selenium import webdriver
from selenium.webdriver.common.by import By
from selenium.webdriver.support.ui import WebDriverWait
from selenium.webdriver.support import expected_conditions as EC
from selenium.webdriver.firefox.options import Options

options = Options()
options.headless = True
driver = webdriver.Firefox(options=options)
driver.get("https://hapondo.qa/rent/doha/apartments/studio")
element = WebDriverWait(driver, 10).until(
    EC.presence_of_element_located((By.XPATH, "/html/head/title"))
)

print(element.text)

Unable to get page title under headless option? Tried to wait and even tried driver.title

what is the error you are getting? You are using incorrect locator - css_selector or xpath ? — Sureshmani Kalirajan
– Sureshmani Kalirajan, Commented Nov 11, 2020 at 20:33
@Sureshmani sorry, just corrected it now. but still not solved the issue. — αԋɱҽԃ αмєяιcαη
– αԋɱҽԃ αмєяιcαη, Commented Nov 11, 2020 at 20:37
Where is your WebDriverWait line? because it works okay for me if I have it before print(driver.title) — Matthew King
– Matthew King, Commented Nov 11, 2020 at 20:53
@MatthewKing i tried multiple times but getting empty print. repl.it/@AmericanY/issue#main.py — αԋɱҽԃ αмєяιcαη
– αԋɱҽԃ αмєяιcαη, Commented Nov 11, 2020 at 20:58

undetected Selenium · Accepted Answer · 2020-11-11 21:49:39Z

8

You need to take care of a couple of things as follows:

To retrieve the Page Title instead of using a xpath you need to use driver.title
The hapondo website contains JavaScript enabled elements.

Solution

To extract the Page Title you need to induce WebDriverWait for the title_contains() and you can use either of the following Locator Strategy:

Code Block:

from selenium import webdriver
from selenium.webdriver.support.ui import WebDriverWait
from selenium.webdriver.support import expected_conditions as EC

options = webdriver.ChromeOptions() 
options.add_argument('--headless')
options.add_argument('--window-size=1920,1080')
driver = webdriver.Chrome(options=options, executable_path=r'C:\WebDrivers\chromedriver.exe')
driver.get('https://hapondo.qa/rent/doha/apartments/studio')
WebDriverWait(driver, 10).until(EC.title_contains("hapondo"))
print(driver.title)

Console Output:

Studio Apartments for rent in Doha | hapondo

References

You can find a couple of relevant detailed discussions in:

How to make selenium wait before getting contents from the actual website which loads after the landing page through IEDriverServer and IE

answered Nov 11, 2020 at 21:49

undetected Selenium

194k44 gold badges304 silver badges387 bronze badges

Sign up to request clarification or add additional context in comments.

3 Comments

αԋɱҽԃ αмєяιcαη Over a year ago

how about if the page title like this how can i add more strings?

undetected Selenium Over a year ago

@αԋɱҽԃαмєяιcαη The phrase hapondo is a string which I'm sure would be present in the Page Title for any webpage with https://hapondo.qa. You can use any string which suits your requirement.

undetected Selenium Over a year ago

@αԋɱҽԃαмєяιcαη I had a look at the Rent section but was unable to conclude which string among bedroom, furnished, apartment, in or by could be common within the Page Title for all the rented properties. You can use the common term as the expected text within the Expected Conditions.

lionrocker221 · Accepted Answer · 2020-11-11 21:25:00Z

-2

By "page title", I'm assuming you mean the text that appears on the tab at the top of the browser.

Solution that changes little of your code:

from selenium import webdriver
from selenium.webdriver.common.by import By
from selenium.webdriver.support.ui import WebDriverWait
from selenium.webdriver.support import expected_conditions as EC


driver = webdriver.Firefox(executable_path=r"[path]")
driver.get("https://hapondo.qa/rent/doha/apartments/studio")


element = WebDriverWait(driver, 10).until(
        EC.presence_of_element_located((By.XPATH, "/html/head/title"))
    )

print(element.get_attribute("innerHTML"))
Output: Studio Apartments for rent in Doha | hapondo

Another way of getting that text is by simply using driver.title.

"The title method is used to retrieve the title of the webpage the user is currently working on. "

Source: GeeksForGeeks

from selenium import webdriver
import time
driver = webdriver.Firefox(executable_path=r"[PATH]")
driver.get("https://hapondo.qa/rent/doha/apartments/studio")
time.sleep(2)

print(driver.title)
#Output: Studio Apartments for rent in Doha | hapondo

Alternate solution which changes very little:

edited Nov 11, 2020 at 21:25

answered Nov 11, 2020 at 21:11

lionrocker221

1713 silver badges10 bronze badges

7 Comments

αԋɱҽԃ αмєяιcαη Over a year ago

That's still not answering the question. i need that to done on the website which i provided. i tried driver.title and got nothing printed out

Matthew King Over a year ago

@αԋɱҽԃαмєяιcαη You should update your code to show the headless option is set as that is related to cause of the problem

lionrocker221 Over a year ago

@αԋɱҽԃαмєяιcαη, Nope, worked for me: Studio Apartments for rent in Doha | hapondo was outputted

αԋɱҽԃ αмєяιcαη Over a year ago

@MatthewKing you are correct. the headless option is the cause of the issue. still trying to figure out a way for it.

αԋɱҽԃ αмєяιcαη Over a year ago

@lionrocker221 sorry, i noticed that the issue is regarding headless browser. do you have any clue ?

|

Collectives™ on Stack Overflow

Python selenium get page title

2 Answers 2

Solution

References

3 Comments

7 Comments

Your Answer

Linked

Hot Network Questions

Collectives™ on Stack Overflow

2 Answers 2

Solution

References

3 Comments

7 Comments

Your Answer

Sign up or log in

Post as a guest

Linked

Related