Selenium using WebDriverWait WebElement still doesn't print any text, recognizes string PYTHON

Question

As title. Couldn't find a solution online. You'll see by the print statements that the program will get the text property from the WebElement object, but it is always an empty string even though I am using WebDriverWait.

from selenium import webdriver
from selenium.webdriver.common.keys import Keys
from selenium.webdriver.common.by import By
from selenium.webdriver.support.ui import WebDriverWait
from selenium.webdriver.support import expected_conditions as EC

import time

PATH = "C:\\Users\\Anthony\\Desktop\\chromedriver.exe"

driver = webdriver.Chrome(PATH)

website = "https://www.magicspoiler.com"
driver.get(website)

el_name = '//div[@class="set-card-2 pad5"]'

try:
    main = WebDriverWait(driver, 20).until(EC.presence_of_element_located((By.XPATH, el_name)))

    articles = main.find_elements(By.XPATH, el_name)
    
    for article in articles:
        print(type(article.text))
        print(article.text)

finally:
    driver.quit()

Anand Gautam · Accepted Answer · 2022-01-04 17:43:24Z

1

I checked the HTML DOM and I don't see any text in the element you are looking for. They are simply images with anchor links and therefore you are getting blank responses.

I have given an alternate try, to extract the links and they were successful. So, after refactoring your code, it looks like this:

from selenium import webdriver
from selenium.webdriver.common.keys import Keys
from selenium.webdriver.common.by import By
from selenium.webdriver.support.ui import WebDriverWait
from selenium.webdriver.support import expected_conditions as EC

import time

PATH = "C:\\Users\\Anthony\\Desktop\\chromedriver.exe"

driver = webdriver.Chrome(PATH)
website = "https://www.magicspoiler.com"
driver.get(website)

el_name = '//div[@class="set-card-2 pad5"]/a'

try:
    main = WebDriverWait(driver, 20).until(EC.presence_of_element_located((By.XPATH, el_name)))

    articles = main.find_elements(By.XPATH, el_name)

    for article in articles:
        # print(type(article.text))
        print(article.get_attribute("href"))

finally:
    pass
    driver.quit()

Here is the response I got:

So, please check if you want to get the links or really the text. If you want the text, then there is none that I see in DOM as I said. You may have to traverse through each of the link by clicking on it, and find if any you need fro the navigated page.

answered Jan 4, 2022 at 17:43

Anand Gautam

2,1011 gold badge6 silver badges9 bronze badges

Sign up to request clarification or add additional context in comments.

2 Comments

Anthony Spano Over a year ago

Hi Anand, thanks for your response! I tried running your code in cmd line and it returns None for each href. Do you have any idea why?

Anand Gautam Over a year ago

Maybe your code/folder path needs a review, for I ran the same code from cmd line (windows commandprompt) and it fetched the links. Here is the result:

DevTools listening on ws://127.0.0.1:63329/devtools/browser/66f398f4-c0ca-4ac7-972c-afd90ef4db2a https://www.magicspoiler.com/mtg-spoiler/flame-discharge/ https://www.magicspoiler.com/mtg-spoiler/nezumi-prowler/ https://www.magicspoiler.com/mtg-spoiler/jukai-trainee/ https://www.magicspoiler.com/mtg-spoiler/the-kami-war-unconfirmed/ https://www.magicspoiler.com/mtg-spoiler/satoru-umezawa/

Collectives™ on Stack Overflow

Selenium using WebDriverWait WebElement still doesn't print any text, recognizes string PYTHON

1 Answer 1

2 Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

2 Comments

Your Answer

Sign up or log in

Post as a guest

Related