Get tag using text selenium beautifulsoup python

Question

I know there's a way using xpath and javascript

    element = browser.find_element_by_xpath("//*[contains(text(),'text')]")

but this method doesn't detect elements/tags, that are defined just as tags, eg:

    <p>
      <span class="text-primary">UK</span>
      +44 (0) 1865 987 667<br>
      Piccadilly Gardens, 49 Piccadilly, Manchester, M1 2AP </p>

In this case, if the text is +44 (0) 1865 987,it does not get the element.

This issue is repetitive in many examples, that incorporates the text this way. What could be the reason?
Is there a way to get the tag, searching using text, in beautifulsoup?

@QHarr yes. There can be. I found a solution by searching for all the tags using selenium, and then matching with the call string. I included a and p for the tags. However, it can get generic than that. — Lakshmi Narayanan
– Lakshmi Narayanan, Commented Sep 14, 2019 at 13:18

Dmitri T · Accepted Answer · 2019-09-16 10:37:08Z

1

My expectation is that you need to use the following functions combination:

normalize-space() - to look for matches in children/ignore leading/trailing whitespaces, etc.
contains() - for the partial match

Putting everything together:

element = driver.find_element_by_xpath("//*[contains(normalize-space(),'+44 (0) 1865 987 667')]")

Demo:

More information: XPath Operators & Functions

answered Sep 16, 2019 at 10:37

Dmitri T

169k6 gold badges91 silver badges149 bronze badges

Sign up to request clarification or add additional context in comments.

Comments

KunduK · Accepted Answer · 2019-09-14 16:59:34Z

0

In Selenium you can try with Sub string matching.

text="+44 (0) 1865 987 667"
print(WebDriverWait(driver,20).until(EC.visibility_of_element_located((By.XPATH,"//*[contains(.,'" + text + "')]"))).text)

answered Sep 14, 2019 at 16:59

KunduK

33.4k5 gold badges19 silver badges42 bronze badges

Collectives™ on Stack Overflow

Get tag using text selenium beautifulsoup python

2 Answers 2

Comments

Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

2 Answers 2

Comments

Comments

Your Answer

Sign up or log in

Post as a guest

Related