Targeting Xpath attributes in Selenium

Question

I'm using Selenium to scrape a Web Page and I'm having some problems targeting some attributes.

The page I'm trying to scrape looks like this:

<div>
    <span abc> content </span>
    <span def> content2 </span>
<div>

My goal would be to retrieve the text within the "span abc" tag, without selecting the other text included in the "span def" tag.

I've tried multiple approaches and looked at a lot of different resources but I wasn't able to find the right approach, since I don't want to select all the spans at the same time and I don't want to search based on the text within the tags.

cruisepandey · Accepted Answer · 2021-10-08 10:21:41Z

1

A simple approach would be indexing cause you do not want to select based on

since I don't want to select all the spans at the same time and I don't want to search based on the text within the tags.

If abc is an attribute please use :

//div/span[@abc]

or

with indexing :

(//div/span[@abc])[1]

answered Oct 8, 2021 at 10:21

cruisepandey

29.5k6 gold badges23 silver badges43 bronze badges

Sign up to request clarification or add additional context in comments.

1 Comment

Nicola Pilia Over a year ago

Thanks , your first line is exactly what I was looking for.

Dennis van den Brock · Accepted Answer · 2021-10-08 10:20:56Z

0

If you only want to pull the first span out of these two, you could easily do this with the XPATH. It would look like this:

span = driver.find_element_by_xpath("/html/body/div/span[1]").text

if you want to pull every span, but execute commands with each of these you could do:

span = len(driver.find_elements_by_xpath("/html/body/div/span"))
m = 1

while m <= 0:
    span = driver.find_element_by_xpath("/html/body/div/span["+str(m)+"]")
    print(span.text)

    m = m + 1

answered Oct 8, 2021 at 10:20

Dennis van den Brock

368 bronze badges

Comments

Krupal Vaghasiya · Accepted Answer · 2021-10-08 10:23:26Z

0

You can use xpath like //span[1]/text() for get text inside of the <span> tag

span = driver.find_element_by_xpath("/html/body/div/span[1]/text()")

answered Oct 8, 2021 at 10:23

Krupal Vaghasiya

5388 silver badges26 bronze badges

Collectives™ on Stack Overflow

Targeting Xpath attributes in Selenium

3 Answers 3

1 Comment

Comments

Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

3 Answers 3

1 Comment

Comments

Comments

Your Answer

Sign up or log in

Post as a guest

Related