Finding all child elements in an html page using python selenium webdriver

Question

I want to extract all h2 elements of the div element. The code that I've used is this:

browser = webdriver.Chrome()
browser.get("https://www.mmorpg.com/play-now")
time.sleep(2)
item_list_new=[]
link = browser.find_element_by_xpath("//div[@class='freegamelist']")
names = link.find_element_by_tag_name('h2')
x = names.text
item_list_new.append(x)
print(item_list_new)

But when I run this, I only get the first 'h2' element of the div element. Can somebody tell me what am I doing wrong and also please guide me with the correct way of doing it? Thanks in advance.

ansu5555 · Accepted Answer · 2018-10-21 19:54:42Z

1

you need to write names = link.find_elements_by_tag_name('h2')

Your code should be

browser = webdriver.Chrome()
browser.get("https://www.mmorpg.com/play-now")
time.sleep(2)
item_list_new=[]
link = browser.find_element_by_xpath("//div[@class='freegamelist']")
names = link.find_elements_by_tag_name('h2')
x = names.text
item_list_new.append(x)
print(item_list_new)

find_element_by_tag_name gives the first element and find_elements_by_tag_name gives all the matching elements

answered Oct 21, 2018 at 19:54

ansu5555

4162 silver badges7 bronze badges

Sign up to request clarification or add additional context in comments.

Comments

Andersson · Accepted Answer · 2018-10-21 20:16:51Z

0

Try to get all header values as below:

link = browser.find_element_by_xpath("//div[@class='freegamelist']")
names = link.find_elements_by_tag_name('h2')
item_list_new = [x.text for x in names]
print(item_list_new)

or you can simplify

names = browser.find_elements_by_xpath("//div[@class='freegamelist']//h2")
item_list_new = [x.text for x in names]
print(item_list_new)

answered Oct 21, 2018 at 20:16

Andersson

52.8k18 gold badges83 silver badges132 bronze badges

Comments

Felix · Accepted Answer · 2018-10-21 19:54:54Z

0

You actually want to use the function find_elements_by_tag_name that sounds almost similar, as pointed out here.

answered Oct 21, 2018 at 19:54

Felix

1,90513 silver badges31 bronze badges

Collectives™ on Stack Overflow

Finding all child elements in an html page using python selenium webdriver

3 Answers 3

Comments

Comments

Comments

Your Answer

Linked

Hot Network Questions

Collectives™ on Stack Overflow

3 Answers 3

Comments

Comments

Comments

Your Answer

Sign up or log in

Post as a guest

Linked

Related