Python- Getting link of new webpage using selenium

Question

I'm new to selenium and I wrote this code that gets user input and searches in ebay but I want to save the new link of the search so I can pass it on to BeautifulSoup.

from selenium import webdriver
from selenium.webdriver.common.keys import Keys

search_ = input()
browser = webdriver.Chrome(r'C:\Users\Leila\Downloads\chromedriver_win32')
browser.get("https://www.ebay.com.au/sch/i.html?_from=R40&_trksid=p2499334.m570.l1311.R1.TR12.TRC2.A0.H0.Xphones.TRS0&_nkw=phones&_sacat=0")
Search = browser.find_element_by_id('kw')
Search.send_keys(search_)
Search.send_keys(Keys.ENTER)
#how do you write a code that gets the link of the new page it loads

AzyCrw4282 · Accepted Answer · 2020-03-21 01:19:53Z

2

To extract a link from a webpage, you need to make use of the HREF attribute and use the get_attribute() method.

This example from here illustrates how it would work.

from selenium import webdriver

options = webdriver.ChromeOptions()
options.add_argument('--ignore-certificate-errors')
driver = webdriver.Chrome(chrome_options=options)

driver.get('https://www.w3.org/')
for a in driver.find_elements_by_xpath('.//a'):
    print(a.get_attribute('href'))

In your case, do:

Search = browser.find_element_by_id('kw')
page_link = Search.get_attribute('href')

edited Mar 21, 2020 at 1:19

answered Mar 21, 2020 at 1:12

AzyCrw4282

7,9145 gold badges26 silver badges43 bronze badges

Sign up to request clarification or add additional context in comments.

1 Comment

Leila K. Over a year ago

thankyou. Are the code on top with the 'options' necessary?

Collectives™ on Stack Overflow

Python- Getting link of new webpage using selenium

1 Answer 1

1 Comment

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

1 Comment

Your Answer

Sign up or log in

Post as a guest

Related