Catching source with selenium before automatic redirect in python

Question

Consider the following page: https://www.cvs.com/shop/advil-pain-reliever-fever-reducer-ibuprofen-tablets-200mg-prodid-1040240?skuid=420321

When selecting a different format, like 100 CT, a new price shows up. Copy that URL and navigate to it, notice that it redirects back to the original 10 CT page.

I want to get the price of what's on the 100 CT page.

Here is my code, which clicks the right format, but when I try to reobtain the url I still get the 10 CT page.

    format_header =  browser.find_element_by_css_selector("ul.--horizontalScroll.gbcvs-c-variantSelectorList")
    items = format_header.find_elements_by_tag_name('li')

    format_count = 1
    for item in items:
        text = item.text
        if(text == '100 CT'):
            break
        else: 
            format_count += 1

    browser.find_element_by_xpath("(.//*[normalize-space(text()) and normalize-space(.)='Count:'])[1]/following::label["+str(format_count)+"]").click()

    print(browser.current_url)

    browser.get(browser.current_url)

supputuri · Accepted Answer · 2019-03-21 13:27:45Z

1

Here is the code that ran and found the price correctly. You can get the price by using print (driver.find_element_by_css_selector("p.shoppdp-c-productPricing__actual").text)

Here is the method code for wait_until_element_not_present

def wait_until_element_not_present(locator_type,locator):
    if locator_type == 'xpath':
        WebDriverWait(driver, 10).until_not(EC.presence_of_element_located((By.XPATH, locator)))
    elif locator_type == "css":
        WebDriverWait(driver, 10).until_not(EC.presence_of_element_located((By.CSS_SELECTOR, locator)))

edited Mar 21, 2019 at 13:27

answered Mar 21, 2019 at 4:28

supputuri

14.2k2 gold badges26 silver badges42 bronze badges

Sign up to request clarification or add additional context in comments.

2 Comments

dirtyw0lf Over a year ago

Which library contains "wait_until_element_not_present"? selenium-python.readthedocs.io/waits.html

JeffC Over a year ago

Instead of passing the locator type and the locator as strings, pass it as a triplet as in this answer. Now you don't have to parse the locator type and deal with each one differently. It turns your function into a one-liner which is easier to manage and more flexible.

dirtyw0lf · Accepted Answer · 2019-03-21 12:34:31Z

0

@supputuri's answer is the correct one, only I replaced wait_until_element_not_present by the following

    WebDriverWait(driver, 10).until(
    EC.presence_of_element_located((By.CLASS_NAME, "gbcvs-c-addToCart__inner"))
    )

answered Mar 21, 2019 at 12:34

dirtyw0lf

1,9986 gold badges39 silver badges70 bronze badges

Collectives™ on Stack Overflow

Catching source with selenium before automatic redirect in python

2 Answers 2

2 Comments

Comments

Your Answer

Linked

Hot Network Questions

Collectives™ on Stack Overflow

2 Answers 2

2 Comments

Comments

Your Answer

Sign up or log in

Post as a guest

Linked

Related