Python selenium webdriver: list index out of range

Question

I have following code to scroll down a javascript enabled website. Problem is when the newHeight reaches around 229275 I get list out of range on the line browser.find_elements_by_class_name('alt')[0].click(). But why I am getting this error and how can I solve this?

My code:

browser = webdriver.PhantomJS("phantomjs")
    browser.get(url)
        while True:            
         time.sleep(pause)
         newHeight = browser.execute_script("return document.body.scrollHeight")
         print newHeight
         browser.find_elements_by_class_name('alt')[0].click()

The element doesn't exist in the page at the time find_elements_by_class_name is called. It's either no longer present or not yet present. Try to wait for it or handle the case where it's no longer present. — Florent B.
– Florent B., Commented Jul 20, 2017 at 22:28

Andersson · Accepted Answer · 2017-07-21 04:49:21Z

1

Try to scroll down page and click element with below approach:

from selenium.webdriver.common.keys import Keys
from selenium.webdriver.common.by import By
from selenium.webdriver.support.ui import WebDriverWait as wait
from selenium.webdriver.support import expected_conditions as EC
from selenium.common.exceptions import NoSuchElementException

browser = webdriver.PhantomJS("phantomjs")
browser.get(url)
while True:
    browser.find_element_by_tag_name("body").send_keys(Keys.END)
    try:
        wait(browser, 10).until(EC.element_to_be_clickable((By.CLASS_NAME, "alt"))).click()
    except NoSuchElementException:
        break

This should allow you to click required element in case it can be found or break loop otherwise

answered Jul 21, 2017 at 4:49

Andersson

52.8k18 gold badges83 silver badges133 bronze badges

Sign up to request clarification or add additional context in comments.

Comments

ThunderHorn · Accepted Answer · 2017-07-20 22:19:35Z

0

Simply try/except statement

browser = webdriver.PhantomJS("phantomjs")
browser.get(url)
    while True:   
     try:
        time.sleep(pause)
        newHeight = browser.execute_script("return document.body.scrollHeight")
        print newHeight
        browser.find_elements_by_class_name('alt')[0].click()
     except:
        pass

answered Jul 20, 2017 at 22:19

ThunderHorn

2,0452 gold badges24 silver badges44 bronze badges

Comments

zawata · Accepted Answer · 2017-07-20 22:31:29Z

0

I would recommend checking the list before acting upon it.

browser = webdriver.PhantomJS("phantomjs")
browser.get(url)
while True:            
    time.sleep(pause)
    newHeight = browser.execute_script("return document.body.scrollHeight")
    print newHeight
    alt_elements = browser.find_elements_by_class_name('alt')
    if len(alt_elements):
        alt_elements[0].click()

Just a side note, an infinite while loop can be a dangerous thing.

answered Jul 20, 2017 at 22:31

zawata

1726 bronze badges

Collectives™ on Stack Overflow

Python selenium webdriver: list index out of range

3 Answers 3

Comments

Comments

Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

3 Answers 3

Comments

Comments

Comments

Your Answer

Sign up or log in

Post as a guest

Related