how to make except only one value of some in selenium?

Question

I want to find title, address, price of some items in an online mall. But, sometimes the address is empty and my code is break in my code(below_it's an only selenium part)

num = 1
while 1:
    try:
        title = browser.find_element_by_xpath('//*[@id="root"]/div[1]/section/article/div/div['+str(num)+']/div/div/a/span').text
        datas_title.append(title)

        address = browser.find_element_by_xpath('//*[@id="root"]/div[1]/section/article/div/div['+str(num)+']/div/div/a/div/p[2]').text
        datas_address.append(address)

        price = browser.find_element_by_xpath('//*[@id="root"]/div[1]/section/article/div/div['+str(num)+']/div/div/a/p').text
        datas_price.append(price)
        print('crowling....num = '+str(num))
        
        num=num+1
    except Exception as e:
        print("finish get data...")
        break

print(datas_title)
print(datas_address)
print(datas_price)

what should I do if the address is empty -> just ignore it and find the next items?

Babatunde Mustapha · Accepted Answer · 2022-04-18 01:57:28Z

1

Use this so you can skip the entries with missing information:

num = 1
while 1:
    try:
        title = browser.find_element_by_xpath('//*[@id="root"]/div[1]/section/article/div/div['+str(num)+']/div/div/a/span').text
        datas_title.append(title)

        address = browser.find_element_by_xpath('//*[@id="root"]/div[1]/section/article/div/div['+str(num)+']/div/div/a/div/p[2]').text
        datas_address.append(address)

        price = browser.find_element_by_xpath('//*[@id="root"]/div[1]/section/article/div/div['+str(num)+']/div/div/a/p').text
        datas_price.append(price)
        print('crowling....num = '+str(num))
        
        num=num+1
    except:
        print("an error was encountered")
        continue

print(datas_title)
print(datas_address)
print(datas_price)

answered Apr 18, 2022 at 1:57

Babatunde Mustapha

2,76325 silver badges22 bronze badges

Sign up to request clarification or add additional context in comments.

Comments

Arundeep Chohan · Accepted Answer · 2022-04-18 03:42:19Z

0

address = browser.find_element_by_xpath('//*[@id="root"]/div[1]/section/article/div/div['+str(num)+']/div/div/a/div/p[2]').text
if not address: 
    address = "None"
else: 
    address = address[0].text
datas_title.append(address)

You could use find_elements to check if it's empty and then proceed to do it with either value. You can than encapsulate this into a function pass it the xpath and the data_title array and your code should be repeatable.

answered Apr 18, 2022 at 3:42

Arundeep Chohan

9,9895 gold badges17 silver badges36 bronze badges

Comments

DharmanBot · Accepted Answer · 2022-04-18 12:03:26Z

0

I think you need to first check if the web element returned isn't none. And then proceed with fetching text.

You could write a function for it, and catch that exception in it.

edited Apr 18, 2022 at 12:03

DharmanBot

1,0742 gold badges7 silver badges10 bronze badges

answered Apr 18, 2022 at 7:00

Pallavi

415 bronze badges

Collectives™ on Stack Overflow

how to make except only one value of some in selenium?

3 Answers 3

Comments

Comments

Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

3 Answers 3

Comments

Comments

Comments

Your Answer

Sign up or log in

Post as a guest

Related