Python Selenium headless option gives "Message: element not interactable" error [duplicate]

Question

I'm trying to scrape a webpage to get the contact number everything works fine but i want to run the script in "--headless" mode but when i do with this option i'm getting error. But it works when i disable --headless mode.

My code :

import time
from bs4 import BeautifulSoup
from selenium import webdriver 
from selenium.webdriver.chrome.options import Options
chrome_options = Options()
chrome_options.add_argument("--headless")

#options.add_argument('--disable-gpu')  # maybe needed if running on Windows.
driver = webdriver.Chrome(executable_path='/home/dobuyme/Desktop/chromedriver', options=chrome_options)
print("Loading Page...")
driver.get('https://www.example.com')
time.sleep(5)
show_number_btn_xpath = '//span[contains(text(),"Show number")]'
sk = driver.find_element_by_xpath(show_number_btn_xpath)
sk.click()

soup = BeautifulSoup(driver.page_source,"html.parser")
title = soup.find("span", {"class": ["_truncate_multilines multiline_truncation"]}).get_text()
app = soup.find("div", {"class": ["_top_row-destop text-left"]}).find("h2").get_text().strip()
driver.quit()
contact = soup.find("div", {"class": ["_user_contact"]}).find("p", {"class": ["_call text-left"]}).get_text()
print(contact)

Error :

selenium.common.exceptions.ElementNotInteractableException: Message: element not interactable

How i can run this script in --headless mode ?

Thanks

Which line give you that error ? Is it show_number_btn_xpath = '//span[contains(text(),"Show number")]' ? — cruisepandey
– cruisepandey, Commented Jun 14, 2021 at 6:49
@cruisepandey he just trying to gain some points. This is exactly what he asked in his previous question and I answered him there. It's OKay :) — Prophet
– Prophet, Commented Jun 14, 2021 at 7:06
@Prophet : Gaining more reputation is a long term time investment here at SO. He would fed up after some time doing this. It's a fair game. — cruisepandey
– cruisepandey, Commented Jun 14, 2021 at 7:21

Sarath C · Accepted Answer · 2021-06-14 06:49:33Z

0

Finally i fixed by adding

chrome_options.add_argument("--window-size=1920,1080")
chrome_options.add_argument("--start-maximized")
chrome_options.add_argument("--headless")

answered Jun 14, 2021 at 6:49

Sarath C

2371 gold badge3 silver badges11 bronze badges

Sign up to request clarification or add additional context in comments.

1 Comment

Prophet Over a year ago

So you just re-asked your previous question and answered here what I have answered you there?

Collectives™ on Stack Overflow

Python Selenium headless option gives "Message: element not interactable" error [duplicate]

1 Answer 1

1 Comment

Linked

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

1 Comment

Linked

Related