Selenium Python test doesn't work with Proxy settings

Question

My simple selenium python script to test how proxy fails. How to force webdriver work through proxy connection?

from selenium import webdriver
from selenium.webdriver.common.by import By
from selenium.webdriver.support.ui import WebDriverWait
from selenium.webdriver.support import expected_conditions as EC

PROXY_HOST = "{MYIP}"
PROXY_PORT = 11200
PROXY_USERNAME = "{UNAME}"
PROXY_PASSWORD = "{PW}"

chrome_options = webdriver.ChromeOptions()
chrome_options.add_argument('--proxy-server=http://%s:%s@%s:%s' % (PROXY_USERNAME, PROXY_PASSWORD, PROXY_HOST, PROXY_PORT))
chrome_options.add_argument("ignore-certificate-errors")

chrome = webdriver.Chrome(options=chrome_options)
chrome.get("https://www.ipchicken.com/")

# Wait until a table is present
wait = WebDriverWait(chrome, 30)  # Adjust the timeout as needed
wait.until(EC.presence_of_element_located((By.TAG_NAME, "table")))

# Get the page source
page_source = chrome.page_source

# Output page data as text in console
print(page_source)

# Close the browser
chrome.quit()

It works good if i remove Proxy settings, but, it throws TimeoutException with proxy settings.

My proxy credentials are correct and work well through CURL.

we cant test your credentials or how did you check proxy work — Wonka
– Wonka, Commented May 13, 2024 at 11:29
i'm using iproyal proxy. I used CURL request: curl -v -x USER:[email protected]:12321 -L ipv4.icanhazip.com And it returned changed IP — user1584043
– user1584043, Commented May 13, 2024 at 11:53
then try to remove http:// on chrome_options.add_argument('--proxy-server= but i think you can set proxy auth there. I solved using whitelist in my proxy provider or with a proxy server who call the real proxy and use proxy server on selenium — Wonka
– Wonka, Commented May 13, 2024 at 11:55

Michael Mintz · Accepted Answer · 2024-05-13 13:28:12Z

0

You've got 4 options for authenticated proxy with Selenium Python:

Load a Chrome extension in your Python Selenium script to set those proxy settings: https://stackoverflow.com/a/35293284/7058266
Use selenium-wire: https://stackoverflow.com/a/56276796/7058266
Use seleniumbase: https://stackoverflow.com/a/77580114/7058266
Combine selenium-wire with seleniumbase and change the proxy in the middle of a script as often as you'd like: https://stackoverflow.com/a/78188999/7058266

answered May 13, 2024 at 13:28

Michael Mintz

16.1k9 gold badges51 silver badges109 bronze badges

Sign up to request clarification or add additional context in comments.

Collectives™ on Stack Overflow

Selenium Python test doesn't work with Proxy settings

1 Answer 1

Comments

Your Answer

Linked

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

Comments

Your Answer

Sign up or log in

Post as a guest

Linked

Related