Auth proxies in Seleniumbase not working on ubuntu

Question

I have a small seleniumbase parser which works fine with a list of auth proxies on Windows. After deploying it on ubuntu server, the code crashed with an exception:

selenium.common.exceptions.WebDriverException: Message: unknown error: cannot connect to chrome at 127.0.0.1:хххх from chrome not reachable

The sample code is as follows:

from seleniumbase import Driver

proxy = LOGIN:PASSWORD@IP:PORT

def get_browser():
    browser = Driver(
        uc=True,
        undetectable=True,
        headless=True,
        proxy=proxy
    )
    return browser

browser = get_browser()
browser.open(WEBSITE)

Without a proxy the parser works OK. I'd appreciate any clues as to what to fix in the code.

Michael Mintz · Accepted Answer · 2024-01-17 17:34:45Z

1

SeleniumBase's proxy-with-auth solution uses https://stackoverflow.com/a/35293284/7058266, which generates a Chrome extension at runtime for the proxy details. However, regular headless mode in Chrome doesn't support extensions. Although there is a newer headless mode for Chrome that does support extensions (https://stackoverflow.com/a/73840130/7058266), the optimal solution for SeleniumBase UC Mode to remain undetected in an Ubuntu environment with no display requires using a virtual display (https://stackoverflow.com/a/23447450/7058266).

SeleniumBase has its own modified version of pyvirtualdisplay called sbvirtualdisplay (https://github.com/mdmintz/sbVirtualDisplay). Just wrap your code with it. Here's an example

from sbvirtualdisplay import Display
from seleniumbase import Driver

display = Display(visible=0, size=(1440, 1880))
display.start()

driver = Driver(uc=True, proxy="USER:PASSWORD@IP:PORT")
driver.uc_open_with_reconnect("https://pixelscan.net/", reconnect_time=10)
# ...
driver.quit()

display.stop()

Since headless mode is the default mode on Linux, add headed=True to override that if the above doesn't work.

answered Jan 17, 2024 at 17:34

Michael Mintz

16.1k9 gold badges51 silver badges109 bronze badges

Sign up to request clarification or add additional context in comments.

1 Comment

AlexeiK Over a year ago

Michael Mintz, thank you for your help. Now the parsing worked OK.

Collectives™ on Stack Overflow

Auth proxies in Seleniumbase not working on ubuntu

1 Answer 1

1 Comment

Your Answer

Linked

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

1 Comment

Your Answer

Sign up or log in

Post as a guest

Linked

Related