Capture network requests using selenium

Question

In the chrome dev tools, there is an option to capture network requests. I would like to know if there is any way to access the requests using selenium, in python.

I have searched this topic, But I could not find a solution. Solutions with other libraries are also appriciated!

Requests screenshot:

Specific request info:

I'm pretty sure Selenium does not offer a feature like this. Look into PlayWright. — Paul M.
– Paul M., Commented Sep 22, 2020 at 9:57

Mate Mrše · Accepted Answer · 2020-09-22 12:19:53Z

1

Selenium 4 implements Chrome Dev Tools protocol support. However, it is still in alpha version, so keep that in mind if you intend to use it in the production code.

Here are some example usages from Automate the Planet that you might find helpful:

1. Intercepting Requests

EventHandler<RequestInterceptedEventArgs> requestIntercepted = (sender, e) =>
{
    Assert.IsTrue(e.Request.Url.EndsWith("jpg"));
};
            
RequestPattern requestPattern = new RequestPattern();
requestPattern.InterceptionStage = InterceptionStage.HeadersReceived;
requestPattern.ResourceType = ResourceType.Image;
requestPattern.UrlPattern = "*.jpg";
var setRequestInterceptionCommandSettings = new SetRequestInterceptionCommandSettings();
setRequestInterceptionCommandSettings.Patterns = new RequestPattern[] { requestPattern };
devToolssession.Network.SetRequestInterception(setRequestInterceptionCommandSettings);
devToolssession.Network.RequestIntercepted += requestIntercepted;

2. Listen to Console Logs

EventHandler<MessageAddedEventArgs> messageAdded = (sender, e) =>
{
    Assert.AreEqual("BELLATRIX is cool", e.Message);
};
devToolssession.Console.Enable();
devToolssession.Console.ClearMessages();
devToolssession.Console.MessageAdded += messageAdded;
_driver.ExecuteScript("console.log('BELLATRIX is cool');");

NOTE: This is Java implementation, you should edit it for Python.

edited Sep 22, 2020 at 12:19

answered Sep 22, 2020 at 11:36

Mate Mrše

8,52413 gold badges52 silver badges95 bronze badges

Sign up to request clarification or add additional context in comments.

1 Comment

kaliiiiiiiii Over a year ago

For Python you can use Selenium-interceptor

Collectives™ on Stack Overflow

Capture network requests using selenium

1 Answer 1

1. Intercepting Requests

2. Listen to Console Logs

1 Comment

Your Answer

Linked

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

1. Intercepting Requests

2. Listen to Console Logs

1 Comment

Your Answer

Sign up or log in

Post as a guest

Linked

Related