Bad performance when using Python 2.7 requests lib (http)

Question

I'm trying to send requests to a microservice running on localhost. I'm using requests.session() for the python client because I want to keep the connection open for more requests. I measured the performance, the overhead, and it's quite slow ~ 4ms. I tried to send the same request from other clients (JS for example) and it was much faster (0.5 ms). Any ideas ?

The code is very simple-

session_holder = requests.Session() 
session_holder.post(url, json= data, headers=headers)

It might be helpful if you add some sample code or other additional information. Your description is a bit vague, it's hard to tell if there is a problem, or what exactly it is. Have you tried without the session? What was the performance then? Are you sending a handful of requests or many? Do you need asynchronicity? — pdowling
– pdowling, Commented Oct 31, 2018 at 10:13
I tried without the session() as well, it was worse. it's the same time if I send one request (no asynchronicity is needed yet). — Gita Ferber
– Gita Ferber, Commented Oct 31, 2018 at 10:34
According to this question requests/urllib3 is always doing a DNS lookup, maybe thats why. — Maurice Meyer
– Maurice Meyer, Commented Oct 31, 2018 at 11:15

Dani G · Accepted Answer · 2018-10-31 10:37:20Z

1

You can try using urllib instead of requests, since requests is a higher level http client interface it will have some overhead.
You can also try using aiohttp which leverages async.
Here is a great tutorial:Intro To asyncio

answered Oct 31, 2018 at 10:37

Dani G

1,2409 silver badges16 bronze badges

Sign up to request clarification or add additional context in comments.

Collectives™ on Stack Overflow

Bad performance when using Python 2.7 requests lib (http)

1 Answer 1

Comments

Your Answer

Linked

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

Comments

Your Answer

Sign up or log in

Post as a guest

Linked

Related