How to send a large JSON file via python http request

Question

I am running two services on my local machine. I want to send data from service 1 to service 2 which is on port 8004. I am doing the following:

r = requests.get('http://127.0.0.1:8004/json_data='+json.dumps(json_data))

I get these 2 errors:

ConnectionResetError: [WinError 10054] An existing connection was forcibly closed by the remote host

ConnectionError: ('Connection aborted.', ConnectionResetError(10054, 'An existing connection was forcibly closed by the remote host', None, 10054, None))

I assume that I am sending a large file which is causing the problem. My file is 15mb in size, its a python dictionary which I am sending via a json.dumps()

Any recommendation for overcoming this error ?

Gautam · Accepted Answer · 2018-07-05 14:48:18Z

1

HTTP GET requests have a limit when it comes to the request size. There is no standard, but I think the max with the most supportive browser is around 200 KB, which is way below what you are trying to send. An alternative could have been to use POST, but that also has limits around 2MB, which varies from browser to browser and from server to server. So you have two options :

Try a file upload.
Break down your payload.

Hope this helps.

answered Jul 5, 2018 at 14:48

Gautam

1,93212 silver badges19 bronze badges

Sign up to request clarification or add additional context in comments.

4 Comments

AnarKi Over a year ago

Thanks for the answer, what do you mean when you say file upload ?

Gautam Over a year ago

@AnarKi, what server are you using ?

AnarKi Over a year ago

I am using cherrypy to expose functions

Gautam Over a year ago

@AnarKi, not very familiar with that, but see if you can use this python example : gist.github.com/UniIsland/3346170

Collectives™ on Stack Overflow

How to send a large JSON file via python http request

1 Answer 1

4 Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

4 Comments

Your Answer

Sign up or log in

Post as a guest

Related