Django request/response multithreading

Question

The workflow of my app is -

User submits a file
On receiving -> process_file()
return response

This could result in timeouts if the process_file() takes much time, so how could I send back the response before and then process the file and send the desired output to user later.
I have checked out django-celery but I think it's quite heavy for a small app which I am trying to build.

Update: I searched a bit around on the internet, and if anyone would like to use celery, here is a nice blog post, that could help you solve this situation - [Link]

You need an async queue : djangopackages.com/grids/g/workers-queues-tasks — bruno desthuilliers
– bruno desthuilliers, Commented Oct 15, 2015 at 9:13

Community · Accepted Answer · 2020-06-20 09:12:55Z

1

You can use Celery for that matter:

Celery is an asynchronous task queue/job queue based on distributed message passing. It is focused on real-time operation, but supports scheduling as well.

The execution units, called tasks, are executed concurrently on a single or more worker servers using multiprocessing, Eventlet, or gevent. Tasks can execute asynchronously (in the background) or synchronously (wait until ready).

edited Jun 20, 2020 at 9:12

CommunityBot

11 silver badge

answered Oct 15, 2015 at 8:52

Wtower

20.1k12 gold badges110 silver badges86 bronze badges

Sign up to request clarification or add additional context in comments.

2 Comments

Anurag-Sharma Over a year ago

Thanks, It seems like I should better stick to celery, rather than other stuff.

Wtower Over a year ago

Welcome, that's where I ended up anyway too.

Collectives™ on Stack Overflow

Django request/response multithreading

1 Answer 1

2 Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

2 Comments

Your Answer

Sign up or log in

Post as a guest

Related