0

I want to disable prefetching on my celery workers (using RabbitMQ + Redis).

As seen here Understanding celery task prefetching in order to disable prefetching, I need to set:

worker_prefetch_multiplier = 1
acks_late = True
run the worker with -Ofair

I did the following, but because I set acks_late as True, if the worker loses connection (for example SIGKILL), it will requeue the task automatically, which I don't want. I have tried to disable that using this setting, but it seems to have no effect on preventing a requeue.

reject_on_worker_lost = False

Is there a way to disable prefetching without using late_acks, or using late_acks without requeueing automatically?

Improve this question
Related questions
21
When does a celery worker acknowledge to RabbitMQ that it has a task?
6
Celery worker connection with Rabbitmq met broken pipe error In gevent or eventlet Mode
2
Socket closed, missed heartbeats from client Celery worker with RabbitMQ
Load 3 more related questions Show fewer related questions

0

Reset to default

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge you have read our privacy policy.

Start asking to get answers

Find the answer to your question by asking.

Ask question

Explore related questions

See similar questions with these tags.