4

I'm considering a move to Elastic Beanstalk (on account of the pricing). The blockage is that I have no idea how to setup Celery on a python app (Django, in my case) deployed to the service. Has anyone managed to setup celery on Elastic Beanstalk? If so, please let me know how you managed to do it and what tools you used.

Improve this question
0

1 Answer 1

Reset to default
7

Use the SQS service. Read this: Celery with Amazon SQS

and this:

http://docs.celeryproject.org/en/latest/getting-started/brokers/sqs.html

Improve this answer
Sign up to request clarification or add additional context in comments.

6 Comments

did u manage to have it working? my problem is: how do i run celery on the EB?
You're not really supposed to run other services like Celery on EB. It's meant to run your main app only. You should probably run your Celery service on a separate EC2 instance. That's what I do, anyway.
I am not sure if Beanstalk has changed much since this was initially posted. Looking at their docs looks like you should be able to run daemon processes with beanstalk. You can create a custom AMI with celery daemon configured. I was able to get it to work with a custom AMI using SQS as the broker.
There is also a way of doing this without creating a custom AMI, see my anwer to a similar question: stackoverflow.com/questions/14761468
If a new instance boots due to auto scaling in EB then that new instance will also have celery worker running, in that case is there any chance of multiple execution of same message in SQS ?
|

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge you have read our privacy policy.

Start asking to get answers

Find the answer to your question by asking.

Ask question

Explore related questions

See similar questions with these tags.