Celery apply_async with eta executing faster than it should

Question

>>> def elp(min):
...     when = datetime.now() + timedelta(minutes=min)
...     print when
...     r = add.apply_async(args=[500,500],eta=when)
...     start = time.time()
...     r.get()
...     end = time.time()
...     elapsed = end-start
...     print elapsed
...
>>> elp(10)

2014-11-08 04:38:01.745000
1.00200009346

Where as when using countdown

>>> def elp_countdown(min):
...     r = add.apply_async(args=[500,500],countdown=(min*60))
...     start = time.time()
...     r.get()
...     end = time.time()
...     elapsed = end-start
...     print elapsed
...
>>> elp_countdown(0.5)
30.1380000114

Why does the task gets executed faster than its suppose when using eta?

my add task is as follows,

@task()
def add(x, y):
    return x + y

Celery verison: 3.1.16 (Cipater)

You need to get start time before you apply the tasks.

Aida Paul
– Aida Paul

2014-11-08 09:42:33 +00:00
Commented Nov 8, 2014 at 9:42 — Aida Paul
– Aida Paul, Commented Nov 8, 2014 at 9:42

Ben · Accepted Answer · 2015-11-23 19:41:50Z

1

So after some research and lot's of reading, it turns out that I needed to pass a utc datetime to celery, since it's time zone is configured by default to be in UTC.

In case anyone is wondering, changing to this:

when = datetime.utcnow() + timedelta(minutes=min)

instead of

when = datetime.now() + timedelta(minutes=min)

will make it work as it should.

edited Nov 23, 2015 at 19:41

Ben

2,6061 gold badge26 silver badges29 bronze badges

answered Nov 9, 2014 at 5:43

Algorithmatic

1,9122 gold badges25 silver badges42 bronze badges

Sign up to request clarification or add additional context in comments.

2 Comments

David Schumann Over a year ago

You posted two times the exact same line. So what did you change?

kodeshpa Over a year ago

if you are using when = datetime.now() + timedelta(minutes=min) then celery executes your job immediately. Always use datetime.utcnow()

Collectives™ on Stack Overflow

Celery apply_async with eta executing faster than it should

1 Answer 1

2 Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

2 Comments

Your Answer

Sign up or log in

Post as a guest

Related