Celery: Getting unexpected run_command() takes 1 positional argument but 318 were given error

Question

I am attempting to run an async task and am getting an unexpected error: run_command() takes 1 positional argument but 318 were given. I have a list of commands that I want to run from a celery task.

run_command.chunks(iter(commands), 10).group().apply_async()

@task
def run_command(commands):
    for command in commands:
        print("RUNNING, ", command)
        print("Pid: ", os.getpid())
        os.system(command)

As shown above, I am attempting to break down my command into batches that will be executed in parallel.

Thanks for the help

@WillemVanOnsem, any suggestions on how I could potentially prevent this, if it is the issue? — Chognificent
– Chognificent, Commented Sep 10, 2019 at 11:51
wrap the items in singleton tuples before passing it to iter(..). — willeM_ Van Onsem
– willeM_ Van Onsem, Commented Sep 10, 2019 at 11:52

Greenev · Accepted Answer · 2019-09-10 12:52:16Z

1

Celery treats its positional arguments as *args, so every command in your commands iterable should looks like ('commandtext',)

commands = ['hello', 'world', '!']

@task
def run_command(command):
    '''run command'''

run_command.chunks(zip(commands), 2).group().apply_async()

edited Sep 10, 2019 at 12:52

answered Sep 10, 2019 at 12:23

Greenev

9096 silver badges27 bronze badges

Sign up to request clarification or add additional context in comments.

Collectives™ on Stack Overflow

Celery: Getting unexpected run_command() takes 1 positional argument but 318 were given error

1 Answer 1

Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

Comments

Your Answer

Sign up or log in

Post as a guest

Related