How to access redis connection in background task

Question

I'm trying to extend the flask-base project https://github.com/hack4impact/flask-base/tree/master/app which comes with a user model only. I'm trying to add the ability to run a background task on redis using rq. I've found https://devcenter.heroku.com/articles/python-rq which is helpful.

this app has support for redis queues with a background redis queue being implemented by running :

@manager.command
def run_worker():
    """Initializes a slim rq task queue."""
    listen = ['default']
    conn = Redis(
        host=app.config['RQ_DEFAULT_HOST'],
        port=app.config['RQ_DEFAULT_PORT'],
        db=0,
        password=app.config['RQ_DEFAULT_PASSWORD'])

    with Connection(conn):
        worker = Worker(map(Queue, listen))
        worker.work()

using:

$ python manage.py run_worker

In my views I have:

@main.route('/selected')
def background_selected():
    from rq import Queue
    from manage import run_worker.conn
    q = Queue(connection=conn)
    return q.enqueue(selected)

The problem is I don't know how to import the connection created in run_worker() into my view. I've tried variations of :

from manage import run_worker.conn

but I'm getting:

SyntaxError: invalid syntax.

How can I get access to the conn variable in the background task?

Farhan · Accepted Answer · 2018-02-12 19:11:51Z

1

from the documentation, python-rq Configuration

Can you try by making the below changes:

manager.py

import redis

"""Initializes a slim rq task queue."""
listen = ['default']
conn = redis.Redis(host=app.config['RQ_DEFAULT_HOST'], 
                   port=app.config['RQ_DEFAULT_PORT'],
                   db=0,     
                   password=app.config['RQ_DEFAULT_PASSWORD'])

@manager.command
def run_worker():
    with Connection(conn):
        worker = Worker(map(Queue, listen))
        worker.work()

and from view:

from rq import Queue
from manage import conn

q = Queue(connection=conn)

answered Feb 12, 2018 at 19:11

Farhan

5035 silver badges16 bronze badges

Sign up to request clarification or add additional context in comments.

1 Comment

user1592380 Over a year ago

Thanks for your help. I didn't realize it before but there is a flask addon called flask-rq (pythonhosted.org/Flask-RQ) which provides a @job decorator to allow background tasks to be run.

user1592380 · Accepted Answer · 2018-03-03 20:08:27Z

1

I contacted the developer who provided the following:

answered Mar 3, 2018 at 20:08

user1592380

36.9k106 gold badges319 silver badges560 bronze badges

Collectives™ on Stack Overflow

How to access redis connection in background task

2 Answers 2

1 Comment

Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

2 Answers 2

1 Comment

Comments

Your Answer

Sign up or log in

Post as a guest

Related