How to completely disable expensive logging tasks in Python

Question

The Python's pprint function I use for logging dictionaries is quite slow for larger objects. I cannot find a way to completely turn off the processing of that function using the standard logging library. Run the code below as an example:

logging.disable(50)
logging.log(msg=sum(range(20000000)), level=0)

Even though the result did not show up, the sum was still definitely computed (crank up the number inside of range to see what I mean). Is there a standard way in the logging module to disable the computing completely? If not, other suggestions are also welcomed.

The sum will always be computed in this case, it gets computed before it is passed to the function — juanpa.arrivillaga
– juanpa.arrivillaga, Commented Jun 24, 2018 at 17:32

Khoa Vo · Accepted Answer · 2018-06-24 17:55:51Z

1

the problem is is that anything that is at the root level (this includes arguments into a function, just not the interior of the function,) is computed as soon as python see's it(ie its computed before python ever calls the log function)... to solve this you can put your logic inside a function ... and then only execute the logic if it is appropriate

def lazy_log(callable_fn,log_name,log_level):
    logger = logging.getLogger(log_name)
    if logger.getEffectiveLevel() > log_level:
        return
    logger.log(msg=str(callable_fn()),level=log_level)

I guess might work for you

lazy_log(lambda : sum(range(1000000)), None, 51)

edited Jun 24, 2018 at 17:55

Khoa Vo

3533 silver badges11 bronze badges

answered Jun 24, 2018 at 17:32

Joran Beasley

114k13 gold badges167 silver badges187 bronze badges

Sign up to request clarification or add additional context in comments.

Collectives™ on Stack Overflow

How to completely disable expensive logging tasks in Python

1 Answer 1

Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

Comments

Your Answer

Sign up or log in

Post as a guest

Related