Include stderr and stdout when logging in python

Question

Having the following logging:

log_name = pd.datetime.now().date().strftime(format="%Y-%m-%d")+".log" #Current day
log_path = os.path.dirname(os.path.dirname(os.path.realpath(__file__)))+"/logs/" #Path
logging.basicConfig(filename=log_path+log_name,filemode="a",level = logging.INFO)

is there a way to catch "Unknown" exceptions (such as pd.to_sql errors due to e.g typo in the column name) and write them to the same logger file specified in logging.basicConfig without having try/catches all over the place?

Ευάγγελος Γρηγορόπουλος · Accepted Answer · 2021-03-17 13:11:26Z

1

Most of the times i use a combination of traceback library(standard) and a very big try-except clause under lets say main() function.So any uncaught error can be logged without special treatment. I hope fits your needs. Example:

import logging
import traceback

try:
    main()
except:
    logger.warning(traceback.format_exc())

answered Mar 17, 2021 at 13:11

Ευάγγελος Γρηγορόπουλος

9152 gold badges10 silver badges22 bronze badges

Sign up to request clarification or add additional context in comments.

4 Comments

CutePoison Over a year ago

That's exactly the point I referred to as "without having try/catches all over the place", since they are where you can expect an error, but if the error is unexpected it is not caught

Daniel Walker Over a year ago

Why not use logger.exception?

CutePoison Over a year ago

In a try/catch ? I want a way to catch un-wanted exceptions and log that. In a try/catch you expect an exception to be there. I could of course wrap the entire main() in a try: main; except Exception as e: logging.except(e) but I doubt that is the cleanest way to do so.

Ευάγγελος Γρηγορόπουλος Over a year ago

As @DanielWalker suggested logger.exception can be used,but traceback will log a whole lot of more info.As it seems there was already a popular question stackoverflow.com/questions/4990718/… with no siginifcant other methodologies.The methodology i suggested works the way you expect.I dont think there is a real alternative other than try-except.

Collectives™ on Stack Overflow

Include stderr and stdout when logging in python

1 Answer 1

4 Comments

Your Answer

Linked

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

4 Comments

Your Answer

Sign up or log in

Post as a guest

Linked

Related