Converting all the datetime columns of a variable Pandas DataFrame into a different timezone

Question

I have to deal with a Pandas DataFrame that can be composed by different datetime columns (they can vary, I can have 0..N datetime cols). I know that each datetime column timezone is UTC and I need to convert their data to another timezone. If I do as follows:

df['a_datetime_column'].dt.tz_localize('UTC').dt.tz_convert('my_timezone')

it works but I need to know in advance the datetime column names (ok, I could get them in some way).

Is there a specific way to do this conversion on all the DataFrame at once independently from the composition of its columns?

What do you have when you print df.dtypes? Can you filter those with datetime type from there? — Quang Hoang
– Quang Hoang, Commented Feb 19, 2020 at 14:51
then you can simply loop over the columns with type datetime64[ns] — gbruenjes
– gbruenjes, Commented Feb 19, 2020 at 14:53

gbruenjes · Accepted Answer · 2020-02-19 14:56:53Z

1

You can loop over the columns which have datetime type:

for col,dtyp in df.dtypes.iteritems():
    if dtyp == 'datetime64[ns]':
        df[col] = df[col].dt.tz_localize('UTC').dt.tz_convert('my_timezone')

answered Feb 19, 2020 at 14:56

gbruenjes

4,2251 gold badge18 silver badges32 bronze badges

Sign up to request clarification or add additional context in comments.

Comments

Dan · Accepted Answer · 2020-02-19 15:02:38Z

1

Check out select_dtypes, you can use it to select only the datetime64[ns] columns and apply your tz_convert to those:

df.select_dtypes(inlcude=["datetime64[ns]"]).dt.tz_localize('UTC').dt.tz_convert('my_timezone')

edited Feb 19, 2020 at 15:02

answered Feb 19, 2020 at 14:55

Dan

45.8k20 gold badges98 silver badges170 bronze badges

3 Comments

floatingpurr Over a year ago

Does this require starting data being tz aware?

Dan Over a year ago

What do you mean? If they are of type datetime64[ns] I assume they have some sort of timezone no?

Dan Over a year ago

For the selection part, no.

Collectives™ on Stack Overflow

Converting all the datetime columns of a variable Pandas DataFrame into a different timezone

2 Answers 2

Comments

3 Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

2 Answers 2

Comments

3 Comments

Your Answer

Sign up or log in

Post as a guest

Related