Problem with date types after excel upload (converting timestamp to datetime)

Question

I've got data in excel, one sheet has dates as columns, the other - as rows. Using pd.read_excel I get them as dataframes. The type of one (Data1) is datetime.datetime, the other (Data2) is timestamp.

How do I prevent this from happening and get uniform types?

I want to do

Data1[Data1.index<Data2.columns[-1]]

this returns an error

TypeError: '<=' not supported between instances of 'datetime.time' and 'Timestamp'

I tried doing

datetime(Data2.columns[-1].year,Data2.columns[-1].month,Data2.columns[-1].day)

instead of

Data2.columns[-1]

the error changes to

TypeError: '<=' not supported between instances of 'datetime.time' and 'datetime.datetime'

I'm lost, how do I get the types to match? What's this datetime.time type out of thin air.

EDIT

this seems to be the crux of the issue:

Data1[Data1.index<Data1.index[3]]

returns

TypeError: '<' not supported between instances of 'datetime.time' and 'datetime.datetime'

Data type for Data1.index is datetime.time.

Both error messages suggest that the type of Data1 is in fact datetime.time. — mportes
– mportes, Commented Aug 19, 2020 at 13:32
Sorry, I have zero experience with pandas. But to convert between datetimes and timestamp floats, you can do dt = datetime.fromtimestamp(ts) and ts = dt.timestamp(). — mportes
– mportes, Commented Aug 19, 2020 at 13:49

FObersteiner · Accepted Answer · 2020-08-19 13:54:29Z

1

Make sure to compare apples with apples. Either compare full datetime (date and time component) or only one of each. Ex:

from datetime import datetime, timedelta
import pandas as pd

# date and time:
pd.Timestamp('now') >= datetime.now() + timedelta(hours=1)
# False

# time only:
pd.Timestamp('now').time() >= (datetime.now() + timedelta(hours=1)).time()
# False

# date only:
pd.Timestamp('now').date() >= (datetime.now() + timedelta(hours=1)).date()
# True

as opposed to e.g.

pd.Timestamp('now').time() >= (datetime.now() + timedelta(hours=1))

...will throw

TypeError: '>=' not supported between instances of 'datetime.time' and 'datetime.datetime'

answered Aug 19, 2020 at 13:54

FObersteiner

26.1k9 gold badges60 silver badges94 bronze badges

Sign up to request clarification or add additional context in comments.

1 Comment

the_dude Over a year ago

Thanks, this was precisely the problem, turns out I had a few datetime.time() in there and was comparing datetime.datetime with datetime.time.

Collectives™ on Stack Overflow

Problem with date types after excel upload (converting timestamp to datetime)

1 Answer 1

1 Comment

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

1 Comment

Your Answer

Sign up or log in

Post as a guest

Related