Unable to convert Dataframe object to datetime

Question

I have been to trying to convert dataframe object to datetime with format Y-m-d. My data looks like:

pdi.head()

     Date                           Predicted_Linear_Regression
0   [2005-02-16T00:00:00.000000000] 0.000663
1   [1982-02-03T00:00:00.000000000] 0.000666
2   [1995-07-12T00:00:00.000000000] 0.000665
3   [1995-03-13T00:00:00.000000000] 0.000666
4   [2009-05-20T00:00:00.000000000] 0.000658

I have tried to convert Date column to str and then tried to convert to datetime but not able. Tried to convert it directly but unable to.

It seems so its a list but when I do pdi['Date'].dtype it gives me dtype('O') — Varun
– Varun, Commented Jun 6, 2019 at 18:16

DYZ · Accepted Answer · 2019-06-06 18:16:07Z

1

Your Date column contains lists of dates, not dates. Extract the first element of each list, then convert to datetime:

pd.to_datetime(df['Date'].str[0])

answered Jun 6, 2019 at 18:16

DYZ

57.3k10 gold badges73 silver badges101 bronze badges

Sign up to request clarification or add additional context in comments.

1 Comment

Quang Hoang Over a year ago

It works if Date is list. If the Date has type string, then str[0] gives you something else.

Quang Hoang · Accepted Answer · 2019-06-06 18:27:54Z

0

If your df.Date is of type list, then try:

df.Date = pd.to_datetime(np.array(list(df.Date)).flatten())

If it's of type str, try:

df.Date = pd.to_datetime(df.Date.str.slice(1,-1))

And if lazy:

try:
    df.Date = pd.to_datetime(df.Date.str.slice(1,-1))
except:
    df.Date = pd.to_datetime(np.array(list(df.Date)).flatten())

answered Jun 6, 2019 at 18:27

Quang Hoang

151k11 gold badges64 silver badges86 bronze badges

Collectives™ on Stack Overflow

Unable to convert Dataframe object to datetime

2 Answers 2

1 Comment

Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

2 Answers 2

1 Comment

Comments

Your Answer

Sign up or log in

Post as a guest

Related