Pandas Convert Series from DateTimeStamp to datetime.datetime object

Question

I have a pandas' dataframe with a column that is of datatype: datetime64[ns].

How do I convert the whole series to a Python's Datetime.datetime objects? On the individual object there is a function called to_datetime(), but I can't call this function on the series.

Thank you

It is really problematic, because it automatically cast to pandas datetimes, but is possible convert to numpy array of dates by df.Date.dt.to_pydatetime() — jezrael
– jezrael, Commented Feb 6, 2017 at 12:42
So this df.Date = df.Date.dt.to_pydatetime() still return Date datetime64[ns] — jezrael
– jezrael, Commented Feb 6, 2017 at 12:44

erip · Accepted Answer · 2017-02-06 14:00:27Z

2

If performance is a concern I would advise to use the following function to convert those columns to date_time:

def lookup(s):
    """
    This is an extremely fast approach to datetime parsing.
    For large data, the same dates are often repeated. Rather than
    re-parse these, we store all unique dates, parse them, and
    use a lookup to convert all dates.
    """
    dates = {date:pd.to_datetime(date) for date in s.unique()}
    return s.apply(lambda v: dates[v])

to_datetime: 5799 ms
dateutil:    5162 ms
strptime:    1651 ms
manual:       242 ms
lookup:        32 ms

edited Feb 6, 2017 at 14:00

erip

17.1k11 gold badges73 silver badges131 bronze badges

answered Feb 6, 2017 at 13:53

SerialDev

2,84722 silver badges34 bronze badges

Sign up to request clarification or add additional context in comments.

2 Comments

code base 5000 Over a year ago

@erip great solution! Works very well.

erip Over a year ago

@codebase5000 It's not my solution! It's SerialDev's.

Collectives™ on Stack Overflow

Pandas Convert Series from DateTimeStamp to datetime.datetime object

1 Answer 1

2 Comments

Your Answer

Linked

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

2 Comments

Your Answer

Sign up or log in

Post as a guest

Linked

Related