Filter dataframe rows using a list of datetime.date objects

Question

Issue:

I am trying to filter my dataframe rows using a list of datetime.date objects. I get ValueError: Arrays were different lengths: 175033 vs 33

Data:

type(third_friday_lst)
list

type(third_friday_lst[0])
datetime.date

third_friday_lst

[datetime.date(2013, 1, 18),
 datetime.date(2013, 2, 15),
 datetime.date(2013, 3, 15),
 datetime.date(2013, 4, 19),
 datetime.date(2013, 5, 17),
 datetime.date(2013, 6, 21),
 datetime.date(2013, 7, 19),
 datetime.date(2013, 8, 16),
 datetime.date(2013, 9, 20),
 datetime.date(2013, 10, 18),
 datetime.date(2013, 11, 15)]

What I have tried:

If I use the following code I get the desired output but only when I specify the first item in the list with third_friday_lst[0]:

data[data['dt-date'] == third_friday_lst[0]]

                       Date         Time    Open    High    Low   Last Volume   dt-date
Timestamp                               
2013-01-18 08:00:00 2013/1/18   08:00:00    7875.5  7876.0  7867.5  7870.5 1059 2013-01-18
2013-01-18 08:05:00 2013/1/18   08:05:00    7871.0  7878.5  7870.5  7877.5  511 2013-01-18
2013-01-18 08:10:00 2013/1/18   08:10:00    7877.0  7879.0  7875.5  7875.5  226 2013-01-18
2013-01-18 08:15:00 2013/1/18   08:15:00    7875.5  7878.0  7874.5  7876.0  162 2013-01-18

Desired output:

I would like to filter rows in data using third_friday_lst without using the list index[0] as I want all the dates contained in the list. I would prefer not to use the ['dt-date'] column but if this is required it is fine.

thanks

data[data['dt-date'].isin(third_friday_lst)]?

Abdou
– Abdou

2016-12-31 00:19:00 +00:00
Commented Dec 31, 2016 at 0:19 — Abdou
– Abdou, Commented Dec 31, 2016 at 0:19
That's what I would say. ^^^

piRSquared
– piRSquared

2016-12-31 00:22:09 +00:00
Commented Dec 31, 2016 at 0:22 — piRSquared
– piRSquared, Commented Dec 31, 2016 at 0:22
Thanks that did it. If you add the answer I will accept.

nipy
– nipy

2016-12-31 00:22:35 +00:00
Commented Dec 31, 2016 at 0:22 — nipy
– nipy, Commented Dec 31, 2016 at 0:22

Abdou · Accepted Answer · 2016-12-31 00:23:47Z

5

You can try:

data[data['dt-date'].isin(third_friday_lst)]

Thanks!

answered Dec 31, 2016 at 0:23

Abdou

13.4k4 gold badges44 silver badges42 bronze badges

Sign up to request clarification or add additional context in comments.

Comments

nipy · Accepted Answer · 2016-12-31 09:54:16Z

2

Just for completeness, I mentioned in the post that I didn't want to use the ['dt-date'] column:

data[data.index.to_series().dt.date.isin(third_friday_lst)]

answered Dec 31, 2016 at 9:54

nipy

5,5485 gold badges37 silver badges84 bronze badges

2 Comments

EHB Over a year ago

Looks like you can also do it in a slightly simpler fashion too: data[data.index.isin(third_friday_lst)]

gabuzo Over a year ago

@EHB actually this is not working as it'll only filter exact match between the index datetimes and the list of dates hence only get rows at midnight

Collectives™ on Stack Overflow

Filter dataframe rows using a list of datetime.date objects

2 Answers 2

Comments

2 Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

2 Answers 2

Comments

2 Comments

Your Answer

Sign up or log in

Post as a guest

Related