Pandas column dtype is object but python thinks it is float

Question

I read in a csv like this

df = pd.read_csv(self.file_path, dtype=str)

then I try this:

 df = df[df["MY_COLUMN"].apply(lambda x: x.isnumeric())]

I get an AttributeError:

AttributeError: 'float' object has no attribute 'isnumeric'

Why is this happening? The column contains mostly digits.

I want to filter out the ones where there are no digits.

This question is not how to achieve that or do it better but why do I get an AttributeError here?

jezrael · Accepted Answer · 2021-03-23 13:19:10Z

1

Why is this happening?

I think because NaN is not converting to string if use dtype=str, still is missing value, so type=float

Use Series.str.isnumeric for working isnumeric with missing values like all text functions in pandas:

df[df["MY_COLUMN"].str.isnumeric()]

edited Mar 23, 2021 at 13:19

answered Mar 23, 2021 at 13:07

jezrael

868k103 gold badges1.4k silver badges1.3k bronze badges

Sign up to request clarification or add additional context in comments.

2 Comments

HrkBrkkl Over a year ago

Thanks for the answer but i explicitly am not asking how to do it better or get it working but why i get an error even with stating the dtypes when reading it in.

jezrael Over a year ago

@goodsnek - I think because NaN is not converting to string if use dtype=str

Collectives™ on Stack Overflow

Pandas column dtype is object but python thinks it is float

1 Answer 1

2 Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

2 Comments

Your Answer

Sign up or log in

Post as a guest

Related