Unable to load Dask data frame -- Expected meta to specify type DataFrame error

Question

I am trying to use Dask to load a fixed width file so I can parse out the columns and load into a database, but I cannot get Dask to load the data frame. I am receiving an error saying the Expected meta to specify type DataFrame, got type pandas.core.frame.DataFrame.

Here is the code:

import dask.dataframe as dd
df == dd.read_csv("S://folder//file.csv")

Can anyone assist as to what I can do differently?

Thanks, phil

Welcome to stack overflow! Please see the guide to How to Ask, and especially, make sure to format your code as a code block, and always post the full traceback - they're full of information that's critical to debugging. Thanks! — Michael Delgado
– Michael Delgado, Commented Jan 27, 2022 at 19:48

Alexandra Dudkina · Accepted Answer · 2022-01-28 05:03:20Z

1

There was a bug with the similar behavior, try to update dask to the latest version, e.g. using:

pip install dask -U

answered Jan 28, 2022 at 5:03

Alexandra Dudkina

4,5123 gold badges18 silver badges29 bronze badges

Sign up to request clarification or add additional context in comments.

1 Comment

Arson 0 Over a year ago

Yes, I was looking into that now too. If updating dask is not a viable option, it's also possible to downgrade pandas to a suitable version for compatibility as well, although not the best solution.

Collectives™ on Stack Overflow

Unable to load Dask data frame -- Expected meta to specify type DataFrame error

1 Answer 1

1 Comment

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

1 Comment

Your Answer

Sign up or log in

Post as a guest

Related