csv.QUOTE_NONNUMERIC does not work with float in python

Question

I have a dataframe in Python that I want to save as a CSV with this line:

df.to_csv(PATH, quoting = csv.QUOTE_NONNUMERIC, index = False)

The dataframe has this form:

date          timeOfDay    GridID            score
2015-12-31     Morning      1445            0.000000

And the result after that piece of code is:

date,timeOfDay,GridID,score
"2015-01-01","Morning",1445,"0.0"

But I don't understand why score is quoted when the code has csv.QUOTE_NONNUMERIC while it is a numpy.float64. Indeed, GridID is stored successfully.

EDIT: If only score is stored in the csv file and anything else, the values are float, not quoted. Only if I add just a column then score is quoted again.

Reut Sharabani · Accepted Answer · 2016-07-14 06:45:01Z

3

There is a bug already on github. So you're actually not doing anything wrong.

Quoting the relevant part from the bug description:

The problem is that pandas.core.internals.FloatBlock.to_native_types (and by extension pandas.formats.format.FloatArrayFormatter.get_result_as_array) unconditionally formats the float array to a str array, which is then passed unchanged to the csv module and hence will be wrapped in quotes by that code.

This is marked as closed and will probably be fixed in a near future release (specifically Next Major Release).

answered Jul 14, 2016 at 6:45

Reut Sharabani

31.5k7 gold badges76 silver badges95 bronze badges

Sign up to request clarification or add additional context in comments.

Collectives™ on Stack Overflow

csv.QUOTE_NONNUMERIC does not work with float in python

1 Answer 1

Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

Comments

Your Answer

Sign up or log in

Post as a guest

Related