Pandas converts string-typed JSON value to INT

Question

I have list of objects as JSON. Each object has two properties: id(string) and arg(number).

When I use pandas.read_json(...), the resulting DataFrame has the id interpreted as number as well, which causes problems, since information is lost.

import pandas as pd

json = '[{ "id" : "1", "arg": 1 },{ "id" : "1_1", "arg": 2}, { "id" : "11", "arg": 2}]'

df = pd.read_json(json)

I'd expect to have a DataFrame like this:

     id     arg  
0   "1"      1
1   "1_1"    2
2   "11"     2

I get

     id     arg  
0     1      1
1    11      2
2    11      2

and suddenly, the once unique id is not so unique anymore.

How can I tell pandas to stop doing that?

My search so far only yielded results, where people where trying to achive the opposite - having columns of string beeing interpreted as numbers. I totally don't want to achive that in this case!

matt035343 · Accepted Answer · 2022-06-29 09:23:05Z

4

If you set the dtype parameter to False, read_json will not infer the types automatically:

df = pd.read_json(json, dtype=False)

answered Jun 29, 2022 at 9:23

matt035343

531 silver badge7 bronze badges

Sign up to request clarification or add additional context in comments.

Comments

jezrael · Accepted Answer · 2021-01-20 13:40:16Z

1

Use dtype parameter for preventing cast id to numbers:

df = pd.read_json(json, dtype={'id':str})

print (df)
    id  arg
0    1    1
1  1_1    2
2   11    2


print (df.dtypes)
id     object
arg     int64
dtype: object

answered Jan 20, 2021 at 13:40

jezrael

868k103 gold badges1.4k silver badges1.3k bronze badges

Collectives™ on Stack Overflow

Pandas converts string-typed JSON value to INT

2 Answers 2

Comments

Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

2 Answers 2

Comments

Comments

Your Answer

Sign up or log in

Post as a guest

Related