How to store a JSON response from a loop into a dataframe in python

Question

I am trying to run an API with multiple id's and I am normalizing the json file and trying it to put into a dataframe. With my current code I am able to get only one response into jsonfile2. When I try to print the json response I will get all the response but response.json() is not working in my code.

for id in ids:
    time.sleep(1)
    url = "https:url/../details/"+str(id)
    querystring = {"API-Token":"Token"}
    headers = {
    'cache-control': "no-cache",
    'postman-token': "111111111111111111111"
    }
    response = requests.request("GET", url.format(id=ids), headers=headers, params=querystring)
#    print(response.json())
    jsonfile2 = response.json()
    works_data2 = json_normalize(jsonfile2, record_path='result')

Example of JSON response

{
  "result": {
    "id": "string",
    "startTime": 0,
    "endTime": 0,
    "tags": [
      {
        "context": "context",
      }
    ],
    "Events": [
      {
        "startTime": 0,
        "endTime": 0,
        "entityId": "string",
        "status": "CLOSED",
        "severities": [
          {
            "context": "context",
            "value": 0,
            "unit": "Bit (bit)"
          }
        ]
}
}

JacobIRR · Accepted Answer · 2019-07-30 19:44:18Z

2

Right now, you are overwriting the jsonfile2 variable during each iteration of your loop. How about appending to a list instead?

jsonfile2  = []

for id in ids:
    time.sleep(1)
    url = "https:url/../details/"+str(id)
    querystring = {"API-Token":"Token"}
    headers = {
    'cache-control': "no-cache",
    'postman-token': "111111111111111111111"
    }
    response = requests.request("GET", url.format(id=ids), headers=headers, params=querystring)
#    print(response.json())
    jsonfile2.append(response.json())
    works_data2 = json_normalize(jsonfile2, record_path='result')

answered Jul 30, 2019 at 19:44

JacobIRR

9,0568 gold badges47 silver badges73 bronze badges

Sign up to request clarification or add additional context in comments.

1 Comment

Nik Over a year ago

Thanks @JacobIRR that working and additional I stored the appended data into a dataframe by using the following code works_data2 = json_normalize(jsonfile2)

Collectives™ on Stack Overflow

How to store a JSON response from a loop into a dataframe in python

1 Answer 1

1 Comment

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

1 Comment

Your Answer

Sign up or log in

Post as a guest

Related