Python API with Requests - how to ignore a null value in JSON?

Question

This is part of my code. The API provides a JSON file that includes an empty value (null) in one location. I get TypeError: 'NoneType' object is not subscriptable on the line that appends. I've read about a number of methods to deal with this (I want my program to just ignore the null value, or replace it with 0 or 'n/a' or whatever, but continue, not break) but they contain insufficient instruction - I still need a lot hand-holding, I'm afraid.

import requests
all_data = []
api_url = 'https://api.nfz.gov.pl/app-umw-api/agreements?page={}&limit=25&format=json&api-version=1.2&serviceType=03&year=2017&branch=07'

for page in range(0, 17):
    data = requests.get(api_url.format(page)).json()

    for a in data["data"]["agreements"]:
        all_data.append({**a["attributes"], "link": a["links"]['related']})
print(all_data)

David Meu · Accepted Answer · 2023-01-18 15:09:46Z

2

Use get instead of direct access:

some_val = json_data.get('host', 'N/A')

Here is how you can achieve this in you code:

import requests
all_data = []
api_url = 'https://api.nfz.gov.pl/app-umw-api/agreements?page={}&limit=25&format=json&api-version=1.2&serviceType=03&year=2017&branch=07'

for page in range(0, 17):
    data = requests.get(api_url.format(page)).json()

    for a in data["data"]["agreements"]:
        res = a.get('links')
        if res is not None:
            res = res.get('related')
        all_data.append({**a["attributes"], "link": res if res is not None else "N/A"})
print(all_data)

edited Jan 18, 2023 at 15:09

answered Jan 18, 2023 at 14:57

David Meu

1,5309 silver badges19 bronze badges

Sign up to request clarification or add additional context in comments.

3 Comments

Michael Wiz Over a year ago

David, thank you, but - sorry - where would I use this in my code? I thought I'm already using get in requests.get...

David Meu Over a year ago

get is a method for dict it returns None if the key is not found or you can supply your own default value. See my edit

Michael Wiz Over a year ago

Thank you very much - super helpful. I just made a modification - your edit erased the whole row in which the None value occurred, so I added an 'else' argument that changed that value to "N/A" and then I was able to get rid of the second conditional. Now it does exactly what I needed!

Collectives™ on Stack Overflow

Python API with Requests - how to ignore a null value in JSON?

1 Answer 1

3 Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

3 Comments

Your Answer

Sign up or log in

Post as a guest

Related