How do I delete most keys in a json file using python?

Question

I have a json file with all the data I searched using Twitter API. I only want to keep certain keys in that file and delete the rest of them, but don't know how to do it correctly. I wrote some code to do so, but I get the error "list indices must be integers or slices, not str"

import json

def read_json(json_file:str)->list:
    tweets_data=[]
    for tweet in open(json_file, 'r'):
        tweets_data.append(json.loads(tweet))
    return tweets_data
tags = ["created_at", "full_text"]
tweet_list=read_json('test.json')

for i in tweet_list["tweet"].keys():
    if i not in tags:
        del tweet_list["tweet"][i]
        
print (tweet_list[0])

You may take a look at the differences between a list and a key-value container, like a dictionary. — Jonathan Ciapetti
– Jonathan Ciapetti, Commented Oct 17, 2022 at 0:04

Tomward Matthias · Accepted Answer · 2022-10-17 00:04:19Z

1

def read_json(json_file:str)->list:
    tweets = []
    with open(json_file, 'r') as f:
        for line in f:
            tweets.append(json.loads(line))
    return tweets
tags = ['created_at', 'full_text']
tweets = read_json('tweets.json')
for tweet in tweets:
    for key in list(tweet.keys()):
        if key not in tags:
            del tweet[key]

answered Oct 17, 2022 at 0:04

Tomward Matthias

1251 silver badge15 bronze badges

Sign up to request clarification or add additional context in comments.

Comments

Damien Ayers · Accepted Answer · 2022-10-17 00:17:57Z

You've gotten really close to something working, but have a bug in the filtering section.

Your read_json() function returns a python list, which is assigned to tweet_list.

The error message refers to tweet_list['tweet'], and says that you must use integers or pairs of numbers (slices) to select from within a list. Not a string tweet.

If you change your code to use the number 0

for i in tweet_list[0].keys():
    if i not in tags:
        del tweet_list[0][i]

It will filter out the unwanted tags from the first element in the list.

To filter every element in the list, you need to iterate over all them with aother for loop.

for i in range(tweet_list):
    for key in tweet_list[i].keys():
        if key not in tags:
            del tweet_list[i][key]

Collectives™ on Stack Overflow

How do I delete most keys in a json file using python?

2 Answers 2

Comments

Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

2 Answers 2

Comments

Comments

Your Answer

Sign up or log in

Post as a guest

Related