Upload raw JSON data on Google Cloud Storage using Python code

Question

I am trying to upload raw JSON data on Google Cloud Platform. But I am getting this error:

TypeError: must be string or buffer, not dict

Code:

def upload_data(destination_path):
    credentials = GoogleCredentials.get_application_default()
    service = discovery.build('storage', 'v1', credentials=credentials)

    content = {'name': 'test'}
    media = http.MediaIoBaseUpload(StringIO(content), mimetype='plain/text')
    req = service.objects().insert(
        bucket=settings.GOOGLE_CLOUD_STORAGE_BUCKET,
        body={"cacheControl": "public,max-age=31536000"},
        media_body=media,
        predefinedAcl='publicRead',
        name=destination_path,
    )
    resp = req.execute()

    return resp

Code Worked by changing StringIO(content) to StringIO(json.dumps(content))

Could you add more information to what imports you've used to get this to work? — Michel K
– Michel K, Commented Mar 30, 2020 at 18:56
so i've found out by doing some digging. To get this to work you'll need ----- from googleapiclient.discovery import build from googleapiclient import http from oauth2client.client import GoogleCredentials import io for predefinedAcl options you can go here: cloud.google.com/storage/docs/access-control/… bucket needs to be the full name of your bucket. If you come from firebase it's "<name>.appspot.com" — Michel K
– Michel K, Commented Mar 31, 2020 at 11:18

Corey Goldberg · Accepted Answer · 2016-08-19 11:19:31Z

3

in your example, content is a dict. Perhaps you want to use json?

content = json.dumps({'name': 'test'})

answered Aug 19, 2016 at 11:19

Corey Goldberg

61.5k30 gold badges135 silver badges148 bronze badges

Sign up to request clarification or add additional context in comments.

2 Comments

Naveen Over a year ago

It Worked. missed this simple thing. was trying number of different things for this. Thanks. :)

Naveen Over a year ago

This above code is working absolutely fine in python manage.py shell . But not in local server. Can you suggest any possible reasons for the same ?

Michel K · Accepted Answer · 2020-03-31 11:26:28Z

To answer my own comment question on how to get this to work:

To get this to work you'll need

from googleapiclient.discovery import build
from googleapiclient import http
from oauth2client.client import GoogleCredentials
import io

Also i needed to change this:

 media = http.MediaIoBaseUpload(StringIO(content), mimetype='plain/text')

in to this:

media = http.MediaIoBaseUpload(io.StringIO(json.dumps(content)), mimetype='plain/text')

Note the insert of 'io' besides the json.dumps recommended by Corey Goldberg.

for predefinedAcl options you can go here:

https://cloud.google.com/storage/docs/access-control/lists#predefined-acl

Bucket needs to be the full name of your bucket. If you come from firebase it's "[name].appspot.com"

Collectives™ on Stack Overflow

Upload raw JSON data on Google Cloud Storage using Python code

2 Answers 2

2 Comments

Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

2 Answers 2

2 Comments

Comments

Your Answer

Sign up or log in

Post as a guest

Related