How to set BigQuery configuration properties with google-api-python-client?

Question

The project I'm working in is still using google-api-python-client which is deprecated and the official documentation has no examples for it. I've gotten BigQuery working with it but I can't seem to figure out how to set configuration properties, specifically so that I can run a query with BATCH priority.

Can anyone point me in the right direction?

Maybe this example is what you are looking for, just add the query priority field to the dict definition and it should work. — Willian Fuks
– Willian Fuks, Commented Mar 6, 2018 at 22:07

Neil C. Obremski · Accepted Answer · 2018-03-07 00:30:37Z

1

The answer is to use jobs().insert() rather than jobs().query(). Inserting a new job asynchronously gives the caller the ability to specify a wide range of options but requires them to run another command to get the results.

So assuming gs is your authenticated service object:

# insert an asynchronous job
jobr = gs.jobs().insert(projectId='abc-123', body={'configuration':{'query':{'query':'SELECT COUNT(*) FROM schema.table'}}}).execute()
# get query results of job
gs.jobs().getQueryResults(projectId='abc-123', jobId=jobr['jobReference']['jobId']).execute()

answered Mar 7, 2018 at 0:30

Neil C. Obremski

20.6k26 gold badges102 silver badges136 bronze badges

Sign up to request clarification or add additional context in comments.

Collectives™ on Stack Overflow

How to set BigQuery configuration properties with google-api-python-client?

1 Answer 1

Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

Comments

Your Answer

Sign up or log in

Post as a guest

Related