Databricks python notebook to execute %sql commandlet based on condition

Question

I have created a python notebook in Databricks, I have python logic and need to execute a %sql commandlet.

Say I wanted to execute that commandlet2 based on a python variable

cmd1

EXECUTE_SQL= True

cmd2

if condition : 
  %sql .....

Since you are using Databricks,it allows you used Sql commands using sql("<query>") — Subash
– Subash, Commented Aug 6, 2022 at 7:28

Alex Ott · Accepted Answer · 2022-08-06 10:39:02Z

3

As mentioned, you can use following Python code (or Scala) to make behavior similar to the %sql cell:

if condition:
  display(spark.sql("your-query"))

One advantage of this approach is that you can embed variables into the query text.

answered Aug 6, 2022 at 10:39

Alex Ott

88.1k10 gold badges110 silver badges157 bronze badges

Sign up to request clarification or add additional context in comments.

Comments

Tim · Accepted Answer · 2022-08-06 14:33:53Z

0

Another alternate which I used is

Extracted the sql to a different notebook,
- In my case i don't want any results back
- Also I am cleaning up the delta tables and deleting contents.

/clean-deltatable-notebook (an sql notebook)

delete from <database>.<table>

cmd2

if condition :
   result = dbutils.run.notebook('<path-of-(clean-deltatable-noetbook)',timeout_seconds = 30)
   print(result)

Link on dbutils.notebook.run() from Databricks

answered Aug 6, 2022 at 14:33

Tim

1,5113 gold badges35 silver badges64 bronze badges