How to sequence pipeline execution trigger in Azure Data Factory

Question

I am working on a migration project where I have a few SQL Server Integration Service projects that will be moved to Azure Data Factory. While I go through this we have a few jobs scheduled via SQL Server Agent which has multiple steps. If were to replicate the same using Azure Data Factory triggers is there a way to group multiple pipelines together and sequence the execution accordingly like we have multiple job steps in SQL Server Agents.

For instance:

Load all of the lookup tables
Load all of the staging tables
Load all of the dimension tables
Load Fact table

Please guide in the right direction.

David Browne - Microsoft · Accepted Answer · 2022-01-20 22:39:09Z

1

You can use the Execute Pipeline Activity to build a master pipeline that runs your other pipelines. eg

edited Jan 20, 2022 at 22:39

answered Jan 20, 2022 at 21:36

David Browne - Microsoft

90.8k7 gold badges52 silver badges87 bronze badges

Sign up to request clarification or add additional context in comments.

2 Comments

ITHelpGuy Over a year ago

Hi @David Browne, Is there a way to group together a few pipelines and add a trigger on them so they run in a sequence?

David Browne - Microsoft Over a year ago

Yes. The Execute Pipeline Activity. See updated answer.

Collectives™ on Stack Overflow

How to sequence pipeline execution trigger in Azure Data Factory

1 Answer 1

2 Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

2 Comments

Your Answer

Sign up or log in

Post as a guest

Related