Trigger AWS Lake Formation Workflow programmatically

Question

In the documentation I did not find a mention of programmatically triggering workflows (e.g. to load data from a RDBMS into S3). I also did not find anything in the API specification of AWS Lake Formation. We are using Airflow for scheduling our ETL pipeline and it would be nice if we could trigger the Workflow via an API call.

vrajat · Accepted Answer · 2019-12-11 07:35:56Z

1

Lake Formation is used to specify permissions for tables and columns in the Glue Catalog. It does not manage ETL. You can use Glue to setup crawlers to download data from a RDBMS. A crawler can be part of a Glue Workflow.

Reference Links:

Documentation on adding a crawler for RDBMS

Glue API to start a crawler

Glue API to start a workflow

answered Dec 11, 2019 at 7:35

vrajat

1281 silver badge8 bronze badges

Sign up to request clarification or add additional context in comments.

Collectives™ on Stack Overflow

Trigger AWS Lake Formation Workflow programmatically

1 Answer 1

Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

Comments

Your Answer

Sign up or log in

Post as a guest

Related