1

I am trying to copy data from ADLS using Azure Data Factory pipeline. The pipeline will run daily and each day it will copy data for the same day.

In the pipeline start time and end time is provided to get only current days data as shown below. enter image description here

The issue is, even though there is no data in the source, the data copy job succeeds, showing pipeline success status. enter image description here

Is there any way to fail the data copy task if there is no data in the source adls?

Improve this question

1 Answer 1

Reset to default
2

I don't think you can force Copy activity to fail if the source exists. What I would do is put a GetMetadata activity that captures "Exists" in front of the Copy. If it does not exist, then fail the pipeline.

Improve this answer
Sign up to request clarification or add additional context in comments.

1 Comment

Yes! For checking the files in the folder, getMetadata activity will serve the purpose.

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge you have read our privacy policy.

Start asking to get answers

Find the answer to your question by asking.

Ask question

Explore related questions

See similar questions with these tags.