1

I am new to ADF. I am creating a small demo where I am trying to hit a sample API "https://dummy.restapiexample.com/api/v1/employees" and inserting data into the Employee table in the SQL database.

However, I would also like to add data flow to perform few select and other transformations on other related tables.
Below are the things that I have done so far in azure data factory:

  1. Created a linked service called "EmployeeRestService" to communicate with the above api.
    enter image description here

  2. Created a linked service called "AzureSqlDatabase" to communicate with azure sql database enter image description here

  3. Created a dataset "EmployeeApiDataset" of type "Rest" and linked it with "EmployeeRestService".

    enter image description here

  4. Created a dataset of type Azure sql database and Selected "EmployeeTable".

  5. Added one data flow (Now here I am getting the problem)
    data flow source settings

    data flow source options

And here is the error snapshot:
Error

In the data flow --> Source Settings, I selected "EmployeeApiDataset". But when I am trying to preview the data by enabling the debug, I am getting below error (refer above snapshot):
at Source 'EmployeeApi': Rest Sink - Error response received from the server (url:http://dummy.restapiexample.com/api/v1/employees,request body: None, request method: GET, status code: 429), response body: Some(

Is this a correct way of doing adding Rest data source in data flow? Note: I do not want to create an Azure data lake to store API results.

Can anybody suggest to me why I am getting the above error and what is the correct way of doing this?

Improve this question
3
  • 429 Too Many Requests is an HTTP error code thrown by the target server, not anything in your workflow. If you open the URL in your browser, you'll see that the target site is returning this status code. Commented Oct 12, 2021 at 15:45
  • Interesting.. !!! But am I going in the right direction. Is it possible to use Rest Api as a source in my data flow this way? Commented Oct 12, 2021 at 17:05
  • This should work. Can you try it as an inline dataset type in your source instead? Commented Oct 12, 2021 at 18:02

1 Answer 1

Reset to default
1

As @esqew mentioned in the comments, there is nothing wrong with your dataflow Source settings. As you are using online dummy Rest API as your source dataset, there are high chances that too many requests are made to call the Rest API by users.

  1. I also got the same error when tried.

enter image description here

  1. Also got the same 429 error when tested the URL.

enter image description here

  1. I just hit the refresh and got the data in the source data preview.

enter image description here

Improve this answer
Sign up to request clarification or add additional context in comments.

Comments

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge you have read our privacy policy.

Start asking to get answers

Find the answer to your question by asking.

Ask question

Explore related questions

See similar questions with these tags.