Skip to main content
81 questions
Newest Active Bountied Unanswered
Filter by
Sorted by
Tagged with
0 votes
0 answers
42 views

I need to transfer data from an Azure SQL database in Tenant A to another Azure SQL database in Tenant B using Azure Data Factory. I want to use Service Principal authentication without relying on ...
Narsimha V's user avatar
  • 11
0 votes
1 answer
80 views

COPY statement input file schema discovery failed: Cannot process the file " https://my-storage-account.dfs.core.windows.net/a-folder/a-parquet-file.snappy.parquet " because it could not be ...
Ricker Silva's user avatar
  • 1,175
0 votes
2 answers
69 views

I've been trying to find out if it's possible to parameterize the linked service in an Azure Data Factory (ADF) dataset, similar to how we can parameterize the table name and schema name in a SQL ...
play_something_good's user avatar
  • 137
1 vote
1 answer
112 views

I have a bicep file that creates a linked service from a data factory to a storage account. It's pretty basic: module Storage 'linked_services/linked_services.bicep' = { name: 'AzureFileStorage' ...
user2328273's user avatar
  • 1,010
1 vote
1 answer
66 views

I have two Azure keys vaults. One for password and one for username. I have to insert username value but I don’t know where I have to get it. How have I to insert username Azure key vault in this ...
Giusy's user avatar
  • 11
0 votes
1 answer
182 views

I try to create a linked_service using this terraform command: azurerm_data_factory_linked_service_azure_sql_database. The documentation says that we can use use_managed_identity (I use it as a ...
Potis23's user avatar
  • 534
0 votes
1 answer
73 views

I have 2 environments, Staging & Production. Both using the exact code, but one environment can read the contents within the file, while other cannot. I can see both FileInfo using 2 codes: Python:...
Dan Wang's user avatar
  • 21
0 votes
1 answer
53 views

I created a linked service in Azure Data Factory, it points to a remote Postgres database. The connection is working. But when I specify a particular schema under the title "Additional connection ...
Smoke Less's user avatar
  • 1
0 votes
1 answer
108 views

In our project we have a Oracle linked service created using connection type as SID. We have a requirement to connect to a Oracle database using Service name only. We want single linked service that ...
kartheek baddula's user avatar
  • 23
0 votes
1 answer
95 views

We have some production stored procedures which need executing in the middle of the day using our on-prem servers, is it possible for these to be trigger via an Azure Data Factory Pipeline on our ...
Nicholas Campbell's user avatar
  • 13
0 votes
2 answers
160 views

I am writing some code to create some Azure ressource using the PowerShell CLI. Currently, I aim at setting up a LinkedService to pull some JSON data from a REST API. When I run the code, the linked ...
user27821072's user avatar
  • 1
0 votes
1 answer
85 views

I wanted to find the SQL Servers are present in ADF or not but I am checking the ADF it through a resource group. Is there any smart way to find out the SQL Server link from linked service of ADF? I ...
Sarmistha Sarkar's user avatar
  • 1
0 votes
0 answers
210 views

In Azure Synapse I'm using the SAP CDC Connector to connect to a S/4HANA system. My goal is to filter data on the source side before storing it in my ADLS Gen2, as there are certain data restrictions ...
supermtz's user avatar
  • 1
1 vote
1 answer
386 views

created Linked service to Azure SQL database in Synapse Analytics that uses Authentication type " System Assigned Managed Identity". Than referencing it in PySpark Notebook. Method ...
Balbeer Singh's user avatar
  • 11
1 vote
2 answers
958 views

This is the error I'm trying to learn azure data bricks, data factory... I'm trying to link the data bricks cluster to data factory, but the clusters are failing to load, I've entered the cluster ...
sashidhar chary's user avatar
  • 11
0 votes
1 answer
177 views

I am trying to connect to Presto using linked service in Azure Data Factory using the link below: https://learn.microsoft.com/en-us/azure/data-factory/connector-presto?tabs=data-factory I have entered ...
Praveen Kumar's user avatar
  • 1,539
0 votes
1 answer
230 views

I have 5 self hosted integration runtimes like shir, shir 1,shir2,...shir5. I want to create a linked service to a SQL MI in adf but want to dynamically pass the integration runtime values. whats the ...
bin's user avatar
  • 11
0 votes
1 answer
2k views

Im using Linked service to connect the Azure SQL database to the Azure data factory data flow. In the Azure data factory Linked service connection gets established successfully. However, when I add ...
Indrajith Ekanayake's user avatar
  • 4,382
0 votes
1 answer
556 views

I deployed my Azure Data Factory (ADF) from the dev environment to the staging environment using Azure DevOps. When in live mode, All the services in the ADF staging are just like they were in the dev ...
Rudra's user avatar
  • 243
0 votes
1 answer
652 views

After performing CICD from dev to qa of ADF, all other resources are in place but linked service didnot setup properly with the following error The data factory Data-Factory-Ds-qa has no MI ...
Rudra's user avatar
  • 243
0 votes
1 answer
515 views

I am trying to pull data from a dedicated sql pool in a different azure subscription, when I try to create the linked service from my target azure synapse workspace using sql authentication, firewall ...
Nhlanganiso md's user avatar
  • 1
1 vote
1 answer
565 views

I have a linked service to a blob storage account in my ADF and what I'm finding is that when I delete the linked service from my azure datafactory (that is linked to my dev branch), that change is ...
Martin's user avatar
  • 597
0 votes
1 answer
647 views

How to connect ADO REST API connection using with Azure data factory pipeline linked service and dataset. I'm trying to create Dataset for REST connect using azure data factory, unable to get preview ...
user avatar
1 vote
1 answer
553 views

I have a linked service. Name is 'LS_test'. The name of the linked service is the same in development as in production. This linked service makes a connection from a Synapse notebook to the data lake ...
Herwini's user avatar
  • 457
-1 votes
1 answer
149 views

I have azure account, and want to create azure data lake storage gen2 URL value from AKV secret name value, I created AKV and created secret name and in the value I gave my storage URL like: https://...
Shohzot Nurullayev's user avatar
  • 1
0 votes
1 answer
734 views

I am facing issue when creating a linked service from ADF for Azure Cosmos DB for PostgreSql CLuster.. Please help me to resolve the issue. Note: Cluster is running. In the cluster in Networking '...
Abhijit's user avatar
  • 27
0 votes
0 answers
194 views

I created a azure data factory pipeline in collaboration branch, pipeline is succeeded and I'm trying to publish the pipeline getting one error. Invalid references or dependencies found. This is ...
user avatar
0 votes
1 answer
623 views

Currently I am trying to deploy some infrastructure in Azure using Terraform. So far everything worked well. Yet, when trying to deploy my Linked Services in Synapse Analytics to a Key Vault and an ...
ExploitedRoutine's user avatar
  • 21
1 vote
1 answer
387 views

I've 4 data-bricks notebook activities to run in parallel to do the same task but for different parameters (variables). Do I need to create separate Linked service for each notebook connection when ...
Hemant Singh's user avatar
  • 13
0 votes
1 answer
319 views

I am unable to create a linked service (file system) i.e a path pointing to my local machine using self-hosted integration runtime. I have installed azure self-hosted integration runtime in my local ...
awesome_sangram's user avatar
  • 89
0 votes
1 answer
151 views

If you are trying to export Google Ads data and you are using Synapse, there is a Linked Service that allows you to use a simple copy activity to land your data on a storage account or similar. Since ...
asguldbrandsen's user avatar
  • 183
0 votes
2 answers
2k views

I'm using ADF to call Databricks notebooks via linked service. When ADF passes parameters as blank (either leaving the input box as blank or typing ""), Databricks notebooks widgets read it ...
Spacez's user avatar
  • 81
1 vote
1 answer
647 views

I need to create linked service with the ODBC connection in azure data factory to copy data from ODBC(Paris) to azure sql. I have installed the ODBC driver in my SHIR , when I create linked service am ...
Ebelly's user avatar
  • 13
1 vote
1 answer
349 views

my API call is of the following format url: base url/page=x&token=yyyy How can I create a safe linked service for this in Azure Data Factory? I tried with head auth but don't know how to proceed.
Alex's user avatar
  • 159
0 votes
1 answer
312 views

I am very new to Azure Synapse and have come across the topic of ‘Datasets’. I have this confusion of why do we need datasets and not directly use a reference to our data file while creating ...
user15096063's user avatar
  • 53
0 votes
1 answer
245 views

I am deploying a Azure Function Linked Service through CICD pipeline, I am unable to deploy it to ADF with its function key "LS_AF_xxxx_properties_typeProperties_functionAppUrl": { "...
Anshul Dubey's user avatar
  • 378
0 votes
1 answer
398 views

I'm working within a Synapse workspace. I have a linked service to a oracle database in a private network (10.x.x.x) I have a SparkJob which is trying to connect to that database with the oracle thin ...
Ricardo Olvera's user avatar
  • 1
0 votes
2 answers
1k views

We are trying to create an Azure Data Factory Linked Service for an Azure Batch account using Terraform. However, there is no native resource available in Terraform documentation for creating an Azure ...
Karandeep Singh's user avatar
  • 1
1 vote
1 answer
4k views

I am trying to connect to On-prem SQL Server ( Microsoft SQL Server) from ADF self integration run time. while creating linked service , i am getting below error Cannot connect to SQL Database. ...
Hema's user avatar
  • 21
2 votes
1 answer
2k views

I am looking to create a simple test pipeline to pull in a csv file on my laptops C drive and load it into SQL Server on-prem (also installed on my laptop). I have installed the self hosted ...
alex878's user avatar
  • 21
0 votes
2 answers
3k views

I am executing the az datafactory linked-service create command, which creates a new linked service in my ADF. It is visible. However, after integrating ADF with Git, the same command returns ...
Karol Bakiera's user avatar
  • 1
0 votes
1 answer
1k views

So in ADF, im trying to create a linked service to an Azure SQL Database where the connection string is stored in the key vault. The connection host many databases so the database name is not declared....
jo80's user avatar
  • 21
0 votes
1 answer
3k views

I need to use different Keyvaults for different environments (Dev/Test/UAT/Prod). So, the name of the keyvault to be used is stored the Global Parameters, and is propagated from pipelines to other ...
Dmitriy Ryabin's user avatar
  • 470
4 votes
4 answers
14k views

I'm trying to create a File System Linked Service in Data Factory in order to access a folder (\\serverName\c$\folder) using Self-Hosted Integration Runtime, even though I inserted an user who has &...
Pedro Fernandes's user avatar
  • 63
0 votes
2 answers
356 views

I am flattening a Json File to CSV file using mapping data flow in Azure data factory, the issue is that files is placed in storage container which is behind firewall. As it looks Only Auto Resolve ...
Anshul Dubey's user avatar
  • 378
0 votes
1 answer
406 views

How can i get refresh token from xero custom connetion, when i work with previous account i could get this refresh token. but now it it now provided.now when i use this https://identity.xero.com/...
chamith rasintha's user avatar
  • 251
1 vote
1 answer
1k views

I have created a Linked service in azure data factory using azure portal. I want to connect to this Linked service in notebook activity in synapse using python. Do we have any such api? Please let me ...
sac's user avatar
  • 225
0 votes
1 answer
493 views

I'm writing a terraform script to create a azure synapse workspace. I've created a linked service for Azure Function but I'm unable to use it in pipeline, where it gives me an error of missing ...
Ehsan's user avatar
  • 3
0 votes
1 answer
810 views

A vendor provided access to their server via ODBC connector that created a SYSTEM DSN on my local machine. I would like to replicate the data in Azure Synapse data lake for analysis. The Azure Synapse ...
Alen Giliana's user avatar
  • 2,154
0 votes
1 answer
2k views

I have an on-prem machine for DB2 connectivity to ADF where SHIR is installed, and I have been provided with the certificate zip file. How to use SSL certificate for linked service of DB2 in data ...
Sunaina Lalwani's user avatar
  • 1

1
2