Azure Mapping Data Flow : Not able to use blob storage dataset as a source

Question

I added a Azure Blob dataset as a source to a Azure mapping data flow, but am not able to view the preview as it is showing the below error :

Dataset is using 'AzureStorage' linked service type, which is not supported in data flow.

Given below is the dataset JSON :

{
"name": "PIT_Input",
"properties": {
    "linkedServiceName": {
        "referenceName": "data_staging",
        "type": "LinkedServiceReference"
    },
    "annotations": [],
    "type": "DelimitedText",
    "typeProperties": {
        "location": {
            "type": "AzureBlobStorageLocation",
            "container": "dataflowpoc"
        },
        "columnDelimiter": ",",
        "escapeChar": "\\",
        "firstRowAsHeader": true,
        "quoteChar": "\""
    },
    "schema": []
  }
}

data_staging is a linked service of type Azure Storage.

The documentation states that Azure Blob datasets can used as a source. Please tell me what I'm doing wrong here.

Just an assumption: was a performance option set to: Premium? If so, consider to change to Standard. Another smaller recommendation is an account kind to set to the most modern "StorageV2" — Alexander Volok
– Alexander Volok, Commented Jan 3, 2020 at 14:12
Please try creating a new dataset of type Delimited Text with an Azure Blob Linked Service and let me know if you still receive this error. — Mark Kromer MSFT
– Mark Kromer MSFT, Commented Jan 4, 2020 at 20:02
I changed the type of the Linked Service from Azure storage to Azure blob storage, and it worked. I'm really not sure about the difference between the two. — Vishnu Suresh
– Vishnu Suresh, Commented Jan 9, 2020 at 5:58

Chetan Joshi · Accepted Answer · 2020-10-05 05:32:26Z

1

According you dataset JSON, you just choose the container dataflowpoc, didn't specify the file.

You only could preview the file data which type is "DelimitedText":

Dataset Preview data, we can not preview all the data if files in the container with different schema:

Dataset JSON:

{
    "name": "DelimitedText1",
    "properties": {
        "linkedServiceName": {
            "referenceName": "AzureBlobStorage1",
            "type": "LinkedServiceReference"
        },
        "annotations": [],
        "type": "DelimitedText",
        "typeProperties": {
            "location": {
                "type": "AzureBlobStorageLocation",
                "container": "containerleon"
            },
            "columnDelimiter": ",",
            "escapeChar": "\\",
            "firstRowAsHeader": false,
            "quoteChar": "\""
        },
        "schema": []
    },
    "type": "Microsoft.DataFactory/factories/datasets"
}

But in Data Flow Data Preview, we can see all the data in the files:

I think your error just happened by accident, please refresh the Data Factory and try again.

Update:

The error is solved: "I changed the type of the Linked Service from Azure storage to Azure blob storage, and it worked."

Hope this helps.

edited Oct 5, 2020 at 5:32

Chetan Joshi

5,7414 gold badges32 silver badges45 bronze badges

answered Jan 6, 2020 at 3:00

Leon Yue

16.5k1 gold badge17 silver badges26 bronze badges

Sign up to request clarification or add additional context in comments.

2 Comments

Vishnu Suresh Over a year ago

I changed the type of the Linked Service from Azure storage to Azure blob storage, and it worked. I'm really not sure about the difference between the two.

Leon Yue Over a year ago

@VishnuSuresh Congratulations. Storage is too widely, it has blog storage, file, queue and table storage. Do mind me update you comment to my answer? Then you can accept(mark) it as answer. This can be beneficial to other community members. Thank you.

Collectives™ on Stack Overflow

Azure Mapping Data Flow : Not able to use blob storage dataset as a source

1 Answer 1

2 Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

2 Comments

Your Answer

Sign up or log in

Post as a guest

Related