How to upload append blob to azure without getting size limit exception?

Question

public async Task<string> UploadDataAsync<T>(CloudBlobContainer container, string relativeUrl, List<T> reportData, string mimeType, string data, ILogger log)
    {
        string absoluteUri = string.Empty;
        byte[] bytes = Encoding.ASCII.GetBytes(data);
        using (var ms = new MemoryStream())
        {
            using (StreamWriter sw = new StreamWriter(ms))
            {
                sw.Write(data);
                sw.Flush();
                ms.Position = 0;

                CloudAppendBlob blob;
                blob = container.GetAppendBlobReference(relativeUrl);
                if (await blob.ExistsAsync())
                {
                    await blob.AppendBlockAsync(ms);
                    absoluteUri = blob.StorageUri.PrimaryUri.AbsoluteUri;
                }
                else
                {
                    CloudAppendBlob appBlob = await CreateEmptyFileAsync(container, relativeUrl, reportData, mimeType, log);
                    await appBlob.AppendBlockAsync(ms);
                    absoluteUri = appBlob.StorageUri.PrimaryUri.AbsoluteUri;
                }
            }
        }

        return absoluteUri;
    }

Getting this Exception -

Microsoft.WindowsAzure.Storage.StorageException: 'The request body is too large and exceeds the maximum permissible limit.' [External Code] PDCGeoTabFunction.Services.UploadService.UploadDataAsync(Microsoft.WindowsAzure.Storage.Blob.CloudBlobContainer, string, System.Collections.Generic.List, string, string, Microsoft.Extensions.Logging.ILogger) in UploadService.cs [External Code] PDCGeoTabFunction.Services.SyncGeoTabDataService.GetZone(Geotab.Checkmate.API, string, string, string, Microsoft.Extensions.Logging.ILogger, string, string, string, string, System.Collections.Generic.List<Geotab.Checkmate.ObjectModel.Zone>) in SyncGeoTabDataService.cs

Please help.

Gaurav Mantri · Accepted Answer · 2022-03-17 06:16:27Z

2

Most likely you are getting this error is because the data that you are trying to upload is more than 4MB. The request payload size of each append operation can be a maximum of 4MB.

From REST API documentation:

Append Block uploads a block to the end of an existing append blob. The block of data is immediately available once the call succeeds on the server. A block may be up to 4 MiB in size.

Please split your data in such a way that each call to AppendBlockAsync is not uploading data more than 4MB.

answered Mar 17, 2022 at 6:16

Gaurav Mantri

137k17 gold badges247 silver badges282 bronze badges

Sign up to request clarification or add additional context in comments.

Collectives™ on Stack Overflow

How to upload append blob to azure without getting size limit exception?

1 Answer 1

Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

Comments

Your Answer

Sign up or log in

Post as a guest

Related