Maximum request length exceeded exception when UploadFromStream to Azure blobs

Question

I write an API, trying to upload the HTTP post content(I'm trying to upload a video) to Azure blobs through Stream in c#. Some thing like this:

Stream videoStream = await Request.Content.ReadAsStreamAsync();
CloudBlockBlob blockBlob = container.GetBlockBlobReference(blobName);
blockBlob.UploadFromStream(videoStream);

It works OK in my local environment. But when I deploy this web service to Azure and call the API, I got a "Maximum request length exceeded" exception like this:

System.Web.HttpException (0x80004005): Maximum request length exceeded.           
at System.Web.HttpBufferlessInputStream.ValidateRequestEntityLength()
at System.Web.HttpBufferlessInputStream.GetPreloadedContent(Byte[] buffer, Int32& offset, Int32& count)
at System.Web.HttpBufferlessInputStream.Read(Byte[] buffer, Int32 offset, Int32 count)
at Microsoft.Owin.Host.SystemWeb.CallStreams.DelegatingStream.Read(Byte[] buffer, Int32 offset, Int32 count)
at System.Web.Http.NonOwnedStream.Read(Byte[] buffer, Int32 offset, Int32 count)
at System.Net.Http.DelegatingStream.Read(Byte[] buffer, Int32 offset, Int32 count)
at Microsoft.WindowsAzure.Storage.Core.Util.StreamExtensions.WriteToSync[T](Stream stream, Stream toStream, Nullable`1 copyLength, Nullable`1 maxLength, Boolean calculateMd5, Boolean syncRead, ExecutionState`1 executionState, StreamDescriptor streamCopyState)
at Microsoft.WindowsAzure.Storage.Blob.CloudBlockBlob.UploadFromStreamHelper(Stream source, Nullable`1 length, AccessCondition accessCondition, BlobRequestOptions options, OperationContext operationContext)
at Microsoft.WindowsAzure.Storage.Blob.CloudBlockBlob.UploadFromStream(Stream source, AccessCondition accessCondition, BlobRequestOptions options, OperationContext operationContext)

I've changed my Web.config according to some tutorials on web,

<system.web>
  <httpRuntime targetFramework="4.5" maxRequestLength="600000" executionTimeout="3600" />
  <compilation debug="true" targetFramework="4.5" />
</system.web>

<system.webServer>
  <security>
    <requestFiltering>
      <requestLimits maxAllowedContentLength="600000000" />
    </requestFiltering>
  </security>
</system.webServer>

And the API works correctly on my local machine, even with some large videos(larger than 10MB). But it doesn't work as soon as I deploy in Azure Web Service. Why is that?

Update: I used some other methods, tring to bypass the problem. Such as I tried copy the HTTP request content to a FileStream, and upload the FileStream to Azure blob. The code like that:

using (Stream output = File.OpenWrite(TmpFile))
{
    await Request.Content.CopyToAsync(output);
}

CloudBlockBlob blockBlob = container.GetBlockBlobReference(blobName);

using (var fileStream = System.IO.File.OpenRead(TmpFile))
{
    blockBlob.UploadFromStream(fileStream);
}

But the same exception "Maximum request length exceeded" throw at function CopyToAsync.

System.Web.HttpException (0x80004005): Maximum request length exceeded.
at System.Web.HttpBufferlessInputStream.ValidateRequestEntityLength()
at System.Web.HttpBufferlessInputStream.GetPreloadedContent(Byte[] buffer, Int32& offset, Int32& count)
at System.Web.HttpBufferlessInputStream.BeginRead(Byte[] buffer, Int32 offset, Int32 count, AsyncCallback callback, Object state)
at Microsoft.Owin.Host.SystemWeb.CallStreams.DelegatingStream.BeginRead(Byte[] buffer, Int32 offset, Int32 count, AsyncCallback callback, Object state)
at System.Web.Http.NonOwnedStream.BeginRead(Byte[] buffer, Int32 offset, Int32 count, AsyncCallback callback, Object state)
at System.Net.Http.StreamToStreamCopy.StartRead()

Mark · Accepted Answer · 2016-11-17 23:58:34Z

CHANGES ARE TO THE Web.Config FILE.

The above solution work's I thought I would just add the code changes necessary instead of needing to download the solution and search through it to find what changes are necessary. Add the following between the system.web tabs which should already exist with other information between them.

<system.web>
<compilation debug="true" targetFramework="4.5.2" />
<httpRuntime targetFramework="4.5.2" maxRequestLength="600000" executionTimeout="3600" />
</system.web>

Then add the following between the system.webserver tabs which should already exist with other information between them.

<system.webserver>
<security>
  <requestFiltering>
    <requestLimits maxAllowedContentLength="600000000" />
  </requestFiltering>
</security>

After that I sent a 12.5 mb .zip file as a blob to azure file storage. Using the code provided by Azure.

 // Retrieve storage account from connection string.
CloudStorageAccount storageAccount = CloudStorageAccount.Parse(
    CloudConfigurationManager.GetSetting("StorageConnectionString"));

// Create the blob client.
CloudBlobClient blobClient = storageAccount.CreateCloudBlobClient();

// Retrieve reference to a previously created container.
CloudBlobContainer container = blobClient.GetContainerReference("mycontainer");

// Retrieve reference to a blob named "myblob".
CloudBlockBlob blockBlob = container.GetBlockBlobReference("myblob");

// Create or overwrite the "myblob" blob with contents from a local file.
using (var fileStream = System.IO.File.OpenRead(@"path\myfile"))
{
    blockBlob.UploadFromStream(fileStream);
}

I hope this helps someone.

JoshL · Accepted Answer · 2016-04-12 16:04:24Z

1

Here's a sample that uploads a random 20MB byte array from a console client to a Web API controller, which streams the HTTP request content into Azure blob storage:

sample

Note that it buffers on the client side (builds the entire 20MB byte array in memory), but it does not buffer on the server.

I tested this successfully with the client running on my laptop, and the server running both locally and in an Azure Web App (no extra config, just published the Web API project into the Azure web app).

Hope this helps... best of luck!

answered Apr 12, 2016 at 16:04

JoshL

1,7161 gold badge12 silver badges13 bronze badges

5 Comments

Mabraygas Over a year ago

Thanks JoshL, seems your code is quite same from mine. But mine still can't work on Azure Web app. My local IIS is version 10.0 but Azure seems 8.0 I doubt the problem might be there. Still checking...

JoshL Over a year ago

Ah, sorry to hear it... let us know if you have more info to share and we can help take a closer look.

JoshL Over a year ago

Out of curiosity, are you sure that your site is running on .NET 4.5 and not some other version, in Azure? Your web.config specifically references targetFramework=4.5. You can view and modify your Azure site config as per here... azure.microsoft.com/en-us/documentation/articles/…

Mabraygas Over a year ago

I check my local environment and the azure settings, the two platform both use .NET 4.6. I tried to delete the targetFramework=4.5 in web.config and tried to modify it to targetFramework=4.6 but seems that didn't take effect. Local succeeded, Azure failed.

JoshL Over a year ago

Try removing the targetFramework reference altogether... does that change anything?

Collectives™ on Stack Overflow

Maximum request length exceeded exception when UploadFromStream to Azure blobs

2 Answers 2

Comments

5 Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

2 Answers 2

Comments

5 Comments

Your Answer

Sign up or log in

Post as a guest

Related