Azure BlobBatchClient.DeleteBlobsAsync always return 404 blob not found

Question

I am experiencing a very strange behaviour when trying to do a batch delete blobs in a container. Having the following code (note some of the code is omitted or edited for brevity and security reasons):

var blobServiceClient = GetAzureBlobServiceClient();
var container = await BuildAzureContainer(blobServiceClient);

var blobsToBeDeleted = new List<Uri>();

var thumbImage = removedMedia.Path.GetThumbImageName();
blobsToBeDeleted.Add(new Uri("https://account-name.blob.core.windows.net/container-name/blob-name"));

if (!string.IsNullOrEmpty(thumbImage))
{
    blobsToBeDeleted.Add(new Uri("https://account-name.blob.core.windows.net/container-name/thumbs/blob-name"));
}

if (blobsToBeDeleted.Any())
{
    var batch = blobServiceClient.GetBlobBatchClient();
    await batch.DeleteBlobsAsync(blobsToBeDeleted, DeleteSnapshotsOption.IncludeSnapshots);
}

Using Azure.Storage.Blobs(12.9.0) and Azure.Storage.Blobs.Batch(12.6.0) Right before I try to do the batch delete I am uploading the images to Azure and confirming they are uploaded and exist in the container. The response from Azure is:

System.AggregateException: 2 batch operation(s) failed. (The specified blob does not 
exist.
RequestId: **removed**
Time:2021-06-18T08:16:15.2409894Z
Status: 404 (The specified blob does not exist.)
ErrorCode: BlobNotFound

Tried also to get the Uri using:

container.GetBlobClient("blob-name").Uri

or

container.GetBlobClient("thumbs/blob-name}").Uri

which also returns a correct url but with no luck.

I have checked and the URLs I am adding to the list are exactly the same with the active ones in Azure. No matter what I am doing the response is the same - all batch operations return BlobNotFound. For instance if do the following with the same blob:

BlobClient blob = container.GetBlobClient("container-name/blob-name");
await blob.DeleteAsync(DeleteSnapshotsOption.IncludeSnapshots);

The blob is successfully deleted. I am really struggling with this and cannot find what is causing this behaviour especially when I am able to delete the same blob but not in a batch. Am I missing something or there's something happening with the SDK? Decided to write here before opening a new issue in GitHub.

Any help would be really appreciated.

P.S. I am sure this was working a couple of months ago and the only thing changed is NuGet package updates.

I just raised an issue here: github.com/Azure/azure-sdk-for-net/issues/24093. — Gaurav Mantri
– Gaurav Mantri, Commented Sep 17, 2021 at 19:19

Stanley Gong · Accepted Answer · 2021-06-18 09:47:37Z

3

I did some tests on my side, if you specify DeleteSnapshotsOption.IncludeSnapshots for batch.DeleteBlobsAsync to delete blobs that have no snapshot, you will get a 404 error.

So I am afraid you need to check if blobs have snapshots or not before deleting them by batch.

answered Jun 18, 2021 at 9:47

Stanley Gong

12.2k1 gold badge12 silver badges20 bronze badges

Sign up to request clarification or add additional context in comments.

4 Comments

Ivaylo Over a year ago

You are so right. Didn't think this would case the issue. Just tested and confirm - if no snapshots are available, DeleteBlobsAsync() should be called without DeleteSnapshotsOption.IncludeSnapshots

Gaurav Mantri Over a year ago

Interesting! So I tried the same and I was able to delete blobs in batch regardless of whether they have snapshots or not. My code was using Node SDK though. I will try the same with .Net SDK.

dugas Oct 2 at 2:17

Any findings on .net sdk, for those that stumble across this a year later?

dugas Oct 2 at 2:43

See: github.com/Azure/azure-sdk-for-net/issues/24093

Collectives™ on Stack Overflow

Azure BlobBatchClient.DeleteBlobsAsync always return 404 blob not found

1 Answer 1

4 Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

4 Comments

Your Answer

Sign up or log in

Post as a guest

Related