Copy blob from one storage account to another using @azure/storage-blob

Question

What would be the best way to copy a blob from one storage account to another storage account using @azure/storage-blob?

I would imagine using streams would be best instead of downloading and then uploading, but would like to know if the code below is the correct/optimal implementation for using streams.

const srcCredential = new ClientSecretCredential(<src-ten-id>, <src-client-id>, <src-secret>);
const destCredential = new ClientSecretCredential(<dest-ten-id>, <dest-client-id>, <dest-secret>);

const srcBlobClient = new BlobServiceClient(<source-blob-url>, srcCredential);
const destBlobClient = new BlobServiceClient(<dest-blob-url>, destCredential);

const sourceContainer = srcBlobClient.getContainerClient("src-container");
const destContainer = destBlobClient.getContainerClient("dest-container");

const sourceBlob = sourceContainer.getBlockBlobClient("blob");
const destBlob = destContainer.getBlockBlobClient(sourceBlob.name)

// copy blob
await destBlob.uploadStream((await sourceBlob.download()).readableStreamBody);

Gaurav Mantri · Accepted Answer · 2021-03-31 06:15:15Z

1

Your current approach downloads the source blob and then re-uploads it which is not really optimal.

A better approach would be to make use of async copy blob. The method you would want to use is beginCopyFromURL(string, BlobBeginCopyFromURLOptions). You would need to create a Shared Access Signature URL on the source blob with at least Read permission. You can use generateBlobSASQueryParameters SDK method to create that.

const sourceBlob = sourceContainer.getBlockBlobClient("blob");
const destBlob = destContainer.getBlockBlobClient(sourceBlob.name);

const sourceBlobSasUrl = GenerateSasUrlWithReadPermissionOnSourceBlob(sourceBlob);
// copy blob
await destBlob.beginCopyFromURL(sourceBlobSasUrl);

answered Mar 31, 2021 at 6:15

Gaurav Mantri

137k17 gold badges247 silver badges282 bronze badges

Sign up to request clarification or add additional context in comments.

4 Comments

Gaurav Mantri Over a year ago

That's weird. Can you tell me more about your setup? Please edit your question and include your latest code. Also, you should be able to dig deep into the error message and see which HTTP header is not in the correct format. Please share that as well.

yohaansunnie Over a year ago

Sorry, I hadn't added the blob URL part before the SAS. However, the issue I have now is that it throws an error saying "RestError: Public access is not permitted on this storage account". The storage account is configured to disable public blob access, but it is configured to allow SAS. 'Allow shared key access' is enabled. Will this only work if the public access is enabled?

Gaurav Mantri Over a year ago

Please see this thread: learn.microsoft.com/en-us/answers/questions/40660/… and this: learn.microsoft.com/en-us/azure/storage/blobs/…. It seems for this solution to work, public access should be enabled.

yohaansunnie Over a year ago

It worked!! Sorry, it was the URL again (missed the '?' before SAS query parameter), which was why the public access error came up thinking it was simply a URL. You don't need to have the 'Public Access' enabled on the storage account, just need the SAS access enabled. I was able to perform a copy on a large file and it completed really fast. Thank you for your answer!!

Collectives™ on Stack Overflow

Copy blob from one storage account to another using @azure/storage-blob

1 Answer 1

4 Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

4 Comments

Your Answer

Sign up or log in

Post as a guest

Related