curl upload all files in a directory with a single curl command?

Question

I am looking to upload a multipart/form-data file upload. I working on a circleci job to auto deploy a couple files of a specific file type all in one go.

This solution works but it is making a seperate curl call for each file.

cd ~/project;find . -name "*.txt*" -type f -exec curl -k -H "Accept: application/json" -H "Authorization: Bearer $bearertoken" -F "deployment-name=${CIRCLE_SHA1:0:7}" -F "deployment-source=circleci" -F "enable-duplicate-filtering=false" -F "deploy-changed-only=true" -F "{}=@{}" http:www.blah.com  \;

I am wondering if there is a way that I can build a file list of all the files in the directory and then use that variable in a single curl upload.

It depends on whether the script you're sending to allows multiple uploads. — Barmar
– Barmar, Commented Mar 3, 2021 at 22:49
Yes, it supports multiple files in a single update. For example it would work like this -F "./file1=@./file1.txt" -F "./file2=@./file2.txt — dayv2005
– dayv2005, Commented Mar 4, 2021 at 14:53

Barmar · Accepted Answer · 2023-04-03 15:02:12Z

4

Use a loop to create an array of alternating -F and filename=@filename. Then substitute the array into the curl command.

files=()
while read -r filename; do
    files+=(-F "$filename=@$filename")
done < <(find . -name '*.txt' -type f)

curl -k -H "Accept: application/json" -H "Authorization: Bearer $bearertoken" "${files[@]}" -F "deployment-name=${CIRCLE_SHA1:0:7}" -F "deployment-source=circleci" -F "enable-duplicate-filtering=false" -F "deploy-changed-only=true" "${files[@]}" http:www.blah.com

edited Apr 3, 2023 at 15:02

answered Mar 4, 2021 at 15:44

Barmar

789k57 gold badges555 silver badges669 bronze badges

Sign up to request clarification or add additional context in comments.

4 Comments

Charles Duffy Over a year ago

Surely there's an extra $ in "${$files[@]}"

dayv2005 Over a year ago

This is exactly what I was looking to do. Thank you. made some slight modifications to my scripts.

b26 Over a year ago

this script doesn't work

Barmar Over a year ago

@b26 There was a typo that Charles Duffy noticed but I never fixed.

Collectives™ on Stack Overflow

curl upload all files in a directory with a single curl command?

1 Answer 1

4 Comments

Your Answer

Linked

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

4 Comments

Your Answer

Sign up or log in

Post as a guest

Linked

Related