Running curl commads in a loop while reading from a file in bash

Question

I'm trying to parse a file by line and then trying to run all the curl commands in it, and then logging the successful v/ unsuccessful calls.

cat file 

/usr/bin/curl  -X POST http://localhost/services/migration -H 'Content-Type: application/json' -H 'cache-control: no-cache' -d ' [{"resources": [{"name": "Provisioned Throughput (at peek load)","value": "514"}],"entityTypes": [{"app": "thanos"}],"subEntityTypes": [{"vapps": "loki-odinson"}],"user": "[email protected]"}]';
/usr/bin/curl  -X POST http://localhost/services/migration -H 'Content-Type: application/json' -H 'cache-control: no-cache' -d ' [{"resources": [{"name": "Provisioned Throughput (at peek load)","value": "5124"}],"entityTypes": [{"app": "stark"}],"subEntityTypes": [{"vapps": "tony-s"}],"user": "[email protected]"}]';

I am parsing the file by line. echo statement works fine and gives me curl command, but when I try to run it plainly, it gives me -bash: No such file or directory error.

I could source the whole file but that would be a pain in logging to see how many failed vs succeeded.

Below is the command im trying to run.

IFS=$'\n'
for var in `cat ten`; do $var ; sleep 1 ; done

Check the BashFAQ.

Paul Hodges
– Paul Hodges

2020-10-06 20:02:27 +00:00
Commented Oct 6, 2020 at 20:02 — Paul Hodges
– Paul Hodges, Commented Oct 6, 2020 at 20:02

l0b0 · Accepted Answer · 2020-10-06 20:12:10Z

1

To run each command listed in a file called commands.txt, simply treat it as a script: bash commands.txt.

That said, the loop has several issues:

Overriding IFS globally is going to cause some weird behaviour. Basically you'll only ever want to override it for a single command, as in IFS=$'\n' COMMAND.
Use $(COMMAND) instead of backticks.
Don't loop over lines using for.
You'll want to put a command into an array to handle non-trivial arguments (such as those containing whitespace).

edited Oct 6, 2020 at 20:12

answered Oct 6, 2020 at 20:02

l0b0

59.7k32 gold badges155 silver badges248 bronze badges

Sign up to request clarification or add additional context in comments.

Comments

Paul Hodges · Accepted Answer · 2020-10-06 20:14:54Z

0

Try setting a trap.

$:  cat x
trap 'echo "$BASH_COMMAND">>errs' ERR
echo 1 2 3 4
bogus 5 6 7 8
true this one
false this one
$: ./x
1 2 3 4
bash: bogus: command not found
$: cat errs
bogus 5 6 7 8
false this one
./x

errs is now the list of the ones that failed. grep -vf errs x to get the ones that succeeded. (Will include the trap.)

answered Oct 6, 2020 at 20:14

Paul Hodges

16.1k1 gold badge24 silver badges43 bronze badges

Collectives™ on Stack Overflow

Running curl commads in a loop while reading from a file in bash

2 Answers 2

Comments

Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

2 Answers 2

Comments

Comments

Your Answer

Sign up or log in

Post as a guest

Related