grep multiple string from text file and export it to CSV

Question

i have shell script which is producing multiple output

for example

#/bin/bash
var1=`cat test.json | grep "test" | awk -F ' ' '{print $1}'`
var2=`cat test.json | grep -e "new" | awk -F ':' '{print$5}'`
var3=`cat test.json | grep -e "new-test" | awk -F ':' '{print$8}'`

echo $var1,var2,var3

output of the first var1 is

output of the first var2 is

output of the first var3 is

how do I create a csv file with the following format?

1,3,834
2,4,45
3,5,345
4,6,73
5,7,23

show the test.json using regex to parse json is not recommended. — Kent
– Kent, Commented Aug 14, 2018 at 14:13
Please replace cat foo | grep "bar" with grep "bar" foo. cat is for concatenation, not for printing. — fusiled
– fusiled, Commented Aug 14, 2018 at 14:14
Please avoid "Give me the codez" questions. Instead show the script you are working on and state where the problem is. Also see How much research effort is expected of Stack Overflow users? — jww
– jww, Commented Aug 15, 2018 at 1:47

glenn jackman · Accepted Answer · 2018-08-14 14:16:16Z

5

The paste command is what you want, together with bash process substitutions:

paste -d, <(echo "$var1") <(echo "$var2") <(echo "$var3")

1,3,834
2,4,45
3,5,345
4,6,73
5,7,23

Make sure you quote the variables to maintain the newlines therein.

Your pipelines can be simpler: cat is unneeded, and awk can do what grep does:

paste -d, \
    <(awk -F ' ' '/test/     {print $1}' test.json) \
    <(awk -F ':' '/new/      {print $5}' test.json) \
    <(awk -F ':' '/new-test/ {print $8}' test.json)

answered Aug 14, 2018 at 14:16

glenn jackman

249k42 gold badges233 silver badges363 bronze badges

Sign up to request clarification or add additional context in comments.

2 Comments

mahendra rathod Over a year ago

Giving me below error new1.sh: line 19: syntax error near unexpected token (' new1.sh: line 19: paste <(echo "$var1") <(echo "$var2") <(echo "$var3")'

glenn jackman Over a year ago

I'm specifically using bash syntax. Make sure your shebang line is #!/bin/bash and you are not invoking the script like sh myscript.sh but like bash myscript.sh

Collectives™ on Stack Overflow

grep multiple string from text file and export it to CSV

1 Answer 1

2 Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

2 Comments

Your Answer

Sign up or log in

Post as a guest

Related