optimize sed command for better performance

Question

I have got the following lines in a file:

1231231213123123123|W3A|{ (ABCDE)="8=3AF.R.Y2=133AA=9WW=334MNFN=20120925-22:23:59.998
1231231213123123123|4GM|{ (ABCDE)="8=3AF.R.Y2=123AA=9WW=4AF013DCV=EXAMPLE=ABC
1231231213123123123|KYC|{ (ABCDE)="8=3AF.R.Y2=112AA=9WW=0002DDS=20120921-14:55:21

In order to get the value between '|' characters I am using:

sed -e 's/\(^.*|\)\(.*\)\(|.*$\)/\2/'

And output is:

W3A
4GM
KYC

Which is expected. But as file has thousands of records, sed command is taking a lot of time. Is there any way to improve the performance of this command?

You could try awk, with awk -F'|' '{print $2}' yourFile

Mark Setchell
– Mark Setchell

2016-02-04 18:52:41 +00:00
Commented Feb 4, 2016 at 18:52 — Mark Setchell
– Mark Setchell, Commented Feb 4, 2016 at 18:52

Tom Fenech · Accepted Answer · 2016-02-04 17:07:19Z

4

Seems to me like you just want to use cut:

cut -d '|' -f 2 file

Set the delimiter to | and print the second field.

answered Feb 4, 2016 at 17:07

Tom Fenech

75.1k13 gold badges119 silver badges154 bronze badges

Sign up to request clarification or add additional context in comments.

Comments

glenn jackman · Accepted Answer · 2016-02-04 17:09:39Z

1

Since you're only keeping the 2nd parenthesized groups, you're making sed do unnecessary work by remembering the other stuff. Try

sed -e 's/^[^|]*|\([^|]*\)|.*/\1/'

Tom Fenech's answer should be a lot faster though.

answered Feb 4, 2016 at 17:09

glenn jackman

249k42 gold badges233 silver badges362 bronze badges

Collectives™ on Stack Overflow

optimize sed command for better performance

2 Answers 2

Comments

Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

2 Answers 2

Comments

Comments

Your Answer

Sign up or log in

Post as a guest

Related