How do I sort these values using Bash Script in Linux?

Question

In the above you will see that at -61 occurs twice and so do some other values. I want to just create a new file without any duplicates. So the new file should have either -61 35 or -61 36 ...

How do I do that?! I tried using sort using uniq but that didn't work.

Mike Clark · Accepted Answer · 2012-05-07 18:02:14Z

5

Assuming your data is in a file called input

cat input | sort -u -n

When doing a numeric (-n) sort along with unique (-u), the duplicate checking is achieved.

answered May 7, 2012 at 18:02

Mike Clark

12k6 gold badges42 silver badges43 bronze badges

Sign up to request clarification or add additional context in comments.

3 Comments

glenn jackman Over a year ago

No need for cat: sort -nu input

Tim Pote Over a year ago

Useless Use of Cat. Otherwise, this is definitely my preferred solution.

Mike Clark Over a year ago

I do agree the use of cat is unnecessary here. In this case I was using it as an illustration of getting the data into the sort command. In practice I would advocate simply piping the output of whatever process generates this list into the sort command. I will make that clearer in the future.

thiton · Accepted Answer · 2012-05-07 18:01:15Z

4

If you can guarantee the length of the first field,

sort | uniq --check-chars=4

will do the trick.

Otherwise, try awk:

awk '{ if (FNR == 1 || last != $1) print; last = $1; }'

answered May 7, 2012 at 18:01

thiton

36.1k4 gold badges74 silver badges104 bronze badges

Collectives™ on Stack Overflow

How do I sort these values using Bash Script in Linux?

2 Answers 2

3 Comments

Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

2 Answers 2

3 Comments

Comments

Your Answer

Sign up or log in

Post as a guest

Related