Remove non-ascii characters from a variable in shell script

Question

I am grep'ing the output of a command inside shell script and store the result in a variable.

There is a very corner case where this variable might have non-ascii characters because of parse logic used by grep.

Question: How do I remove these non-ascii characters from this variable inside the shell script, so that I can use the variable in the subsequent commands?

gniourf_gniourf · Accepted Answer · 2012-12-20 18:24:49Z

10

If you're using bash, and if your variable is called var, then

"${var//[^[:ascii:]]/}"

will expand to var with all non-ascii characters removed. So:

var_non_ascii=${var//[^[:ascii:]]/}

should do. (This is definitely the best method: no sub-shells and no forks to external processes to bash).

answered Dec 20, 2012 at 18:24

gniourf_gniourf

47.4k10 gold badges105 silver badges113 bronze badges

Sign up to request clarification or add additional context in comments.

Comments

Guru · Accepted Answer · 2012-12-20 17:10:51Z

4

Assuming your variable is var, try this:

var=$(echo $var | sed 's/[^\x00-\x7F]//g')

This should remove the non-ascii characters

answered Dec 20, 2012 at 17:10

Guru

17.1k2 gold badges37 silver badges47 bronze badges

1 Comment

Sudar Over a year ago

I am selecting the other answer since that doesn't involve an external process. Upvoted though :)

Collectives™ on Stack Overflow

Remove non-ascii characters from a variable in shell script

2 Answers 2

Comments

1 Comment

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

2 Answers 2

Comments

1 Comment

Your Answer

Sign up or log in

Post as a guest

Related