Strip only domain name out of input url string

Question

Did a bit of searching already but cannot seem to find an elegant way of doing this. I'd like to be able to search through a list like below and only end up with a plain text output file containing on the domain name, no http:// or anything after the /

So a list like this:

http://7wind.ru/file/Behind+the+dune/
http://aldersgatencsc.org/open.php?utm_source=5r2ke0ow6k&utm_medium=qqod2h9a88&utm_campaign=2d1hl1v8c5&utm_term=mz34ligqc4&utm_content=bgi71kl5oy
http://amunow.org/test.php?utm_source=5r2ke0ow6k&utm_medium=qqod2h9a88&utm_campaign=2d1hl1v8c5&utm_term=dhxg1r4l76&utm_content=tr71txtklp

I want to end up with plain text output file like this.

7wind.ru
aldersgatencsc.org
amunow.org

dawg · Accepted Answer · 2017-07-13 15:28:24Z

3

Given:

$ echo "$txt"
http://7wind.ru/file/Behind+the+dune/
http://aldersgatencsc.org/open.php?utm_source=5r2ke0ow6k&utm_medium=qqod2h9a88&utm_campaign=2d1hl1v8c5&utm_term=mz34ligqc4&utm_content=bgi71kl5oy
http://amunow.org/test.php?utm_source=5r2ke0ow6k&utm_medium=qqod2h9a88&utm_campaign=2d1hl1v8c5&utm_term=dhxg1r4l76&utm_content=tr71txtklp

You can use cut:

$ echo "$txt" | cut -d'/' -f3
7wind.ru
aldersgatencsc.org
amunow.org

Or, if your content is in a file:

$ cut -d'/' -f3 file
7wind.ru
aldersgatencsc.org
amunow.org

Then redirect that to the file you want:

$ cut -d'/' -f3 file >new_file

answered Jul 13, 2017 at 15:28

dawg

105k24 gold badges143 silver badges217 bronze badges

Sign up to request clarification or add additional context in comments.

1 Comment

MitchellK Over a year ago

Thanks this works great and it's short and to the point. Much obliged.

Raman Sailopal · Accepted Answer · 2017-07-13 15:20:55Z

1

awk -F \/ '{ print $3 }' outputfile > newfile

Print the 3rd field delimited by /

answered Jul 13, 2017 at 15:20

Raman Sailopal

13k2 gold badges15 silver badges21 bronze badges

Comments

CWLiu · Accepted Answer · 2017-07-14 03:27:15Z

1

$ sed -r 's#.*//([^/]*)/.*#\1#' Input_file
7wind.ru
aldersgatencsc.org
amunow.org

answered Jul 14, 2017 at 3:27

CWLiu

4,0531 gold badge13 silver badges14 bronze badges

Comments

RavinderSingh13 · Accepted Answer · 2017-07-13 15:24:33Z

0

try following awks.

Solution 1st:

awk '{sub(/.*\/\//,"");sub(/\/.*/,"");print}'   Input_file

Solution 2nd:

awk '{match($0,/\/.[^/]*/);print substr($0,RSTART+2,RLENGTH-2)}'   Input_file

answered Jul 13, 2017 at 15:24

RavinderSingh13

135k14 gold badges61 silver badges100 bronze badges

Comments

Randy Morris · Accepted Answer · 2017-07-13 15:25:31Z

0

This works by stripping the protocol and :// first, then anything after and including the next slash.

sed "s|.*://||; s|/.*||" url-list.txt

Add -i to change the file directly.

answered Jul 13, 2017 at 15:25

Randy Morris

41.3k8 gold badges73 silver badges80 bronze badges

Comments

Mohsen · Accepted Answer · 2017-07-13 15:28:10Z

0

try this regexp

((http|https):\/\/)?([a-zA-Z\.]+)(\/)?

first match, 3th group but it may validate invalid url too! be careful

answered Jul 13, 2017 at 15:28

Mohsen

3073 silver badges15 bronze badges

Collectives™ on Stack Overflow

Strip only domain name out of input url string

6 Answers 6

1 Comment

Comments

Comments

Comments

Comments

Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

6 Answers 6

1 Comment

Comments

Comments

Comments

Comments

Comments

Your Answer

Sign up or log in

Post as a guest

Related