Python regexp to get url without http or www

Question

How can I get only site.com from search results using python to get insights about words in google seach ?

from xgoogle.search import GoogleSearch, SearchError
try:
  page = 1
  gs = GoogleSearch("#hashtag insights")
  gs.results_per_page = 100
  results = []
  while True:
    tmp = gs.get_results()
    if not tmp: # no more results were found
      break
    results.extend(tmp)
  # ... do something with all the results ...
except SearchError, e:
  print "Search failed: %s" % e

for res in results:
    print res.url

@sshashank124 No , I am newbie in Python so I am figuring out how to implement the answers into the code I found but no luck till now — MTALY
– MTALY, Commented Apr 18, 2014 at 17:09

Pedro Lobito · Accepted Answer · 2014-04-18 16:13:59Z

2

You don't need a regex for that, use urlparse

hostname = urlparse.urlparse("http://www.techcrunch.com/").hostname

http://docs.python.org/library/urlparse.html

answered Apr 18, 2014 at 16:13

Pedro Lobito

99.8k36 gold badges274 silver badges278 bronze badges

Sign up to request clarification or add additional context in comments.

Comments

sshashank124 · Accepted Answer · 2014-04-18 16:11:19Z

0

Try it with regex as follows:

import re
s = 'http://www.google.com'

>>> print re.search(r'^https?:\/\/www\.(.*)$', s).group(1)
google.com

If you have a more general site, you can do:

import re
s = 'http://username.blogspot.com'

>>> print re.search(r'^https?:\/\/[^.]*.(.*)$', s).group(1)
blogspot.com

answered Apr 18, 2014 at 16:11

sshashank124

32.3k10 gold badges72 silver badges76 bronze badges

Collectives™ on Stack Overflow

Python regexp to get url without http or www

2 Answers 2

Comments

Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

2 Answers 2

Comments

Comments

Your Answer

Sign up or log in

Post as a guest

Related