error while parsing url using python

Question

I am working on a url using python.
If I click the url, I am able to get the excel file.
but If I run following code, it gives me weird output.

>>> import urllib2
>>> urllib2.urlopen('http://intranet.stats.gov.my/trade/download.php?id=4&var=2012/2012%20MALAYSIA%27S%20EXPORTS%20BY%20ECONOMIC%20GROUPING.xls').read()

output :

"<script language=javascript>window.location='2012/2012 MALAYSIA\\'S EXPORTS BY ECONOMIC GROUPING.xls'</script>"

why its not able to read content with urllib2?

itayw · Accepted Answer · 2012-05-01 10:53:07Z

1

Take a look using an http listener (or even Google Chrome Developer Tools), there's a redirect using javascript when you get to the page.

You will need to access the initial url, parse the result and fetch again the actual url.

answered May 1, 2012 at 10:53

itayw

6149 silver badges20 bronze badges

Sign up to request clarification or add additional context in comments.

Comments

Community · Accepted Answer · 2017-05-23 10:34:42Z

1

@Kai in this question seems to have found an answer to javascript redirects using the module Selenium

from selenium import webdriver

driver = webdriver.Firefox()
link = "http://yourlink.com"
driver.get(link)

#this waits for the new page to load
while(link == driver.current_url):
  time.sleep(1)

redirected_url = driver.current_url

edited May 23, 2017 at 10:34

CommunityBot

11 silver badge

answered May 1, 2012 at 11:01

Nolen Royalty

18.7k4 gold badges43 silver badges51 bronze badges

Collectives™ on Stack Overflow

error while parsing url using python

2 Answers 2

Comments

Comments

Your Answer

Linked

Hot Network Questions

Collectives™ on Stack Overflow

2 Answers 2

Comments

Comments

Your Answer

Sign up or log in

Post as a guest

Linked

Related