0

I have a tricky one, I am trying to scrape data from http://www.vafinancials.com/v5/plugins/quick_stats.php?id=25129.

I was able to do this for another website where I pulled the page source and parsed the source for the data I was looking for. However with this site I can't seem to find any way of scraping the relevant data.

So I am curious how would one scrape data on such a site where jQuery seems to be generating the result behind closed doors.

Anyone have any ideas?

2
  • Which data do you want? Commented Sep 22, 2015 at 5:18
  • @intboolstring I am trying to get only the numeric values. I could careless about the names. Commented Sep 22, 2015 at 6:25

1 Answer 1

2

Use Firebug or the integrated developer tools of your browser to see what's going on with the requests and responses of the page.

In your case there is an ajax call fetching the data: Firebug Parameter

The response is XML: Firebug Response

I would use this URL to fetch the data.

Sign up to request clarification or add additional context in comments.

3 Comments

You say I should use "This URL" to fetch data. Which URL are you referring to? The XML one in the screenshot? Do you happen to have a direct link to that. I'm sure I can do it myself but just in case.
Yes, the one in the screenshot: vafinancials.com/v5/plugins/app/… But you should figure out if the "key" parameter could change.
Awesome Christoph, let me give this a try! I would upvote this but I don't have 15 rank yet.

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge you have read our privacy policy.

Start asking to get answers

Find the answer to your question by asking.

Ask question

Explore related questions

See similar questions with these tags.