Javascript API to screen scrape page flow, including button click

Question

We are looking for Javascript API to screen scrape page flow, including button click. If it were on server side, WebDriver of Selenium would have been a great choice, but we want the screen scraping to run on the client browser. The screens to be scrapped is a transaction in itself (login to third party website, transaction step 1, step 2 and then final confirmation). Any javascript API available?

AFAIK, both nodeJS and phantom JS don't have capability to click a button from the scrapped page.

thanks in advance, abbas

Sebastian Golasch · Accepted Answer · 2014-06-18 14:10:15Z

1

Webdriver is an HTTP based protocol, something that every browser speaks, so it is possible to control one browser from another. I've written a tutorial some weeks ago on that topic here

answered Jun 18, 2014 at 14:10

Sebastian Golasch

6864 silver badges6 bronze badges

Sign up to request clarification or add additional context in comments.

Comments

Catalyst · Accepted Answer · 2014-06-18 05:23:12Z

0

I recently ran into DalekJS (http://dalekjs.com/docs/actions.html) which allows for taking screenshots of pages and clicking on the elements as well. I think it even supports multiple browsers -- although they have to be installed (http://dalekjs.com/pages/documentation.html#browsers).

here is the sample code directly from the link:

 test.open('http://doctorwhotv.co.uk/')
 .assert.text('#nav').is('Navigation')
 .assert.visible('#nav')
 .assert.attr('#nav', 'data-nav', 'true')
 .click('#nav')
 .done();

answered Jun 18, 2014 at 5:23

Catalyst

3,23720 silver badges21 bronze badges

2 Comments

contactabbas Over a year ago

But the problem with Dalekjs is that it needs to run with a dalek framework. We require some tool (eg. js file) that we can bundle inside our webpage and runs in the browser.

Catalyst Over a year ago

I'm not sure then. I'll look harder when I get the chance.

Collectives™ on Stack Overflow

Javascript API to screen scrape page flow, including button click

2 Answers 2

Comments

2 Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

2 Answers 2

Comments

2 Comments

Your Answer

Sign up or log in

Post as a guest

Related