How to parse JavaScript using Nokogiri and Ruby

Question

I need to parse an array out of a website. The part of the JavaScript I want to parse looks like this:

_arPic[0] = "http://example.org/image1.jpg";
_arPic[1] = "http://example.org/image2.jpg";
_arPic[2] = "http://example.org/image3.jpg";
_arPic[3] = "http://example.org/image4.jpg";
_arPic[4] = "http://example.org/image5.jpg";
_arPic[5] = "http://example.org/image6.jpg";

I get the whole JavaScript using something like this:

product_page = Nokogiri::HTML(open(full_url))    
product_page.css("div#main_column script")[0]

Is there an easy way to parse all the variables?

the Tin Man · Accepted Answer · 2013-01-23 02:56:50Z

2

If I read you correctly you're trying to parse the JavaScript and get a Ruby array with your image URLs yes?

Nokogiri only parses HTML/XML so you're going to need a different library; A cursory search turns up the RKelly library which has a parse function that takes a JavaScript string and returns a parse tree.

Once you have a parse tree you're going to need to traverse it and find the nodes of interest by name (e.g. _arPic) then get the string content on the other side of the assignment.

Alternatively, if it doesn't have to be too robust (and it wouldn't be) you can just use a regex to search the JavaScript if possible:

/^\s*_arPic\[\d\] = "(.+)";$/

might be a good starter regex.

edited Jan 23, 2013 at 2:56

the Tin Man

161k44 gold badges222 silver badges308 bronze badges

answered Jan 22, 2013 at 15:36

Ron Warholic

10.1k34 silver badges47 bronze badges

Sign up to request clarification or add additional context in comments.

Comments

pguardiario · Accepted Answer · 2013-01-23 01:36:08Z

0

The easy way:

_arPic = URI.extract product_page.css("div#main_column script")[0].text

which can be shortened to:

_arPic = URI.extract product_page.at("div#main_column script").text

answered Jan 23, 2013 at 1:36

pguardiario

55.2k21 gold badges130 silver badges169 bronze badges

Collectives™ on Stack Overflow

How to parse JavaScript using Nokogiri and Ruby

2 Answers 2

Comments

Comments

Your Answer

Linked

Hot Network Questions

Collectives™ on Stack Overflow

2 Answers 2

Comments

Comments

Your Answer

Sign up or log in

Post as a guest

Linked

Related