Nested Loop using apply functions in R

Question

I have the following function to get some urls from a website using RSelinium and phantomjs.

get_url <- function(url){
  rdr$navigate(url)
  li <- rdr$findElements(using = 'xpath',  "//div[@data-id]")
  str <- sapply(li, function(x){x$getElementAttribute('outerHTML')})
  if(length(str)>1){
  tree <- htmlParse(str)
  url <- getNodeSet(tree, '//div//a[@class="link url"]')
  url <- sapply(url, xmlGetAttr, 'href')
  }
}

And the url is stored in a 30 x 60 matrix.

I tried doing this using the following nested loop.

for(i in 1:ncol(offset_url)){
  for(j in 1:nrow(offset_url)){
    url_list <- rbind(url_list,get_url(offset_url[j,i]))
  }
}

However, it takes a lot of time to execute.

Is there a way that I can use apply functions to rduce the time?

There a a number of syntactic issues with posted code which you might be throwing together as an example. Can you post actual code? — Parfait
– Parfait, Commented Jul 27, 2016 at 3:26

user2100721 · Accepted Answer · 2016-07-28 13:39:14Z

1

Is this helpful?

do.call(rbind,list(mapply(function(x,y) get_url(offset_url[x,y]),x=row(offset_url),y=col(offset_url))))

answered Jul 28, 2016 at 13:39

user2100721

3,5972 gold badges22 silver badges30 bronze badges

Sign up to request clarification or add additional context in comments.

Collectives™ on Stack Overflow

Nested Loop using apply functions in R

1 Answer 1

Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

Comments

Your Answer

Sign up or log in

Post as a guest

Related