Passing multiple arguments to data.table inside a function

Question

Here is the output that I want from data.table.

library(data.table)
dt_mtcars <- as.data.table(mtcars)

## desired output ----
dt_mtcars[mpg >20
          , .(mean_mpg = mean(mpg)
              ,median_mpg = median(mpg))
          , .(cyl, gear)]

   cyl gear mean_mpg median_mpg
1:   6    4   21.000      21.00
2:   4    4   26.925      25.85
3:   6    3   21.400      21.40
4:   4    3   21.500      21.50
5:   4    5   28.200      28.20

I want to get the output by passing arguments to a function.

processFUN <- function(dt, where, select, group){

  out <- dt[i=eval(parse(text = where))
            ,j=eval(parse(text = select))
            ,by=eval(parse(text = group))]

  return(out)
}

report <- processFUN(dt_mtcars 
                     ,where= "mpg > 20"
                     ,select= ".(mean_mpg = mean(mpg), median_mpg = median(mpg))"
                     ,group= ".(cyl, gear)")

However, I get an error message.

 Error in .(cyl, gear) : could not find function "."

For calls that aren't quoted strings, this link may be helpful stackoverflow.com/questions/57122960/… — Cole
– Cole, Commented Jul 29, 2019 at 12:04
If you prefer SQL syntax maybe use sqldf: sqldf("select cyl, gear, avg(mpg) mean_mpg, median(mpg) median_mpg from mtcars where mpg > 20 group by cyl, gear") — zx8754
– zx8754, Commented Jul 29, 2019 at 13:11

Alexis · Accepted Answer · 2019-07-29 13:26:53Z

4

Just to give you an alternative, if you can/want to use table.express, you can also use strings in many situations:

library(data.table)
library(table.express)

processFUN <- function(dt, where, select, group) {
  dt %>%
    start_expr %>%
    group_by(!!!group, .parse = TRUE) %>%
    where(!!!where, .parse = TRUE) %>%
    transmute(!!!select, .parse = TRUE) %>%
    end_expr
}

processFUN(as.data.table(mtcars),
           "mpg>20",
           c("mean_mpg = mean(mpg)", "median_mpg = median(mpg)"),
           c("cyl", "gear"))
   cyl gear     V1    V2
1:   6    4 21.000 21.00
2:   4    4 26.925 25.85
3:   6    3 21.400 21.40
4:   4    3 21.500 21.50
5:   4    5 28.200 28.20

In the next release, start_expr and end_expr will be optional.

answered Jul 29, 2019 at 13:26

Alexis

5,0991 gold badge22 silver badges40 bronze badges

Sign up to request clarification or add additional context in comments.

Comments

Ronak Shah · Accepted Answer · 2019-07-29 11:59:54Z

3

Do you really want to pass conditions as strings? If so, one way would be to construct the query together using paste and then use eval(parse... to evaluate it

library(data.table)

processFUN <- function(dt, where, select, group){
    eval(parse(text = paste0(as.character(substitute(dt)), "[", where, ",", 
               select, ",by = ", group, "]")))
}

processFUN(dt_mtcars 
          ,where= "mpg > 20"
          ,select= ".(mean_mpg = mean(mpg), median_mpg = median(mpg))"
          ,group= ".(cyl, gear)")


#   cyl gear mean_mpg median_mpg
#1:   6    4   21.000      21.00
#2:   4    4   26.925      25.85
#3:   6    3   21.400      21.40
#4:   4    3   21.500      21.50
#5:   4    5   28.200      28.20

answered Jul 29, 2019 at 11:59

Ronak Shah

391k20 gold badges173 silver badges237 bronze badges

2 Comments

William Chiu Over a year ago

Preferably, I would pass the expressions (rather than strings) into processFUN(). Is that possible?

Ronak Shah Over a year ago

@WilliamChiu yes, it should be possible with expressions as well.

chinsoon12 · Accepted Answer · 2019-08-01 00:16:50Z

1

Or using eval with substitute:

library(data.table) #Win R-3.5.1 x64 data.table_1.12.2
dt_mtcars <- as.data.table(mtcars)

processFUN <- function(dt, where, select, group) {

    out <- dt[i=eval(substitute(where)), 
        j=eval(substitute(select)), 
        by=eval(substitute(group))]

    return(out)
}

processFUN(dt_mtcars, mpg>20, .(mean_mpg=mean(mpg), median_mpg=median(mpg)), .(cyl, gear))

Some of the earliest references that I can find are

The old faq 1.6 contains reference to this: http://datatable.r-forge.r-project.org/datatable-faq.pdf

edited Aug 1, 2019 at 0:16

answered Jul 30, 2019 at 0:46

chinsoon12

25.2k4 gold badges27 silver badges35 bronze badges

1 Comment

Frank Over a year ago

Re "using it outside will not work" -- seems to be false. Actually it works fine in j, just not in by=. select = ".(mean_mpg = mean(mpg), median_mpg = median(mpg))"; dt_mtcars[, eval(parse(text = select))]

Collectives™ on Stack Overflow

Passing multiple arguments to data.table inside a function

3 Answers 3

Comments

2 Comments

1 Comment

Your Answer

Linked

Hot Network Questions

Collectives™ on Stack Overflow

3 Answers 3

Comments

2 Comments

1 Comment

Your Answer

Sign up or log in

Post as a guest

Linked

Related