Sum-aggregation script for term frequencies without dynamic scripting

Question

I try to evaluate a web-application for my masterthesis. For this I want to make a user study, where I prepare the data in elasitc found, and send my web application to the testers. As far as I know, elastic found does not allow dynamic scripting for security reasons. I try to refomulate the following dynamic script query:

GET my_index/document/_search
{
  "query": {
    "match_all":{}
  },
  "aggs": {
    "stadt": {
      "sum": {
        "script": "_index['textBody']['frankfurt'].tf()"
      }
    }
  }  
}

This query sums up all term frequencies in the document field textBody for the term frankfurt.

In order to reformulate the query without dynamic scripting, I've taken a look on groovy scripts without dynamic scripting, but I still get parsing errors.

My approach to this was:

GET my_index/document/_search
{
  "query": {
    "match_all":{}
  },
  "aggs": {
    "stadt": {
      "sum": {
        "script": {
            "script_id": "termFrequency",
            "lang" : "groovy",
            "params": {
              "term" : "frankfurt"
            }
        }        
      }
    }
  }  
}

and the file termFrequency.groovy in the scripts directory:

_index['textBody'][term].tf()

I get the following parsing error:

Parse Failure [Unexpected token START_OBJECT in [stadt].]

What version of ES you are using?

ChintanShah25
– ChintanShah25

2015-11-28 14:39:01 +00:00
Commented Nov 28, 2015 at 14:39 — ChintanShah25
– ChintanShah25, Commented Nov 28, 2015 at 14:39

ChintanShah25 · Accepted Answer · 2015-11-28 14:38:00Z

1

This is the correct syntax assuming your file is inside config/scripts directory.

{
  "query": {
    "match_all": {}
  },
  "aggs": {
    "stadt": {
      "sum": {
        "script_file": "termFrequency",
        "lang": "groovy",
        "params": {
          "term": "frankfurt"
        }
      }
    }
  },
  "size": 0
}

Also the term should be variable rather than string so it should be

_index['textBody'][term].tf()

Hope this helps!

answered Nov 28, 2015 at 14:38

ChintanShah25

12.7k3 gold badges45 silver badges44 bronze badges

Sign up to request clarification or add additional context in comments.

Collectives™ on Stack Overflow

Sum-aggregation script for term frequencies without dynamic scripting

1 Answer 1

Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

Comments

Your Answer

Sign up or log in

Post as a guest

Related