Elasticsearch custom scoring script -- check if field exists?

Question

I'd like check if a field exists in my custom scoring script when searching in elasticsearch.

This search works:

{
  "query": {
    "custom_score": {
      "script": "((doc['region'].value == '1') ? 1 : 0)",
      "query": {
        "constant_score": {
          "filter": {
            "and": [
              {
                "term": {
                  "id": "100"
                }
              }
            ]
          }
        }
      }
    }
  },
  "size": 1
}

It will score the result as 1 if the region field value is 1.

However this query will not work: it will not score the document as 1 if the region field does not exist in the document:

{
  "query": {
    "custom_score": {
      "script": "((doc['region'].value == null) ? 1 : 0)",
      "query": {
        "constant_score": {
          "filter": {
            "and": [
              {
                "term": {
                  "id": "100"
                }
              }
            ]
          }
        }
      }
    }
  },
  "size": 1
}

How do I check for missing values in a script?

imotov · Accepted Answer · 2012-10-29 11:17:51Z

14

If this field has a numeric type, which includes dates that are indexed as long, the missing value is represented by 0.

edited Oct 29, 2012 at 11:17

answered Oct 26, 2012 at 20:37

imotov

30.2k3 gold badges93 silver badges87 bronze badges

Sign up to request clarification or add additional context in comments.

2 Comments

user697547 Over a year ago

Unfortunately the field is a date type.

bradvido Over a year ago

What if the field has a legitimate value of 0?

Evan Kleiner · Accepted Answer · 2022-08-18 20:47:06Z

This post addresses a similar issue. Long story short, you should use doc['fieldName'].size() == 0 to check if a field exists in an Elasticsearch script. Here's an example implementation that I have working to apply a Gaussian function to a date field only when that field is populated:

GET /items/_search
{
    "size": 10,
    "from": 0,
    "query": {
        "function_score": {
            "_name": "favorNewItems",
            "query": {
                "bool": {
                    "must": [
                        "match": {"color": "blue"}
                    ]
                }
            },
            "functions": [
                {
                    "gauss": {
                        "firstReceivedDate": {
                            "origin": "now",
                            "scale": "180d"
                        }
                    },
                    "weight": 2
                },
                {
                    "script_score": {
                        "script": "if (doc['publishDate'].size() == 0) return 0; return 1;"
                    }
                }
            ],
            "score_mode": "multiply",
            "boost_mode": "sum"
        }
    }
}

Collectives™ on Stack Overflow

Elasticsearch custom scoring script -- check if field exists?

2 Answers 2

2 Comments

Comments

Your Answer

Linked

Hot Network Questions

Collectives™ on Stack Overflow

2 Answers 2

2 Comments

Comments

Your Answer

Sign up or log in

Post as a guest

Linked

Related