elastic search highlight not working with filter query

Question

I can't get this to highlight for the life of me. It seems like elastic search is broken with regards to highlighting on fields that are mentioned in a filtered clause. The below query just does not highlight. Is this an issue with Elastic? What can I do to make this work?

    {
  "query": {
    "filtered": {
      "query": {
        "bool": {
          "must": [
            {
              "term": {
                "language": "Austrian"
              }
            }
          ]
        }
      },
      "filter": {
        "and": [
          {
            "query": {
              "query_string": {
                "fields": [
                  "standard_analyzed_name",
                  "standard_analyzed_message"
                ],
                "query": "Arnold AND Schwarz"
              }
            }
          }
        ]
      }
    }
  },
  "size": 20,
  "sort": [
    {
      "total_interactions": {
        "order": "desc"
      }
    }
  ],
  "highlight": {
    "fields": {
      "standard_analyzed_name": {
        "pre_tags": [
          "<strong>"
        ],
        "post_tags": [
          "</strong>"
        ],
        "fragment_size": 500,
        "number_of_fragments": 1
      },
      "standard_analyzed_message": {
        "pre_tags": [
          "<strong>"
        ],
        "post_tags": [
          "</strong>"
        ],
        "fragment_size": 500,
        "number_of_fragments": 1
      }
    }
  }
}

UPDATE

The above query does highlight in elastic search 2.0.0 - Yayyy

Can you share your mapping and some documents that might be helpful to reproduce your case? — Val
– Val, Commented Nov 12, 2015 at 3:29
Thanks, what about your mapping? curl -XGET localhost:9200/facebook_posts/_mapping/document — Val
– Val, Commented Nov 12, 2015 at 3:57
Here is the data: gist.githubusercontent.com/imtiazahmad007/8463cde239399a685f0d/… — Horse Voice
– Horse Voice, Commented Nov 12, 2015 at 14:21

Val · Accepted Answer · 2015-11-12 04:56:48Z

1

Well, simply put, you have your query and filter parts swapped. Your query_string should go inside the query part and the term should go inside the filter part, then all will be well and you'll see the highlighted fields.

{
   "query": {
      "filtered": {
         "query": {
            "query_string": {
               "fields": [
                  "standard_analyzed_name",
                  "standard_analyzed_message"
               ],
               "query": "arnold"
            }
         },
         "filter": {
            "term": {
               "language": "austrian"
            }
         }
      }
   },
   "size": 20,
   "sort": [
      {
         "total_interactions": {
            "order": "desc"
         }
      }
   ],
   "highlight": {
      "fields": {
         "standard_analyzed_name": {
            "pre_tags": [
               "<strong>"
            ],
            "post_tags": [
               "</strong>"
            ],
            "fragment_size": 500,
            "number_of_fragments": 3
         },
         "standard_analyzed_message": {
            "pre_tags": [
               "<strong>"
            ],
            "post_tags": [
               "</strong>"
            ],
            "fragment_size": 500,
            "number_of_fragments": 3
         }
      }
   }
}

answered Nov 12, 2015 at 4:56

Val

218k14 gold badges377 silver badges384 bronze badges

Sign up to request clarification or add additional context in comments.

19 Comments

Horse Voice Over a year ago

Thanks, but my query should have still worked. Highlight seems to be kind of picky.. Would you be able to elaborate on this a little further?

Horse Voice Over a year ago

That does not return any data.

Val Over a year ago

With arnold and austrian both in lowercase, I do get one result and one highlighted field: "I like <strong>Arnold</strong>"

Horse Voice Over a year ago

I modified my query. Notice the query": "Arnold AND Schwarz. Using the and keyword. This is a result of an API i'm writing for elastic. Does this query condition still work for you?

Val Over a year ago

If I'm not mistaken, there is no Schwarz in the document about Arnold that you shared earlier.

|

Collectives™ on Stack Overflow

elastic search highlight not working with filter query

1 Answer 1

19 Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

19 Comments

Your Answer

Sign up or log in

Post as a guest

Related