Elasticsearch: How can I use dynamic templates, index objects with date ranges, and search with date-range queries?

Question

The following sequence of HTTP requests sent from Postman to an Elasticsearch 7.17.5 server yields two search hits corresponding to objects with dates 2022-07-27T00:00:00.000Z and 2022-07-28T23:59:59.999Z.

PUT http://localhost:9200/commit
{
    "mappings": {
        "properties": {
            "date": {
                "type": "date",
                "format": "uuuu-MM-dd[['T'][ ]HH:mm[:ss[.[SSS][SS][S]][,[SSS][SS][S]]]][XXXXX][XXXX][X]"
            }
        }
    }
}

PUT http://localhost:9200/commit/_doc/commit20220727?refresh
{
    "date": "2022-07-27T00:00:00.000Z"
}

PUT http://localhost:9200/commit/_doc/commit20220728?refresh
{
    "date": "2022-07-28T00:00:00.000Z"
}

POST http://localhost:9200/commit/_search
{
    "query" : {
        "range" : {
            "date" : { 
                "gte": "2022-07-27T00:00:00.000Z",
                "lte": "9999-12-31T23:59:59.999Z"
            }
        }
    }
}

DELETE http://localhost:9200/commit

Similarly, the following sequence of HTTP requests yields two search hits corresponding to objects with date ranges [2022-07-27T00:00:00.000Z TO 2022-07-27T23:59:59.999Z] and [2022-07-28T00:00:00.000Z TO 2022-07-28T23:59:59.999Z].

PUT http://localhost:9200/commit
{
    "mappings": {
        "properties": {
            "dateTimeRange": {
                "type": "date_range",
                "format": "uuuu-MM-dd[['T'][ ]HH:mm[:ss[.[SSS][SS][S]][,[SSS][SS][S]]]][XXXXX][XXXX][X]"
            }
        }
    }
}

PUT http://localhost:9200/commit/_doc/commit20220727?refresh
{
    "dateTimeRange": {
        "gte": "2022-07-27T00:00:00.000Z", 
        "lte": "2022-07-27T23:59:59.999Z"
    }
}

PUT http://localhost:9200/commit/_doc/commit20220728?refresh
{
    "dateTimeRange": {
        "gte": "2022-07-28T00:00:00.000Z", 
        "lte": "2022-07-28T23:59:59.999Z"
    }
}

Same search and delete requests

Similarly, the following sequence of HTTP requests yields two search hits corresponding to objects with dates 2022-07-27T00:00:00.000Z and 2022-07-28T23:59:59.999Z.

PUT http://localhost:9200/commit
{
    "mappings": {
        "dynamic_templates": [
            {
                "date": {
                    "match": "date_*",
                    "match_mapping_type": "string",
                    "mapping": {
                    "type": "date",
                    "format": "uuuu-MM-dd[['T'][ ]HH:mm[:ss[.[SSS][SS][S]][,[SSS][SS][S]]]][XXXXX][XXXX][X]"
                    }
                }
            }
        ]
    }
}

PUT http://localhost:9200/commit/_doc/commit20220727?refresh
{
    "date_/date": "2022-07-27T00:00:00.000Z"
}

PUT http://localhost:9200/commit/_doc/commit20220728?refresh
{
    "date_/date": "2022-07-28T00:00:00.000Z"
}

Same search and delete requests

But the following sequence of HTTP requests yields zero search hits.

PUT http://localhost:9200/commit
{
    "mappings": {
        "dynamic_templates": [
            {
                "date": {
                    "match": "date_*",
                    "match_mapping_type": "string",
                    "mapping": {
                        "type": "date_range",
                        "format": "uuuu-MM-dd[['T'][ ]HH:mm[:ss[.[SSS][SS][S]][,[SSS][SS][S]]]][XXXXX][XXXX][X]"
                    }
                }
            }
        ]
    }
}

PUT http://localhost:9200/commit/_doc/commit20220727?refresh
{
    "date_/date": {
        "gte": "2022-07-27T00:00:00.000Z", 
        "lte": "2022-07-27T23:59:59.999Z"
    }
}

PUT http://localhost:9200/commit/_doc/commit20220728?refresh
{
    "date_/date": {
        "gte": "2022-07-28T00:00:00.000Z", 
        "lte": "2022-07-28T23:59:59.999Z"
    }
}

Same search and delete requests

How can I use dynamic templates, index objects with date ranges, and search with date-range queries?

Tom Lever · Accepted Answer · 2022-08-03 19:03:56Z

1

The date dynamic template's match mapping type must be object, not string.

PUT http://localhost:9200/commit
{
    "mappings": {
        "dynamic_templates": [
            {
                "date": {
                    "match": "date_*",
                    "match_mapping_type": "object",
                    "mapping": {
                        "type": "date_range",
                        "format": "uuuu-MM-dd[['T'][ ]HH:mm[:ss[.[SSS][SS][S]][,[SSS][SS][S]]]][XXXXX][XXXX][X]"
                    }
                }
            }
        ]
    }
}

edited Aug 3, 2022 at 19:03

answered Aug 2, 2022 at 19:19

Tom Lever

4475 silver badges20 bronze badges

Sign up to request clarification or add additional context in comments.

Collectives™ on Stack Overflow

Elasticsearch: How can I use dynamic templates, index objects with date ranges, and search with date-range queries?

1 Answer 1

Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

Comments

Your Answer

Sign up or log in

Post as a guest

Related