elasticsearch delete by query not release disk space

Question

I delete ElasticSearch(elasticsearch-7.2.0) document using:

curl -H'Content-Type:application/json' -d'{
    "query": {
        "range": {
            "@timestamp": {
                "lt": "now-40d",
                "format": "epoch_millis"
            }
        }
    }
}
' -XPOST "http://127.0.0.1:9200/*-*/_delete_by_query?pretty"

this is the result:

{
  "took" : 55500,
  "timed_out" : false,
  "total" : 16710000,
  "deleted" : 16710000,
  "batches" : 20000,
  "version_conflicts" : 0,
  "noops" : 0,
  "retries" : {
    "bulk" : 0,
    "search" : 0
  },
  "throttled_millis" : 0,
  "requests_per_second" : -1.0,
  "throttled_until_millis" : 0,
  "failures" : [ ]
}

but when I check the disk usage:

du -sh /data/docker/efk/elasticsearch-7.2.0/data/nodes/0

the disk space did not released.What should I do to make disk space release?

hamid bayat · Accepted Answer · 2019-09-01 11:50:39Z

3

elastic just mark documents as deleted and will free it when a merge process happen.

You can use forecemerge API for freeing the disk. https://www.elastic.co/guide/en/elasticsearch/reference/current/indices-forcemerge.html

but you should consider that when you use this command automatic merge and automatic freeing the disk will be disabled for that index.

there is sample command that can solve your problem:

curl  -H'Content-Type:application/json' -XPOST 127.0.0.1:9200/AN-INDEX-NAME/_forcemerge?max_num_segments=1

the merge process is resource killer and you should do it against indices one per time.

answered Sep 1, 2019 at 11:50

hamid bayat

2,21914 silver badges21 bronze badges

Sign up to request clarification or add additional context in comments.

Collectives™ on Stack Overflow

elasticsearch delete by query not release disk space

1 Answer 1

Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

Comments

Your Answer

Sign up or log in

Post as a guest

Related