Elasticsearch: ILM的自动删除不起作用

Question

我想在一定时间后(比如10s)删除一个索引，但它不起作用。我做了很多研究，但找不到和我吐露的东西不同的东西。以下是我的心声：

我的ILM配置：

{
  "policy": {
    "phases": {
      "hot": {
        "min_age": "0ms",
        "actions": {
          "set_priority": {
            "priority": 100
          }
        }
      },
      "delete": {
        "min_age": "10s",
        "actions": {
          "delete": {}
        }
      }
    }
  }
}

我的模板：

{
  "order": 0,
  "index_patterns": ["myindex.*"],
  "settings": {
    "index": {
      "lifecycle": {
        "name": "myindex"
      }
    }
  }
}

我的索引：

{
  "job_id": 1,
  "message": "sample data",
  "@timestamp": "DATETIME"
}

然后使用下面的脚本测试我的场景：

#!/bin/bash                                                                                                                                                                            
NAME=myindex

# Add ILM and template.                                                                                                                                                                
echo -n "Add policy..."
http PUT http://localhost:9200/_ilm/policy/"${NAME}" < ilm.json                                                 
echo -n "Add template..."
http PUT http://localhost:9200/_template/"${NAME}" < template.json 

# Create index.                                                                                                                                                                        
echo -n "Create index..."
http PUT http://localhost:9200/"${NAME}" | jq '.acknowledged'

# List of data stream and indices.                                                                                                                                                     
echo -n "List of data stream..."
http http://localhost:9200/_data_stream/ | jq '.data_streams'
echo "List of indices..."
http http://localhost:9200/_cat/indices/ | awk '{print $3}'

echo "Index ILM explain..."
http http://localhost:9200/"${NAME}"/_ilm/explain

# Insert a document.                                                                                                                                                                   
echo -n "Insert a document..."
sed "s/DATETIME/$(date +%Y-%m-%dT%H:%M:%S)/g" < index.json | http POST http://localhost:9200/"${NAME}"/_doc | jq -r ".result"

# Wait until it reaches the TTL.                                                                                                                                                       
echo "Waiting to reach the TTL..."
sleep 10 # "$(( $(jq -r .policy.phases.delete.min_age < ilm.json | sed 's/s//g') + 2 ))"                                                                                               

# Search for the data and expected to find nothing.                                                                                                                                    
echo "Search the inserted document..."
echo '{"query": {"match": {"job_id": 1}}}' | http http://localhost:9200/"${NAME}"/_search

在最后一部分，当我搜索索引时，我可以找到它。索引仍然存在！

Answer 1

我设置了indices.lifecycle.poll_interval，它起作用了！

PUT /_cluster/settings
{
    "persistent" : {
        "indices.lifecycle.poll_interval": "5s"
    }
}

参考文献：

• https://discuss.elastic.co/t/index-lifecycle-management-at-elasticsearch-6-6-0/168429/2
• https://stackoverflow.com/a/66138564/4604579