repositoryhttps://www.elastic.co/guide/en/elasticsearch/client/curator/current/yum-repository.html2、安装elasticsearch-curator 这里采用pip安装pip install elasticsearch-curator图片curator --versioncurator, version 5.8.4四、curator_cli 命令行工具使用查看集群索引 forcemerge前图片forcemerge后图片可以清晰看到doc.deleted碎片有所下降六、使用crontab定期执行curator6 0 * * * curator --config /data/elasticsearch-curator /config.yml /data/elasticsearch-curator/action.yml
Step1:安装: 1pip install elasticsearch-curator centos6/7用户更简洁: 1yum install elasticsearch-curator Step 2:升级至最新版本(非必须,根据自己需要): 1pip install -U elasticsearch-curator 验证执行成功方法1: 1curator_cli show_indices 若成功
5、pip install 安装docker-compose或elasticsearch-curator因网络问题失败。 这个问题本人曾经尝试用清华源来解决,结果失败了。清华源中没有这两个包。 解决方法:运行install.sh前先安装好docker-compose和elasticsearch-curator ? 如果网络实在太差,无法下载,下载安装包进行安装: ? git链接如下:https://github.com/Panjks/t-pot-autoinstall 由于elasticsearch-curator的whl文件找不到了,所以提供了库的源代码。
地址:https://github.com/taskrabbit/elasticsearch-dump 2.4 集群数据处理工具 9、elasticsearch-curator elasticsearch 地址:https://pypi.python.org/pypi/elasticsearch-curator 另外 ES6.3(还未上线) 有一个 Index LifeCycle Management
last_month中删除60天以前的索引 curator alias --unalias-older-than 60 --alias last_month 安装Curator pip install elasticsearch-curator
使用 安装条件:CVM云主机 腾讯ES集群(也可以自己搭建虚拟环境) CVM与ES同在一个VPC 第一步:在CVM上,通过 pip 安装 curator 包 使用命令:pip install elasticsearch-curator distutils installed project and thus we cannot accurat” image.png 解决办法:执行这条命令添加参数: sudo pip install elasticsearch-curator
notification-tenant-sidecar:v3.2.0 ##kubesphere-logging-images docker pull registry.cn-beijing.aliyuncs.com/kubesphereio/elasticsearch-curator notification-tenant-sidecar:v3.2.0 ##kubesphere-logging-images docker tag registry.cn-beijing.aliyuncs.com/kubesphereio/elasticsearch-curator :v5.7.6 $HarborAddr/elasticsearch-curator:v5.7.6 docker tag registry.cn-beijing.aliyuncs.com/kubesphereio HarborAddr/notification-manager:v1.4.0 $HarborAddr/notification-tenant-sidecar:v3.2.0 $HarborAddr/elasticsearch-curator HarborAddr/notification-tenant-sidecar:v3.2.0 ##kubesphere-logging-images docker push $HarborAddr/elasticsearch-curator
float" } } } # 启动 logstash $ cd /data/ELKStack/logstash $ docker-compose up -d elasticsearch 索引定时清理 elasticsearch-curator gpgcheck=1 gpgkey=https://packages.elastic.co/GPG-KEY-elasticsearch enabled=1 # 安装 curator $ yum install elasticsearch-curator
还原快照还原快照 使用方法 安装 pip install elasticsearch-curator 命令行下单次执行 curator_cli --host 127.0.0.1 --port 9200
1C:\Program Files\elasticsearch-curator>curator.exe --config .\conf\curator.yml .
定期清理(elasticsearch-curator) 我们使用的方式非常的暴力,没有做太多的索引优化,elasticsearch的全文索引内存消耗爆炸高。 所以用了个官方的工具 elasticsearch-curator 来定期清理掉不再需要的日志,具体使用可以见官方文档,我这里设置了清理30天以上的条目。
dockerhub.kubekey.local/kubesphereio/k8s-dns-node-cache:1.15.12 docker push dockerhub.kubekey.local/kubesphereio/elasticsearch-curator
centos/7 gpgcheck=1 gpgkey=https://packages.elastic.co/GPG-KEY-elasticsearch enabled=1 $ yum install elasticsearch-curator
v0.18.0 grafana/grafana:7.4.3 ##kubesphere-logging-images kubesphere/elasticsearch-oss:6.7.0-1 kubesphere/elasticsearch-curator
registry.cn-beijing.aliyuncs.com/kubesphereio/notification-tenant-sidecar:v3.2.0 - registry.cn-beijing.aliyuncs.com/kubesphereio/elasticsearch-curator
registry.cn-beijing.aliyuncs.com/kubesphereio/notification-tenant-sidecar:v3.2.0 - registry.cn-beijing.aliyuncs.com/kubesphereio/elasticsearch-curator