我有一个kuberenetes集群,我正在尝试从集群中的容器中收集日志。我正在使用Filebeat收集日志,并将其发送到elasctic搜索,然后在Kibana显示。我部署了Kibana和弹性搜索,它工作得很好。我正在使用DaemonSet来部署FileBeat。下面是我所引用的YAML文件,用于部署File节拍。我从这里开始使用清单文件来部署它,并对它做了一些修改。
https://www.elastic.co/guide/en/beats/filebeat/master/running-on-kubernetes.html
---
apiVersion: v1
kind: ConfigMap
metadata:
name: filebeat-config
namespace: kube-system
labels:
k8s-app: filebeat
data:
filebeat.yml: |-
filebeat.config:
inputs:
- type: log
# Mounted `filebeat-inputs` configmap:
paths: /var/lib/docker/containers/*/*.log
# Reload inputs configs as they change:
reload.enabled: false
json.message_key: log
json.keys_under_root: true
output.elasticsearch:
hosts: ['x.x.x.x:9200']
---
apiVersion: v1
kind: ConfigMap
metadata:
name: filebeat-inputs
namespace: kube-system
labels:
k8s-app: filebeat
data:
kubernetes.yml: |-
- type: docker
containers.ids:
- "*"
processors:
- add_kubernetes_metadata:
in_cluster: true
---
apiVersion: extensions/v1beta1
kind: DaemonSet
metadata:
name: filebeat
namespace: kube-system
labels:
k8s-app: filebeat
spec:
template:
metadata:
labels:
k8s-app: filebeat
spec:
serviceAccountName: filebeat
terminationGracePeriodSeconds: 30
containers:
- name: filebeat
image: docker.elastic.co/beats/filebeat:6.3.1
args: [
"-c", "/etc/filebeat.yml",
"-e",
]
env:
- name: ELASTICSEARCH_HOST
value: X.x.x.x
- name: ELASTICSEARCH_PORT
value: "9200"
value:
securityContext:
runAsUser: 0
resources:
limits:
memory: 200Mi
requests:
cpu: 100m
memory: 100Mi
volumeMounts:
- name: config
mountPath: /etc/filebeat.yml
readOnly: true
subPath: filebeat.yml
- name: inputs
mountPath: /usr/share/filebeat/inputs.d
readOnly: true
- name: data
mountPath: /usr/share/filebeat/data
- name: varlibdockercontainers
mountPath: /var/lib/docker/containers
readOnly: true
volumes:
- name: config
configMap:
defaultMode: 0600
name: filebeat-config
- name: varlibdockercontainers
hostPath:
path: /var/lib/docker/containers
- name: inputs
configMap:
defaultMode: 0600
name: filebeat-inputs
# data folder stores a registry of read status for all files, so we don't send everything again on a Filebeat pod restart
- name: data
hostPath:
path: /var/lib/filebeat-data
type: DirectoryOrCreate
--- 我检查了运行File节拍的豆荚,它存储日志。但不知何故,它并没有把它发布到弹性搜索中。什么应该是我的确切配置,使它发布到elasticsearch。我已经坚持了几天了,我没有选择了。任何帮助都将不胜感激。
发布于 2018-07-24 22:39:51
文件节拍配置没有选择任何输入类型。
filebeat.yaml文件输入路径必须指向您的文件-inputs.yaml,而不是日志位置。然后将其委托给停靠器输入类型。默认的containers.path是/var/lib/docker/。
https://www.elastic.co/guide/en/beats/filebeat/current/filebeat-input-docker.html
https://stackoverflow.com/questions/51506082
复制相似问题