我正在尝试将我的API自定义日志文件传递给Kibana。为此,我使用myLogFiles.log -> Logstash -> Elasticsearch -> Kibana。
问题
Logstash输出告诉我们一切都很好,但是Elasticsearch仍然是空的(我用kibana或elasticsearch web可视化插件检查过)
问题
我如何给elasticsearch喂食,使我在基巴纳的数据可视化?
调试到目前为止
为了进行一些调试,我告诉Logstash将输出到一个.log文件中并放在控制台上。见我的logstash.conf:
input {
file {
path => '/home/***/dev_logstach/acci.log'
start_position => beginning
}
}
filter {
grok {
match => {"message" => "%{WORD:key} %{WORD:userID} %{WORD:lakeID} %{WORD:ballID} %{NUMBER:longitude} %{NUMBER:latitude} %{TIMESTAMP_ISO8601:date_evenement}"}
}
}
output {
elasticsearch {
hosts => ["localhost:9200"]
index => "testACCI"
}
stdout { codec => rubydebug }
file {
path => "/home/***/dev_logstach/testLog.log"
create_if_deleted => true
}
}和对数存储输出
{
"userID" => "HJcOX",
"@timestamp" => 2018-04-10T13:27:47.723Z,
"latitude" => "-123.8",
"message" => "{message:ACWWCI HJcOX qHYFM ABCCCC -22.5 -123.8 2018-04-10T09:11:06.173Z,level:info}",
"path" => "/home/***/dev_logstach/acci.log",
"date_evenement" => "2018-04-10T09:11:06.173Z",
"@version" => "1",
"lakeID" => "qHYFM",
"key" => "ACWWCI",
"ballID" => "ABCCCC",
"host" => "sd-10****",
"longitude" => "-22.5"
}当我再次运行它以不记录以前的数据时,当logstash运行时,如果我
echo -e "new data line" >> acci.log新数据出现在日志中。然后,我假设数据被发送到某个地方,但我不知道我能在哪里以及如何前进。
在elasticsearch日志中,我只看到一个警告:
2018-04-10T17:01:52,507][WARN ][o.e.d.i.m.MapperService ] [_default_] mapping is deprecated since it is not useful anymore now that indexes cannot have more than one type我读到了一些类似的问题,但由于日期格式,我的问题是valide (YYYY DD.)
发布于 2018-04-11 09:53:00
有几种选择:
这应该能解决你的问题。
https://stackoverflow.com/questions/49755494
复制相似问题