如何在docker-compose中将telegraf连接到kafka

Question

我有docker zookeeper，kafka，telegraf，influxdb，postgres和其他

version: '2.1'
services:
  zookeeper:
    image: wurstmeister/zookeeper
    ports:
      - "2181:2181"
    environment:
      ZOOKEEPER_CLIENT_PORT: 2181
      ZOOKEEPER_TICK_TIME: 2000
    healthcheck:
      test: echo stat | nc localhost 2181
      interval: 10s
      timeout: 10s
      retries: 3
  kafka:
    image: wurstmeister/kafka:0.11.0.0
    ports:
      - "9092:9092"
    environment:
      OFFSETS_TOPIC_REPLICATION_FACTOR: 1
      KAFKA_BROKER_ID: 3
      KAFKA_ADVERTISED_PORT: 9092
      KAFKA_ADVERTISED_LISTENERS: PLAINTEXT://kafka:9092
      LOG4J_LOGGER_KAFKA_AUTHORIZER_LOGGER: TRACE
      KAFKA_ZOOKEEPER_CONNECT: zookeeper:2181
      KAFKA_CREATE_TOPICS: "testservise:1:1,testServiceInQueue:1:1,anotherTestServiceInQueue:1:1,storageServiceInQueue:1:1"
    volumes:
      - /var/run/docker.sock:/var/run/docker.sock
    depends_on:
      zookeeper:
        condition: service_healthy

  influxdb:
    image: influxdb:latest
    container_name: influxdb
    ports:
      - "8083:8083"
      - "8086:8086"
      - "8090:8090"

  telegraf:
    image: telegraf:latest
    restart: always
    container_name: telegraf
    hostname: localhost
    links:
      - influxdb
    volumes:
      - ${PWD}/.telegraf/telegraf.conf

首先，我做这个telegraf -sample-config -input-filter kafka_consumer -output-filter influxdb > telegraf.conf

原因需要使用telegraf /plugins/input/kafka_consumer它是正确的docker-compose文件吗？

在那之后，我需要从kafka获取信息，当我的测试服务发送一些东西时，我如何才能做到这一点，或者如何正确地谷歌它？

Answer 1

您的撰写文件看起来很好

默认情况下，我认为telegraf的配置如下所示

[[inputs.kafka_consumer]]
    ## kafka servers
    brokers = ["localhost:9092"]
    ## topic(s) to consume
    topics = ["telegraf"]

您需要使用kafka:9092并相应地更新主题。而且您还需要更新涌入的输出，可能还需要远离localhost

您还可以使用Kafka Connect向InfluxDB写入kafka消息