Kubernetes上的Flink JobManager HA

Question

JobManager HA上的最新Flink 1.9 doc仅涵盖单机版和纱线版。我正在寻找如何在Kubernetes上启用HA。

Answer 1

在K8s上部署Flink使用独立模式，您只需将HA配置添加到您的flink-conf.yaml中：

high-availability: zookeeper
high-availability.zookeeper.quorum: localhost:2181
high-availability.zookeeper.path.root: /flink
high-availability.cluster-id: /cluster_one # important: customize per cluster
high-availability.storageDir: hdfs:///flink/recovery

如何创建Docker镜像：https://github.com/apache/flink/tree/release-1.9/flink-container/docker

掌舵图：https://github.com/docker-flink/examples

如果您使用helmchart部署您的作业，您只需在values.yaml中添加HA配置：

flink:
  num_taskmanagers: 3
  config: |
    high-availability: zookeeper
    high-availability.zookeeper.quorum: localhost:2181
    high-availability.zookeeper.path.root: /flink
    high-availability.cluster-id: /cluster_one # important: customize per cluster
    high-availability.storageDir: hdfs:///flink/recovery