启用检查点的flinksql客户端配置文件的示例是什么?
当我通过flink sql客户端提交流作业时,检查点未启用。
发布于 2021-01-12 18:20:27
检查点配置不能在flink sql客户端配置文件中设置,但可以在群集配置文件(flink-conf.yaml)中设置。
您至少应该配置execution.checkpointing.interval、state.backend和state.checkpoints.dir。
类似这样的内容,例如:
execution.checkpointing.interval: 10000
state.backend: filesystem
state.checkpoints.dir: file:///tmp/flink-checkpoints-directory
state.savepoints.dir: file:///tmp/flink-savepoints-directory有关更多详细信息,请参阅checkpointing、fault tolerance和state backends的配置文档。
发布于 2021-08-27 10:35:16
就我在文档中看到的,您应该能够在sql客户端通过如下设置属性来执行此操作:
SET 'state.checkpoints.dir' = 'hdfs:///bar/foo/';
SET 'execution.checkpointing.mode' = 'EXACTLY_ONCE';
SET 'execution.checkpointing.interval' = '30min';
SET 'execution.checkpointing.min-pause' = '20min';
SET 'execution.checkpointing.max-concurrent-checkpoints' = '1';
SET 'execution.checkpointing.prefer-checkpoint-for-recovery' = 'true';https://stackoverflow.com/questions/65674619
复制相似问题