搜索 - 腾讯云开发者社区-腾讯云

文章/答案/技术大牛

发布

来自专栏Lansonli技术博客
客快物流大数据项目(五十三)：实时ETL模块开发准备
program output ## # Run in the yarn mode in Linux spark.app.dfs.checkpoint.dir=/apps/logistics/dat-hdfs/spark-checkpoint logistics/jars # Run in the local mode in Linux spark.app.local.checkpoint.dir=/apps/logistics/dat-local/spark-checkpoint jars # Running in the local Mode in Windows spark.app.win.checkpoint.dir=D://apps/logistics/dat-local/spark-checkpoint sparkAppDfsCheckpointDir = resourceBundle.getString("spark.app.dfs.checkpoint.dir")// /apps/logistics/dat-hdfs/spark-checkpoint sparkAppWinCheckpointDir = resourceBundle.getString("spark.app.win.checkpoint.dir")// D://apps/logistics/dat-local/spark-checkpoint
62631编辑于 2022-03-02
来自专栏ApacheHudi
基于Apache Hudi的多库多表实时入湖最佳实践
9092 \ -t cdc_topic_001 -p emr-cdc-group-02 -s true \ -o earliest \ -i 60 -y cow -p 10 \ -c s3://xxxxx/spark-checkpoint
3.3K10编辑于 2022-12-09