在“#19步骤名称:配置单元清理”java.lang.RuntimeException: failed to read kylin_hive_conf.xml (#19步骤名称:配置单元清理)时，Kylin构建多维数据集失败

Question

错误有时会发生，在重启kylin(kylin.sh停止，然后kylin.sh启动)后，它会找到conf目录的位置并通过此步骤。

我使用的是Kylin版本"2.6.2"，并且已经正确设置了KYLIN_CONF="/opt/kylin/conf“。

错误提示是不同的，因为我已经反驳了以下几点: 1.

java.lang.RuntimeException: Failed to read kylin_hive_conf.xml at '/opt/apache-kylin-2.6.2-bin-hadoop3/bin/meta/kylin_hive_conf.xml'
    at org.apache.kylin.common.util.SourceConfigurationUtil.loadXmlConfiguration(SourceConfigurationUtil.java:88)
    at org.apache.kylin.common.util.SourceConfigurationUtil.loadHiveConfiguration(SourceConfigurationUtil.java:61)
    at org.apache.kylin.common.util.HiveCmdBuilder.<init>(HiveCmdBuilder.java:48)
    at org.apache.kylin.source.hive.GarbageCollectionStep.cleanUpIntermediateFlatTable(GarbageCollectionStep.java:63)
    at org.apache.kylin.source.hive.GarbageCollectionStep.doWork(GarbageCollectionStep.java:49)
    at org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:167)
    at org.apache.kylin.job.execution.DefaultChainedExecutable.doWork(DefaultChainedExecutable.java:71)
    at org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:167)
    at org.apache.kylin.job.impl.threadpool.DefaultScheduler$JobRunner.run(DefaultScheduler.java:114)
    at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
    at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
    at java.lang.Thread.run(Thread.java:748)

2.

java.lang.RuntimeException: Failed to read kylin_hive_conf.xml at '/opt/apache-kylin-2.6.2-bin-hadoop3/bin/meta/kylin_hive_conf.xml'

3.

java.lang.RuntimeException: Failed to read kylin_hive_conf.xml at '/opt/apache-kylin-2.6.2-bin-hadoop3/conf/meta/kylin_hive_conf.xml'

谁能帮我找到根本原因并解决这个问题？提前谢谢。

Answer 1

我希望你已经解决了这个问题。我也遇到过同样的问题，并对此进行了调查。

首选https://github.com/apache/kylin/blob/kylin-2.6.2/engine-mr/src/main/java/org/apache/kylin/engine/mr/common/AbstractHadoopJob.java#L481

当我们使用MapReduce时，KYLIN_CONF会被设置到不同的文件夹中。

System.setProperty(KylinConfig.KYLIN_CONF, metaDir.getAbsolutePath());

我认为要解决这个问题，我们必须为所有XML xml配置创建简单的链接。

尝试查看您的Kylin日志

cat YOUR_PATH/apache-kylin-2.6.3-bin-hbase1x/logs/kylin.log | grep "The absolute path"

你可能会看到结果

2019-10-14 23:47:04,438 INFO  [LocalJobRunner Map Task Executor #0] common.AbstractHadoopJob:482 : The absolute path for meta dir is /SOME_FOLDER/meta