火花-HBase- GCP模板(1/3) -如何在本地封装Hortonworks连接器？

Question

我试图在GCP上下文中测试Spark连接器，并尝试遵循1，这要求使用Maven (我尝试了Maven 3.6.3)在本地打包连接器2，并导致以下问题。

错误“分支-2.4”：

[ERROR] Failed to execute goal net.alchim31.maven:scala-maven-plugin:3.2.2:compile (scala-compile-first) on project shc-core: Execution scala-compile-first of goal net.alchim31.maven:scala-maven-plugin:3.2.2:compile failed.: NullPointerException -> [Help 1]

参考文献

1

2

Answer 1

正如注释中所建议的(谢谢@Ismail !)，使用Java8构建连接器：

sdk use java 8.0.275-zulu

mvn clean package -DskipTests

然后可以在Dependencies.scala的GCP模板中导入jar，如下所示。

...
val shcCore = "com.hortonworks" % "shc-core" % "1.1.3-2.4-s_2.11" from "file:///<path_to_jar>/shc-core-1.1.3-2.4-s_2.11.jar"
...
// shcCore % (shcVersionPrefix + scalaBinaryVersion) excludeAll(
shcCore excludeAll(
...