我试图用GCP数据流来实现Apache,使用谷歌提供的这个模板。
在可用的模板中,我使用的是JdbcToBigquery,这是我的用法。这些是我在pom.xml中的依赖项
<project xmlns="http://maven.apache.org/POM/4.0.0" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xsi:schemaLocation="http://maven.apache.org/POM/4.0.0 http://maven.apache.org/maven-v4_0_0.xsd">
<modelVersion>4.0.0</modelVersion>
<groupId>com.base</groupId>
<artifactId>Deltaflow</artifactId>
<version>1.0-SNAPSHOT</version>
<properties>
<scala.version>2.13.1</scala.version>
<beam.version>2.28.0</beam.version>
<threetenbp.version>1.4.4</threetenbp.version>
<beam-vendor-guava.version>0.1</beam-vendor-guava.version>
</properties>
<dependencies>
<dependency>
<groupId>org.scala-lang</groupId>
<artifactId>scala-library</artifactId>
<version>${scala.version}</version>
</dependency>
<dependency>
<groupId>org.apache.beam</groupId>
<artifactId>beam-sdks-java-core</artifactId>
<version>${beam.version}</version>
</dependency>
<dependency>
<groupId>org.apache.beam</groupId>
<artifactId>beam-sdks-java-io-google-cloud-platform</artifactId>
<version>${beam.version}</version>
</dependency>
<dependency>
<groupId>org.apache.beam</groupId>
<artifactId>beam-sdks-java-extensions-google-cloud-platform-core</artifactId>
<version>${beam.version}</version>
</dependency>
<dependency>
<groupId>org.apache.beam</groupId>
<artifactId>beam-sdks-java-extensions-protobuf</artifactId>
<version>${beam.version}</version>
</dependency>
<dependency>
<groupId>org.apache.beam</groupId>
<artifactId>beam-runners-google-cloud-dataflow-java</artifactId>
<version>${beam.version}</version>
</dependency>
<dependency>
<groupId>org.apache.beam</groupId>
<artifactId>beam-runners-direct-java</artifactId>
<version>${beam.version}</version>
</dependency>
<dependency>
<groupId>org.apache.beam</groupId>
<artifactId>beam-sdks-java-io-jdbc</artifactId>
<version>${beam.version}</version>
</dependency>
<dependency>
<groupId>org.apache.beam</groupId>
<artifactId>beam-vendor-guava-20_0</artifactId>
<version>${beam-vendor-guava.version}</version>
</dependency>
<dependency>
<groupId>org.threeten</groupId>
<artifactId>threetenbp</artifactId>
<version>${threetenbp.version}</version>
</dependency>
<dependency>
<groupId>com.base</groupId>
<artifactId>Deltaflow</artifactId>
<version>1.0-SNAPSHOT</version>
</dependency>
</dependencies>
<build>
<plugins>
<plugin>
<groupId>org.apache.maven.plugins</groupId>
<artifactId>maven-assembly-plugin</artifactId>
<configuration>
<descriptorRefs>
<descriptorRef>jar-with-dependencies</descriptorRef>
</descriptorRefs>
</configuration>
<executions>
<execution>
<id>assemble-all</id>
<phase>package</phase>
<goals>
<goal>single</goal>
</goals>
</execution>
</executions>
</plugin>
<plugin>
<groupId>net.alchim31.maven</groupId>
<artifactId>scala-maven-plugin</artifactId>
<version>3.4.0</version>
<executions>
<execution>
<id>scala-compile-first</id>
<phase>process-resources</phase>
<goals>
<goal>add-source</goal>
<goal>compile</goal>
</goals>
</execution>
<execution>
<id>scala-test-compile</id>
<phase>process-test-resources</phase>
<goals>
<goal>testCompile</goal>
</goals>
</execution>
</executions>
</plugin>
<plugin>
<groupId>org.apache.maven.plugins</groupId>
<artifactId>maven-compiler-plugin</artifactId>
<configuration>
<source>8</source>
<target>8</target>
</configuration>
</plugin>
</plugins>
</build>
</project>在模板中,有一个类: DynamicJdbcIO.java,它帮助创建jdbc连接。可以找到这里
我在我的pom.xml文件中添加了所有与光束相关的jars。但是,在DynamicJdbcIO.java类中的代码的这一部分中,我遇到了一些错误:
public static <T> DynamicRead<T> read() {
return new AutoValue_DynamicJdbcIO_DynamicRead.Builder<T>().build();
}错误:
Cannot resolve symbol 'AutoValue_DynamicJdbcIO_DynamicRead'我还添加了这些外部jars,以确保我拥有所有的库。
有谁能告诉我我在这里缺少什么吗?这是依赖型版本错配,还是AutoValue_DynamicJdbcIO_DynamicRead可用的jar文件或依赖项?
任何帮助都是非常感谢的。
发布于 2022-06-27 12:19:40
你从哪里搞到这个错误的?在IDE (VS代码,IntelliJ .)中编译maven项目时会发生此错误吗?
在我看来,应该将依赖项添加到pom.xml文件中。
<dependency>
<groupId>com.google.auto.service</groupId>
<artifactId>auto-service</artifactId>
<version>${autovalue.service.version}</version>
</dependency>
<dependency>
<groupId>com.google.auto.value</groupId>
<artifactId>auto-value</artifactId>
<version>${autovalue.version}</version>
<scope>provided</scope>
</dependency>
<dependency>
<groupId>com.google.auto.value</groupId>
<artifactId>auto-value-annotations</artifactId>
<version>${autovalue.annotations.version}</version>
</dependency>来自数据流模板的版本:
<autovalue.service.version>1.0-rc6</autovalue.service.version>
<autovalue.annotations.version>1.7.4</autovalue.annotations.version>
<autovalue.version>1.7.4</autovalue.version>https://stackoverflow.com/questions/66740569
复制相似问题