如何通过sqoop从sybase导入数据？

Question

我可以通过sqoop使用以下命令从oracle 11g导入数据

import"
                , "-fs",  "file:///"
                , "-jt", "local"
                , "-libjars", "/tmp/HELLO/tej01/EMP.jar"
                , "--connect", "jdbc:oracle:thin:@192.168.1.111:1522:test"
                , "--username", "SCOTT", "--password", "password"
                ,"--table","EMP"
                ,"--inline-lob-limit","0"
                , "-m", "1"
                ,"--target-dir","/tmp/HELLO/tej01"
                ,"--fields-terminated-by", "^"
                , "--enclosed-by", enclosedBY

现在，我试图使用sqoop导入sybase-ase的数据。为此我使用了以下命令-

sqoop import --verbose --connect jdbc:sybase:Tds:[host]:5000?ServiceName=master --username sa --password password --query  "select * from City where \$CONDITIONS" --target-dir /tmp/HELLO/tej01 --driver "com.sybase.jdbc4.jdbc.SybDriver" -m 1

但我在跟踪错误-

    ERROR tool.ImportTool: Encountered IOException running import job: java.io.FileNotFoundException: File does not exist: hdfs://[host]:54310/usr/lib/sqoop/lib/parquet-format-2.0.0.jar
at org.apache.hadoop.hdfs.DistributedFileSystem$18.doCall(DistributedFileSystem.java:1122)
at org.apache.hadoop.hdfs.DistributedFileSystem$18.doCall(DistributedFileSystem.java:1114)
at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81)
at org.apache.hadoop.hdfs.DistributedFileSystem.getFileStatus(DistributedFileSystem.java:1114)
at org.apache.hadoop.mapreduce.filecache.ClientDistributedCacheManager.getFileStatus(ClientDistributedCacheManager.java:288)
at org.apache.hadoop.mapreduce.filecache.ClientDistributedCacheManager.getFileStatus(ClientDistributedCacheManager.java:224)
at org.apache.hadoop.mapreduce.filecache.ClientDistributedCacheManager.determineTimestamps(ClientDistributedCacheManager.java:93)
at org.apache.hadoop.mapreduce.filecache.ClientDistributedCacheManager.determineTimestampsAndCacheVisibilities(ClientDistributedCacheManager.java:57)
at org.apache.hadoop.mapreduce.JobSubmitter.copyAndConfigureFiles(JobSubmitter.java:269)
at org.apache.hadoop.mapreduce.JobSubmitter.copyAndConfigureFiles(JobSubmitter.java:390)
at org.apache.hadoop.mapreduce.JobSubmitter.submitJobInternal(JobSubmitter.java:483)
at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1296)
at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1293)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:415)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1628)
at org.apache.hadoop.mapreduce.Job.submit(Job.java:1293)
at org.apache.hadoop.mapreduce.Job.waitForCompletion(Job.java:1314)
at org.apache.sqoop.mapreduce.ImportJobBase.doSubmitJob(ImportJobBase.java:196)
at org.apache.sqoop.mapreduce.ImportJobBase.runJob(ImportJobBase.java:169)
at org.apache.sqoop.mapreduce.ImportJobBase.runImport(ImportJobBase.java:266)
at org.apache.sqoop.manager.SqlManager.importQuery(SqlManager.java:729)
at org.apache.sqoop.tool.ImportTool.importTable(ImportTool.java:499)
at org.apache.sqoop.tool.ImportTool.run(ImportTool.java:605)
at org.apache.sqoop.Sqoop.run(Sqoop.java:143)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
at org.apache.sqoop.Sqoop.runSqoop(Sqoop.java:179)
at org.apache.sqoop.Sqoop.runTool(Sqoop.java:218)
at org.apache.sqoop.Sqoop.runTool(Sqoop.java:227)
at org.apache.sqoop.Sqoop.main(Sqoop.java:236)

这个jar文件已经在sqoop的lib文件夹中了。请帮帮我。我在用

Hadoop版本: 2.6.0

Sqoop版本: 1.4.6

Answer 1

通过以下命令解决了这个问题

sqoop import --verbose --connect jdbc:sybase:Tds:192.168.1.102:5000?ServiceName=master --username sa --password password --table Class --driver com.sybase.jdbc4.jdbc.SybDriver -m 1 --target-dir file:////tmp/HELLO/tej01