无法获取返回NoSuchObjectException的数据库默认值

Question

当我启动spark时，我会收到这样的警告：

Using Scala version 2.10.5 (OpenJDK 64-Bit Server VM, Java 1.8.0_77)
Type in expressions to have them evaluated.
Type :help for more information.
Spark context available as sc.
16/04/03 15:07:31 WARN Connection: BoneCP specified but not present in CLASSPATH (or one of dependencies)
16/04/03 15:07:31 WARN Connection: BoneCP specified but not present in CLASSPATH (or one of dependencies)
16/04/03 15:07:39 WARN ObjectStore: Version information not found in metastore. hive.metastore.schema.verification is not enabled so recording the schema version 1.2.0
16/04/03 15:07:39 WARN ObjectStore: Failed to get database default, returning NoSuchObjectException
SQL context available as sqlContext.

scala> 

还有当我执行这个命令时：var sqlContext = new org.apache.spark.sql.hive.HiveContext(sc)

我又收到了这样的警告：

scala> var sqlContext = new org.apache.spark.sql.hive.HiveContext(sc)
16/04/03 15:04:31 WARN Connection: BoneCP specified but not present in CLASSPATH (or one of dependencies)
16/04/03 15:04:31 WARN Connection: BoneCP specified but not present in CLASSPATH (or one of dependencies)
16/04/03 15:04:35 WARN ObjectStore: Failed to get database default, returning NoSuchObjectException
sqlContext: org.apache.spark.sql.hive.HiveContext = org.apache.spark.sql.hive.HiveContext@13453610

所以我的问题是，你是否知道为什么会出现这个警告，以及尽管警告正在发生，但命令var sqlContext = new org.apache.spark.sql.hive.HiveContext(sc)是否正常工作？

Answer 1

BoneCP是一个Java JDBC连接池，它试图绑定到一个JDBC连接，这就是为什么您会收到这些警告。您可以通过配置记录器级别来抑制此类警告。

Answer 2

我对这个警告也是这样的：

“无法获取数据库默认值，返回NoSuchObjectException”

但是我可以正确地连接到hive，所以请检查您的hive-site.xml，我不确定此警告是否会影响哨兵。

Answer 3

检查您是否分配了SQLContext

sqlContext = pyspark.SQLContext(sc)