火花塞3.2.2模拟用户面对错误与亚稳态。SASL谈判失败，GSS启动失败

Question

在hadoop角化簇上。如果我不冒充用户上的火花节约服务器。效果很好。但当我这么做的时候。我面临一个与亚稳态认证有关的错误。

我把这份文件

https://docs.cloudera.com/HDPDocuments/HDP2/HDP-2.6.4/bk_spark-component-guide/content/config-sts-user-imp.html

https://docs.cloudera.com/HDPDocuments/HDP2/HDP-2.6.4/bk_data-access/content/ref-5422cb60-d1d5-425a-b719-ec7bd03ee5d3.1.html

步骤1：

高级spark-hive-site-override

• Add spark.jars =自定义spark-thrift-sparkconf

中的

• Set hive.server2.enable.doAs = true

步骤2:高级蜂巢中的2-site

• Set hive.security.authorization.enabled = true
• Set hive.server2.enable.doAs = true
• Set hive.metastore.pre.event.listeners = hive.security.metastore.authorization.manager = org.apache.hadoop.hive.ql.security.authorization.StorageBasedAuthorizationProvider

第3步：

'jdbc:hive2://:/default;principal=spark3/@;auth=KERBEROS;transportMode=binary'

• I创建了一个用户keytab和princinpal和kinit
• 运行cli: beeline -u -u

连接到jdbc:hive2:///default;principal=spark3/@;auth=KERBEROS;transportMode=binary (版本3.2.2)驱动程序: Hive (版本3.1.3.1.4.0-315)事务隔离: Apache的TRANSACTION_REPEATABLE_READ Beeline版本3.1.0.3.1.4.0-315

• 运行cli:显示数据库；

我正面临着这样一个错误

Error: org.apache.hive.service.cli.HiveSQLException: Error running query: org.apache.spark.sql.AnalysisException: org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.RuntimeException: Unable to instantiate org.apache.hadoop.hive.ql.metadata.SessionHiveMetaStoreClient
    ....
Caused by: org.apache.spark.sql.AnalysisException: org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.RuntimeException: Unable to instantiate org.apache.hadoop.hive.ql.metadata.SessionHiveMetaStoreClient
    ....
Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.RuntimeException: Unable to instantiate org.apache.hadoop.hive.ql.metadata.SessionHiveMetaStoreClient
....
Caused by: java.lang.RuntimeException: Unable to instantiate org.apache.hadoop.hive.ql.metadata.SessionHiveMetaStoreClient
    ....
Caused by: java.lang.reflect.InvocationTargetException
....
Caused by: MetaException(message:Could not connect to meta store using any of the URIs provided. Most recent failure: org.apache.thrift.transport.TTransportException: GSS initiate failed

我查了一下星星之火--看

22/10/07 15:07:31 INFO ThriftCLIService: Client protocol version: HIVE_CLI_SERVICE_PROTOCOL_V10
22/10/07 15:07:31 INFO HiveSessionImpl: Operation log session directory is created: /tmp/spark3/operation_logs/64eb19a6-1bdc-4ed8-81c9-8881c4251e75
22/10/07 15:07:31 INFO metastore: Trying to connect to metastore with URI thrift://<host>:<port>
22/10/07 15:07:32 INFO metastore: Opened a connection to metastore, current connections: 1
22/10/07 15:07:32 INFO metastore: Connected to metastore.
22/10/07 15:07:39 INFO SparkExecuteStatementOperation: Submitting query 'show databases' with fdcf90cb-74bb-4574-99b7-bfd981ce8010
22/10/07 15:07:39 INFO SparkExecuteStatementOperation: Running query with fdcf90cb-74bb-4574-99b7-bfd981ce8010
22/10/07 15:07:39 INFO metastore: Closed a connection to metastore, current connections: 0
22/10/07 15:07:39 INFO metastore: Trying to connect to metastore with URI thrift://<host>:<port>
22/10/07 15:07:39 ERROR TSaslTransport: SASL negotiation failure
javax.security.sasl.SaslException: GSS initiate failed [Caused by GSSException: No valid credentials provided (Mechanism level: Failed to find any Kerberos tgt)]
    
Caused by: GSSException: No valid credentials provided (Mechanism level: Failed to find any Kerberos tgt)
    
22/10/07 15:07:39 WARN metastore: Failed to connect to the MetaStore Server...
22/10/07 15:07:39 INFO metastore: Waiting 5 seconds before next connection attempt.
22/10/07 15:07:44 INFO metastore: Trying to connect to metastore with URI  thrift://<host>:<port>
22/10/07 15:07:44 ERROR TSaslTransport: SASL negotiation failure
javax.security.sasl.SaslException: GSS initiate failed [Caused by GSSException: No valid credentials provided (Mechanism level: Failed to find any Kerberos tgt)]

我测试连接火花节省服务器成功，但当我运行查询。我面临以上的错误。我哪里错了？

Answer 1

星星之花服务器是建立在单个星星之火应用程序之上的，不幸的是，它还不支持模拟。

也许你可以试试Apache Kyuubi https://github.com/apache/incubator-kyuubi