如何将Spark SQL连接到远程Hive Metastore

本篇内容主要讲解"如何将Spark SQL连接到远程Hive Metastore"，感兴趣的朋友不妨来看看。本文介绍的方法操作简单快捷，实用性强。下面就让小编来带大家学习"如何将Spark SQL连接到远程Hive Metastore"吧!

For Spark 1.x, you can set with :

System.setProperty("hive.metastore.uris", "thrift://METASTORE:9083");final SparkConf conf = new SparkConf();SparkContext sc = new SparkContext(conf);HiveContext hiveContext = new HiveContext(sc);

Or

final SparkConf conf = new SparkConf();SparkContext sc = new SparkContext(conf);HiveContext hiveContext = new HiveContext(sc);hiveContext.setConf("hive.metastore.uris", "thrift://METASTORE:9083");

Update If your Hive is Kerberized :

Try setting these before creating the HiveContext :

System.setProperty("hive.metastore.sasl.enabled", "true");System.setProperty("hive.security.authorization.enabled", "false");System.setProperty("hive.metastore.kerberos.principal", hivePrincipal);System.setProperty("hive.metastore.execute.setugi", "true");

到此，相信大家对"如何将Spark SQL连接到远程Hive Metastore"有了更深的了解，不妨来实际操作一番吧！这里是网站，更多相关内容可以进入相关频道进行查询，关注我们，继续学习！