分布式部署 Spark 2.2.1 集成Hive数据仓库的案例与解读(6)

??

3)???????????? 启动Thrift Server服务。分布式部署

root@master:/usr/local/spark-2.2.1-bin-hadoop2.6/sbin#  start-thriftserver.sh  --master

spark://master:7077  --driver-class-path/usr/local/apache-hive-1.2.1/lib/mysql-connector-java-5.1.13-bin.jar

startingorg.apache.spark.sql.hive.thriftserver.HiveThriftServer2, logging to/usr/local/spark-2.2.1-bin-hadoop2.6/logs/spark-root-org.apache.spark.sql.hive.thriftserver.HiveThriftServer2-1-master.out

 

4)???????????? 启动Beeline工具，使用!connectjdbc:hive2://master:10001/default?

hive.server2.transport.mode=http;hive.server2.thrift.http.path=cliservice方式连接ThriftServer服务。

root@master:/usr/local/spark-2.2.1-bin-hadoop2.6/sbin#../bin/beeline

Beeline version 1.2.1.spark2 by Apache Hive

beeline> !connectjdbc:hive2://master:10001/default?hive.server2.transport.mode=http;hive.server2.thrift.http.path=cliservice

Connecting tojdbc:hive2://master:10001/default?hive.server2.transport.mode=http;hive.server2.thrift.http.path=cliservice

Enter username forjdbc:hive2://master:10001/default?hive.server2.transport.mode=http;hive.server2.thrift.http.path=cliservice:root

Enter password forjdbc:hive2://master:10001/default?hive.server2.transport.mode=http;hive.server2.thrift.http.path=cliservice:****

18/02/20 21:09:19 INFO jdbc.Utils: Supplied authorities:master:10001

18/02/20 21:09:19 WARN jdbc.Utils: ***** JDBC param deprecation*****

18/02/20 21:09:19 WARN jdbc.Utils: The use ofhive.server2.transport.mode is deprecated.

18/02/20 21:09:19 WARN jdbc.Utils: Please use transportMode like so:jdbc:hive2://<host>:<port>/dbName;transportMode=<transport_mode_value>

18/02/20 21:09:19 WARN jdbc.Utils: ***** JDBC param deprecation*****

18/02/20 21:09:19 WARN jdbc.Utils: The use of hive.server2.thrift.http.pathis deprecated.

18/02/20 21:09:19 WARN jdbc.Utils: Please use httpPath like so:jdbc:hive2://<host>:<port>/dbName;httpPath=<http_path_value>

18/02/20 21:09:19 INFO jdbc.Utils: Resolved authority: master:10001

Connected to: Spark SQL (version 2.2.1)

Driver: Hive JDBC (version 1.2.1.spark2)

Transaction isolation: TRANSACTION_REPEATABLE_READ

0: jdbc:hive2://master:10001/default>

 

本文来自电脑杂谈，转载请注明本文网址：
http://www.pc-fly.com/a/jisuanjixue/article-86251-6.html