业精于勤而荒于嬉,行成于思而毁于随

Spark Demo

Posted on By Jack Sun

Spark执行hive查询

SparkSession sparkSession = SparkSession.builder().appName(appName)
                    .config("spark.sql.warehouse.dir", "/user/hive/warehouse")
                    .config("hive.metastore.uris", hiveMetastoreUris).enableHiveSupport().getOrCreate();    
String sql = "sql";
Dataset<Row> rowDatas = sparkSession.sqlContext().sql(sql);