您的位置:首页 > 其它

Spark2.0在本地运行时报错URISyntaxException: Relative path in absolute URI: file:G:/code/VersionTest/spark-wa

2016-09-20 13:58 429 查看
错误信息:

Exception in thread “main” java.lang.IllegalArgumentException: java.net.URISyntaxException: Relative path in absolute URI: file:G:/code/VersionTest/spark-warehouse

at org.apache.hadoop.fs.Path.initialize(Path.java:206)

at org.apache.hadoop.fs.Path.(Path.java:172)

at org.apache.spark.sql.catalyst.catalog.SessionCatalog.makeQualifiedPath(SessionCatalog.scala:114)

at org.apache.spark.sql.catalyst.catalog.SessionCatalog.createDatabase(SessionCatalog.scala:145)

at org.apache.spark.sql.catalyst.catalog.SessionCatalog.(SessionCatalog.scala:89)

at org.apache.spark.sql.internal.SessionState.cataloglzycompute(SessionState.scala:95)atorg.apache.spark.sql.internal.SessionState.catalog(SessionState.scala:95)atorg.apache.spark.sql.internal.SessionStateanon1.(SessionState.scala:112)

at org.apache.spark.sql.internal.SessionState.analyzerlzycompute(SessionState.scala:112)atorg.apache.spark.sql.internal.SessionState.analyzer(SessionState.scala:111)atorg.apache.spark.sql.execution.QueryExecution.assertAnalyzed(QueryExecution.scala:49)atorg.apache.spark.sql.Dataset.ofRows(Dataset.scala:64)

at org.apache.spark.sql.SparkSession.createDataFrame(SparkSession.scala:542)

at org.apache.spark.sql.SparkSession.createDataFrame(SparkSession.scala:302)

at DataSetTest$.main(DataSetTest.scala:39)

at DataSetTest.main(DataSetTest.scala)

at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)

at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)

at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)

at java.lang.reflect.Method.invoke(Method.java:498)

at com.intellij.rt.execution.application.AppMain.main(AppMain.java:144)

Caused by: java.net.URISyntaxException: Relative path in absolute URI: file:G:/code/VersionTest/spark-warehouse

at java.net.URI.checkPath(URI.java:1823)

at java.net.URI.(URI.java:745)

at org.apache.hadoop.fs.Path.initialize(Path.java:203)

… 20 more

解决办法:

val warehouseLocation = “/code/VersionTest/spark-warehouse”

val ss = SparkSession

.builder

.master(“local”)

.config(conf)

.config(“spark.sql.warehouse.dir”, warehouseLocation) //设置warehouse

.getOrCreate()
内容来自用户分享和网络整理,不保证内容的准确性,如有侵权内容,可联系管理员处理 点击这里给我发消息
相关文章推荐