Spark2.0在本地运行时报错URISyntaxException: Relative path in absolute URI: file:G:/code/VersionTest/spark-wa
2016-09-20 13:58
429 查看
错误信息:
Exception in thread “main” java.lang.IllegalArgumentException: java.net.URISyntaxException: Relative path in absolute URI: file:G:/code/VersionTest/spark-warehouse
at org.apache.hadoop.fs.Path.initialize(Path.java:206)
at org.apache.hadoop.fs.Path.(Path.java:172)
at org.apache.spark.sql.catalyst.catalog.SessionCatalog.makeQualifiedPath(SessionCatalog.scala:114)
at org.apache.spark.sql.catalyst.catalog.SessionCatalog.createDatabase(SessionCatalog.scala:145)
at org.apache.spark.sql.catalyst.catalog.SessionCatalog.(SessionCatalog.scala:89)
at org.apache.spark.sql.internal.SessionState.cataloglzycompute(SessionState.scala:95)atorg.apache.spark.sql.internal.SessionState.catalog(SessionState.scala:95)atorg.apache.spark.sql.internal.SessionStateanon1.(SessionState.scala:112)
at org.apache.spark.sql.internal.SessionState.analyzerlzycompute(SessionState.scala:112)atorg.apache.spark.sql.internal.SessionState.analyzer(SessionState.scala:111)atorg.apache.spark.sql.execution.QueryExecution.assertAnalyzed(QueryExecution.scala:49)atorg.apache.spark.sql.Dataset.ofRows(Dataset.scala:64)
at org.apache.spark.sql.SparkSession.createDataFrame(SparkSession.scala:542)
at org.apache.spark.sql.SparkSession.createDataFrame(SparkSession.scala:302)
at DataSetTest$.main(DataSetTest.scala:39)
at DataSetTest.main(DataSetTest.scala)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.intellij.rt.execution.application.AppMain.main(AppMain.java:144)
Caused by: java.net.URISyntaxException: Relative path in absolute URI: file:G:/code/VersionTest/spark-warehouse
at java.net.URI.checkPath(URI.java:1823)
at java.net.URI.(URI.java:745)
at org.apache.hadoop.fs.Path.initialize(Path.java:203)
… 20 more
解决办法:
val warehouseLocation = “/code/VersionTest/spark-warehouse”
val ss = SparkSession
.builder
.master(“local”)
.config(conf)
.config(“spark.sql.warehouse.dir”, warehouseLocation) //设置warehouse
.getOrCreate()
Exception in thread “main” java.lang.IllegalArgumentException: java.net.URISyntaxException: Relative path in absolute URI: file:G:/code/VersionTest/spark-warehouse
at org.apache.hadoop.fs.Path.initialize(Path.java:206)
at org.apache.hadoop.fs.Path.(Path.java:172)
at org.apache.spark.sql.catalyst.catalog.SessionCatalog.makeQualifiedPath(SessionCatalog.scala:114)
at org.apache.spark.sql.catalyst.catalog.SessionCatalog.createDatabase(SessionCatalog.scala:145)
at org.apache.spark.sql.catalyst.catalog.SessionCatalog.(SessionCatalog.scala:89)
at org.apache.spark.sql.internal.SessionState.cataloglzycompute(SessionState.scala:95)atorg.apache.spark.sql.internal.SessionState.catalog(SessionState.scala:95)atorg.apache.spark.sql.internal.SessionStateanon1.(SessionState.scala:112)
at org.apache.spark.sql.internal.SessionState.analyzerlzycompute(SessionState.scala:112)atorg.apache.spark.sql.internal.SessionState.analyzer(SessionState.scala:111)atorg.apache.spark.sql.execution.QueryExecution.assertAnalyzed(QueryExecution.scala:49)atorg.apache.spark.sql.Dataset.ofRows(Dataset.scala:64)
at org.apache.spark.sql.SparkSession.createDataFrame(SparkSession.scala:542)
at org.apache.spark.sql.SparkSession.createDataFrame(SparkSession.scala:302)
at DataSetTest$.main(DataSetTest.scala:39)
at DataSetTest.main(DataSetTest.scala)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.intellij.rt.execution.application.AppMain.main(AppMain.java:144)
Caused by: java.net.URISyntaxException: Relative path in absolute URI: file:G:/code/VersionTest/spark-warehouse
at java.net.URI.checkPath(URI.java:1823)
at java.net.URI.(URI.java:745)
at org.apache.hadoop.fs.Path.initialize(Path.java:203)
… 20 more
解决办法:
val warehouseLocation = “/code/VersionTest/spark-warehouse”
val ss = SparkSession
.builder
.master(“local”)
.config(conf)
.config(“spark.sql.warehouse.dir”, warehouseLocation) //设置warehouse
.getOrCreate()
相关文章推荐
- Spark2.0的Caused by: java.net.URISyntaxException: Relative path in absolute URI: file错误
- spark 2.0 遇到java.net.URISyntaxException: Relative path in absolute URI
- Spark:java.net.URISyntaxException: Relative path in absolute URI: file:D:/XXX/spark-spark-warehouse
- Spark2.0异常:java.net.URISyntaxException: Relative path in absolute URI
- Spark代码调试遇到的错误Caused by: java.net.URISyntaxException: Relative path in absolute URI: file:
- Why does Spark report “java.net.URISyntaxException: Relative path in absolute URI” when working with
- Hive启动时,报错Relative path in absolute URI: ${system:java.io.tmpdir}
- hive启动报错 java.net.URISyntaxException: Relative path in absolute URI: ${system:java.io.tmpdir%7D/$%7B
- hive1.2.1配置错误( Relative path in absolute URI: ${system:java.io.tmpdir%7D/$%7Bsystem:user.name%7D)
- FAILED java.lang.IllegalArgumentException: java.net.URISyntaxException: Relative path in absolute URI:hdfs:192.*
- Hive学习1_hive配置遇到的问题:Relative path in absolute URI: ${system:java.io.tmpdir%7D/$%7Bsystem:user.name%
- hive 配置 mysql时的问题(Relative path in absolute URI: ${system:java.io.tmpdir%7D/$%7Bsystem:user.name%7D)
- hive启动报错 java.net.URISyntaxException: Relative path in absolute URI: ${system:java.io.tmpdir%7D/$%7B
- Hive 启动异常: java.net.URISyntaxException: Relative path in absolute URI:
- hive配置遇到的问题( Relative path in absolute URI: ${system:java.io.tmpdir%7D/$%7Bsystem:user.name%7D)
- hive 配置 mysql时的问题(Relative path in absolute URI: ${system:java.io.tmpdir%7D/$%7Bsystem:user.name%7D
- Hive启动时,遇到java.net.URISyntaxException: Relative path in absolute URI
- Relative path in absolute URI: ${system:java.io.tmpdir%7D/$%7Bsystem:user.name%7D
- Relative path in absolute URI: ${system:java.io.tmpdir%7D/$%7Bsystem:user.name%7D)
- Relative path in absolute URI: ${system:java.io.tmpdir%7D/$%7Bsystem:user.name%7D)