Exception in thread "main" java.lang.UnsupportedOperationException: No Encoder found for Any
2018-01-17 11:43
836 查看
Exception in thread "main" java.lang.UnsupportedOperationException: No Encoder found for Any - field (class: "java.lang.Object", name: "_1") - root class: "scala.Tuple3" at org.apache.spark.sql.catalyst.ScalaReflection$.org$apache$spark$sql$catalyst$ScalaReflection$$serializerFor(ScalaReflection.scala:598) at org.apache.spark.sql.catalyst.ScalaReflection$$anonfun$9.apply(ScalaReflection.scala:592) at org.apache.spark.sql.catalyst.ScalaReflection$$anonfun$9.apply(ScalaReflection.scala:583) at scala.collection.TraversableLike$$anonfun$flatMap$1.apply(TraversableLike.scala:241) at scala.collection.TraversableLike$$anonfun$flatMap$1.apply(TraversableLike.scala:241) at scala.collection.immutable.List.foreach(List.scala:381) at scala.collection.TraversableLike$class.flatMap(TraversableLike.scala:241) at scala.collection.immutable.List.flatMap(List.scala:344) at org.apache.spark.sql.catalyst.ScalaReflection$.org$apache$spark$sql$catalyst$ScalaReflection$$serializerFor(ScalaReflection.scala:583) at org.apache.spark.sql.catalyst.ScalaReflection$.serializerFor(ScalaReflection.scala:425) at org.apache.spark.sql.catalyst.encoders.ExpressionEncoder$.apply(ExpressionEncoder.scala:61) at org.apache.spark.sql.Encoders$.product(Encoders.scala:274) at org.apache.spark.sql.SQLImplicits.newProductEncoder(SQLImplicits.scala:47) at wangsheng.sibat.highway.process$.main(process.scala:37) at wangsheng.sibat.highway.process.main(process.scala)
上面是报错信息
val LineFlow = data.groupBy("InRoadNoInStationNo","OutRoadNoOutStationNo").count().map(s => (s(0),s(1),s(2))).toDF("InRoadNoInStationNo","OutRoadNoOutStationNo","count")这是我的代码
在网上看了一些相关的解决办法,都跟我的不一样。我觉得应该这里问题应该出在map上面
解决方法就是去掉中间的map
val LineFlow = data.groupBy("InRoadNoInStationNo","OutRoadNoOutStationNo").count().toDF("InRoadNoInStationNo","OutRoadNoOutStationNo","count")
相关文章推荐
- Exception in thread "main" java.lang.UnsupportedOperationException
- [置顶] spark2.2错误 java.lang.UnsupportedOperationException: No Encoder found for org.apache.spark.sql.Row解决
- Hbase delete遇到的常见异常: Exception in thread "main" java.lang.UnsupportedOperationException
- 解决Exception in thread “main" java.lang.UnsupportedClassVersionError
- Exception in thread "main" java.lang.UnsupportedClassVersionError: org/apache/catalina/startup/Boots
- Exception in thread "main" java.lang.UnsupportedClassVersionError: scala/tools/n sc/MainGenericRunne
- Exception in thread "main" java.lang.NoSuchFieldError: INSTANCE
- Exception in thread “main" java.lang.UnsupportedClassVersionError
- Exception in thread "main" java.lang.UnsupportedClassVersionError: Filter(Unsupported major.minor ve
- Exception in thread "main" java.lang.UnsupportedClassVersionError: org/apache/ma ven/cli/Maven
- Exception in thread "main" java.lang.UnsupportedClassVersionError
- 基于Web的Kafka管理器工具之Kafka-manager启动时出现Exception in thread "main" java.lang.UnsupportedClassVersionError错误解决办法(图文详解)
- idea找不到导入的包和类,intelij idea: Exception in thread "main" java.lang.ClassNotFoundException
- Exception in thread "main" java.lang.UnsupportedClassVersionError: org/apache/maven/cli/MavenCli : U
- intelij idea: Exception in thread "main" java.lang.ClassNotFoundException
- java编译中出现了Exception in thread “main" java.lang.UnsupportedClassVersionError
- 1. spring boot项目创建过程中遇到的问题(一):Exception in thread "main" java.lang.UnsupportedClassVersionError
- Exception in thread "main" java.lang.RuntimeException: java.lang.NoSuchFieldException: versionID
- Exception in thread "main" java.lang.ClassNotFoundException: xxxx
- 关于java的Graphics出现“Exception in thread "AWT-EventQueue-0" java.lang.UnsupportedOperationException: Not supported yet.”