Exception in thread "main" java.lang.UnsupportedOperationException: Schema for type AnyVal is not supported at org.apache.spark.sql.catalyst.ScalaReflection$$anonfun$schemaFor$1.apply(ScalaReflection.scala:790) at org.apache.spark.sql.catalyst.ScalaReflection$$anonfun$schemaFor$1.apply(ScalaReflection.scala:724) at scala.reflect.internal.tpe.TypeConstraints$UndoLog.undo(TypeConstraints.scala:56) at org.apache.spark.sql.catalyst.ScalaReflection$class.cleanUpReflectionObjects(ScalaReflection.scala:907) at org.apache.spark.sql.catalyst.ScalaReflection$.cleanUpReflectionObjects(ScalaReflection.scala:45) at org.apache.spark.sql.catalyst.ScalaReflection$.schemaFor(ScalaReflection.scala:723) at org.apache.spark.sql.catalyst.ScalaReflection$.schemaFor(ScalaReflection.scala:720) at org.apache.spark.sql.UDFRegistration.register(UDFRegistration.scala:234) at myspark.warehouse.DataParsing$.main(DataParsing.scala:62) at myspark.warehouse.DataParsing.main(DataParsing.scala)
原因:
之前定义了一个函数,在spark sql中使用,该函数的返回值类型是AnyVal,导致Dataframe无法解析,然后抛出了这个错误



