val spark = SparkSession.builder().getOrCreate()
val array = Array(StructField("name",StringType,true),
StructField("age",IntegerType,true))
val schema = StructType(array)
val rdd1 = spark.sparkContext.textFile("file:///home/sparkb")
val rdd2 = rdd1.map(x=>x.split(","))
val rdd_row = rdd2.map(x=>Row(x(0),x(1).trim.toInt))
val df = spark.createDataFrame(rdd_row,schema)
df.createOrReplaceTempView("user")
spark.sql("select * from user where age > 20").show
可能时idea自己没有自动导包,需要自己手动导包
import org.apache.spark.sql.types._ import org.apache.spark.sql.Row
如果idea中仍然报错,建议删除报错代码重新写
如果在虚拟机中也报错,建议将包也导入虚拟机



