前提:本地java、hadoop已经安装好,但本地cmd启动spark-shell报出下面错误,我的配置是hadoop2.7、spark-2.3.1。
提示:没有配置好hadoop、spark(两者版本有联系,有对应)请先在本地安装好hadoop、spark。
出错原因:本地java版本过高.
处理方法:降低java版本到java8。如果不想影响你之前的java环境配置,你可以在本地多安一个java,想用哪个就到环境变量里面修改路径即可。
java8百度云资源:
链接: https://pan.baidu.com/s/1U4p8U8_DgDkOmK8xNiMlWw 提取码: q2pe
报错信息:
Exception in thread "'main" jav a . lang . Except ionInIn it ialize rError
at org . apache . hadoop . ut il. Str ingUt ils.
at org . apac he . hadoop . secur ity. UserGrowpI nf ormat ion . init ialize (UserGroupInf ornat ion . java :273)
at org apac he . hadoop secur it y . Use rGroupInf ornat ion ensure Init ialized (Use rGroupInf ormat ion .java:261)
at org . apac he . hadoop . security . Use rGroupI nf ormat ion . log inUse rFromSub.jec t (Use rGroupInf ormat ion . java:791>
at org . apac he . hadoop . secur ity . UserGroupI nf ormat ion . get LogrinUser
at org . apac he .s park . ut i1.Ut ils 5 anonf un李ge tCurentUse rNane$1. app1y
at scala . Opt ion . getOrElse KOpt ion. scala :121)
at org . apac he .s park . ut i1.Ut ils$ . ge tCurrentUse rNane (Ut ils . scala:2467)
at org . apac he . s park . Secur it yManager < in it >(Secur it yManager .sc ala : 220)
at org . apac he - s park . deploy . S parkSubmits - secMgrS 1z ycompute51 at org . apache . spark deplo y . S parkSubmit$ .org'$ apac hes s parks de plo y$S parkSubmit5$s ecMgr51(S parkSubnit .sc ala : 408 )
at org apac he . spark . deploy. SparkSubmit5 5anonf un$ doPre pareSubmit Env ironnent$? .app1y(S parkSubmit .scala:416>
at org . apac he . s park . deploy . SparkSubmit$$ anonf un$doPre pare Submit Enu ironnent$? . app1y
at scala. Opt ion map(Opt ion . scala:146
at org . apac he . spark . dep1o y . SparkSubmit$ . doPre pareSubmit Env ironnent
at org . apac he . spark . deploy . Sparkubmit$ . submit (SparkSubmit . scala:171 >
at org . apac he . s park . deploy . SparkSubmit5. main (SparkSubmit . scala:137)
at org . apac he . s park . deploy . s parkSubmit . ma in (S parkSubmit . scala)
Caused by: java. lang . Str ingI nde xOutOf Bounds Exception: begin 日. end 3. length 2
at java . base/ jaua. lang . S tr ing chec kBounds Beg inEnd at java base/ java . lang . Str ing . subs tr ing
22 more



