栏目分类:
子分类:
返回
名师互学网用户登录
快速导航关闭
当前搜索
当前分类
子分类
实用工具
热门搜索
名师互学网 > IT > 软件开发 > 后端开发 > Java

flink部署-低级错误记录

Java 更新时间: 发布时间: IT归档 最新发布 模块sitemap 名妆网 法律咨询 聚返吧 英语巴士网 伯小乐 网商动力

flink部署-低级错误记录

项目场景:

flink-yarn模式 配置,启动测试


问题1

Flink Application Mode模式执行任务时出错

 The program finished with the following exception:

java.lang.IllegalStateException: No ClusterClientFactory found. If you were targeting a Yarn cluster, please make sure to export the HADOOP_CLASSPATH environment variable or have hadoop in your classpath. For more information refer to the "Deployment" section of the official Apache Flink documentation.
        at org.apache.flink.client.deployment.DefaultClusterClientServiceLoader.getClusterClientFactory(DefaultClusterClientServiceLoader.java:83)
        at org.apache.flink.client.deployment.application.cli.ApplicationClusterDeployer.run(ApplicationClusterDeployer.java:61)
        at org.apache.flink.client.cli.CliFrontend.runApplication(CliFrontend.java:213)
        at org.apache.flink.client.cli.CliFrontend.parseAndRun(CliFrontend.java:1057)
        at org.apache.flink.client.cli.CliFrontend.lambda$main$10(CliFrontend.java:1132)
        at java.security.AccessController.doPrivileged(Native Method)
        at javax.security.auth.Subject.doAs(Subject.java:422)
        at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1729)
        at org.apache.flink.runtime.security.contexts.HadoopSecurityContext.runSecured(HadoopSecurityContext.java:41)
        at org.apache.flink.client.cli.CliFrontend.main(CliFrontend.java:1132)
----------------------------------------------------------------------------

问题1原因:
bin/flink run-application -t yarn-appliction -c com.atguigu.flink.chapter01.Flink02_UnBounded_WC_Lambda ./flink211125-1.0-SNAPSHOT.jar

执行上述命令时,手打打少了一个a,导致奇怪的错误。
正确命令如下:
bin/flink run-application -t yarn-application -c com.atguigu.flink.chapter01.Flink02_UnBounded_WC_Lambda ./flink211125-1.0-SNAPSHOT.jar

问题2

配置了flink-yarn高可用后,提交任务测试。

bin/flink run-application -t yarn-application -c com.atguigu.flink.chapter01.Flink02_UnBounded_WC_Lambda ./flink211125-1.0-SNAPSHOT.jar

之后一直处于 ACCEPTED 状态。

Deploying cluster, current state ACCEPTED
Deployment took more than 60 seconds. Please check if the requested resources are available in the YARN cluster

问题2原因

配置了高可用以后要起zookeeper, 否则一直连不上zookeeper,会一直是ACCEPTED状态,超过60秒还会提示你检查yarn集群资源够不够。

原因就是:配了高可用但没有起zookeeper,把zookeeper起了之后问题解决。


转载请注明:文章转载自 www.mshxw.com
本文地址:https://www.mshxw.com/it/871719.html
我们一直用心在做
关于我们 文章归档 网站地图 联系我们

版权所有 (c)2021-2022 MSHXW.COM

ICP备案号:晋ICP备2021003244-6号