栏目分类:
子分类:
返回
名师互学网用户登录
快速导航关闭
当前搜索
当前分类
子分类
实用工具
热门搜索
名师互学网 > IT > 前沿技术 > 大数据 > 大数据系统

hadoop上传jar时遇到的问题

hadoop上传jar时遇到的问题

上传MapReduce的jar包时

1、Exception in thread “main” org.apache.hadoop.ipc.RemoteException(java.io.IOException): File /tmp/hadoop-yarn/staging/root/.staging/job_1625723817019_0003/job.jar could only be replicated to 0 nodes instead of minReplication (=1). There are 2 datanode(s) running and 2 node(s) are excluded in this operation.、

解决办法,每台都要关闭
systemctl stop firewalld.service #停止firewall
systemctl disable firewalld.service #禁止firewall开机启动
firewall-cmd --state #查看默认防火墙状态(关闭后显示notrunning,开启后显示running)

2、Exception in thread “main” org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.server.namenode.SafeModeException): Cannot delete /tmp/hadoop-yarn/staging/root/.staging/job_1625792478226_0001. Name node is in safe mode.The reported blocks 0 needs additional 12 blocks to reach the threshold 0.9990 of total blocks 12.
解决办法
Linux集群中的namenode没有关闭safemode
hadoop dfsadmin -safemode leave/enter(退出/进入安全模式)

转载请注明:文章转载自 www.mshxw.com
本文地址:https://www.mshxw.com/it/676553.html
我们一直用心在做
关于我们 文章归档 网站地图 联系我们

版权所有 (c)2021-2022 MSHXW.COM

ICP备案号:晋ICP备2021003244-6号