TezSession has already shutdown.Application XXX failed 2 times due to AM Container

org.apache.tez.dag.api.SessionNotRunning: TezSession has already shutdown. Application application_1648284477641_0003 failed 2 times due to AM Container for appattempt_1648284477641_0003_000002 exited with exitCode: 1

hadoop集群上从机上运行的Container试图使用过多的内存，被NodeManager kill掉了。

[摘录] The NodeManager is killing your container. It sounds like you are trying to use hadoop streaming which is running as a child process of the map-reduce task. The NodeManager monitors the entire process tree of the task and if it eats up more memory than the maximum set in mapreduce.map.memory.mb or mapreduce.reduce.memory.mb respectively, we would expect the Nodemanager to kill the task, otherwise your task is stealing memory belonging to other containers, which you don’t want.

修改 yarn的 hadoop-2.7.2/etc/hadoop/yarn-site.xml，指定内存为6个G；

	
        yarn.nodemanager.vmem-pmem-ratio
        6.0
    

关掉虚拟内存检查，修改yarn-site.xml。

	yarn.nodemanager.vmem-check-enabled
	false

修改mapred-site.xml中设置Map和Reduce任务的内存配置（value中的值根据实际实况灵活修改）

　　mapreduce.map.memory.mb
　　1536


　　mapreduce.map.java.opts
　　-Xmx2048M


　　mapreduce.reduce.memory.mb
　　3072


　　mapreduce.reduce.java.opts
　　-Xmx2560M