Hadoop之Yarn的配置（详细步骤）

配置

先进入hadoop-2.7.6/etc/hadoop

 cd /home/ZQ/hadoop-2.7.6/etc/hadoop/

配置 mapred-site.xml

 vim mapred-site.xml

增加如下内容

  

       mapreduce.framework.name

       yarn

  

配置 yarn-site.xml 

vim yarn-site.xml 

增加如下内容

  

        yarn.nodemanager.aux-services

        mapreduce_shuffle

  

 

       yarn.resourcemanager.address

        westgisB062:8032





yarn.resourcemanager.scheduler.address

        westgisB062:8030

  

 

        yarn.resourcemanager.resource-tracker.address
        westgisB062:8031

  



        yarn.nodemanager.memory-mb

        8GB





        yarn.nodemanager.cpu-vcores

        4

将配置文件拷贝到其他节点

以其中一个节点为例，其他节点同理（拷贝到所有节点）

scp -r /home/ZQ/hadoop-2.7.6/etc/hadoop/mapred-site.xml ZQ@10.103.105.59:/home/ZQ/hadoop-2.7.6/etc/hadoop

scp -r /home/ZQ/hadoop-2.7.6/etc/hadoop/yarn-site.xml ZQ@10.103.105.59:/home/ZQ/hadoop-2.7.6/etc/hadoop

集群的操作和查看

 启动集群

$HADOOP_HOME/sbin/start-dfs.sh

start-dfs.sh

$HADOOP_HOME/sbin/start-yarn.sh

start-yarn.sh

 查看集群

jps

HDFS

http://10.103.105.62:50070

YARN

http://10.103.105.62:8088

 停止集群

$HADOOP_HOME/sbin/stop-yarn.sh

stop-yarn.sh

$HADOOP_HOME/sbin/stop-dfs.sh

stop-dfs.sh