接上两篇文章继续。
Centos7 安装zookeeper3.6.3_Atraceofviciss的博客-CSDN博客
Centos7 Hadoop3.1 集群安装_Atraceofviciss的博客-CSDN博客
配置Hadoop文件core-site.xml
fs.defaultFS hdfs://ns1 ha.zookeeper.quorum root1:2181,root2:2181,root3:2181
配置hdfs-site.xml
dfs.nameservices ns1 dfs.ha.namenodes.ns1 nn1,nn2 dfs.namenode.rpc-address.ns1.nn1 root1:9000 dfs.namenode.http-address.ns1.nn1 root1:50070 dfs.namenode.rpc-address.ns1.nn2 root2:9000 dfs.namenode.http-address.ns1.nn2 root2:50070 dfs.namenode.shared.edits.dir qjournal://root1:8485;root2:8485;root3:8485/ns1 dfs.journalnode.edits.dir /hadoop/data/journal dfs.ha.automatic-failover.enabled true dfs.client.failover.proxy.provider.ns1 org.apache.hadoop.hdfs.server.namenode.ha.ConfiguredFailoverProxyProvider dfs.ha.fencing.methods sshfence shell(/bin/true) dfs.ha.fencing.ssh.private-key-files /home/vagrant/.ssh/id_rsa dfs.ha.fencing.ssh.connect-timeout 30000
配置完毕
启动zkServer.sh
初始化zookeeper
hdfs zkfc -formatZK
报错：hadoop-daemon.sh start journalnode
org.apache.hadoop.hdfs.qjournal.client.QuorumException: Unable to check if JNs are ready for formatting. 3 exceptions thrown:
初始化
./start-dfs.sh
hdfs namenode -format
同步NEMENODE副节点数据
hadoop-daemon.sh start namenode
hdfs namenode -bootstrapStandby
hadoop-daemon.sh start namenode
报错：启动集群时
but there is no HDFS_ZKFC_USER defined. Aborting operation
hadoop-env.sh需要哪个添加哪个
export HDFS_NAMENODE_USER=root export HDFS_DATANODE_USER=root export HDFS_SECONDARYNAMENODE_USER=root export YARN_RESOURCEMANAGER_USER=root export YARN_NODEMANAGER_USER=root export HDFS_ZKFC_USER=root export HDFS_JOURNALNODE_USER=root
默认端口为50070
