hadoop21：Zookeeper分布式集群构建

文章目录

• 一、Zookeeper分布式集群构建步骤：
• • 1、通过secureCRT 把Zookeeper压缩包传到app目录里面，
  • 2、解压Zookeeper压缩包
  • 3、删掉压缩包
  • 4、把apache-zookeeper-3.5.6-bin改名为zookeeper-3.5.6
  • 5、创建软链接
  • 6、修改zoo.cfg配置文件
  • 7、 ==deploy.sh zookeeper-3.5.6 /home/hadoop/app/ slave==：将Zookeeper安装目录整体分发到其他节点
  • 8、分别给从节点创建软链接
  • 9、创建规划的目录
  • • 目录一：==runRemoteCmd.sh "mkdir -p /home/hadoop/data/zookeeper/zkdate" all==
    • 目录二：==runRemoteCmd.sh "mkdir -p /home/hadoop/data/zookeeper/zkdatalog" all==
  • 10、修改每个节点服务编号
  • 11、测试运行
  • • （1）启动Zookeeper
    • • 命令： ==runRemoteCmd.sh "/home/hadoop/app/zookeeper/bin/zkServer.sh start" all==
    • （2）查看ZooKeeper状态
    • • 命令：== runRemoteCmd.sh "/home/hadoop/app/zookeeper/bin/zkServer.sh status" all==
    • （3）查看ZooKeeper本身的数据结构，即本身有哪些目录

一、Zookeeper分布式集群构建步骤： 1、通过secureCRT 把Zookeeper压缩包传到app目录里面， 2、解压Zookeeper压缩包

[hadoop@hadoop60 app]$ tar -zxvf apache-zookeeper-3.5.6-bin.tar.gz
[hadoop@hadoop60 app]$ ls
apache-zookeeper-3.5.6-bin  apache-zookeeper-3.5.6-bin.tar.gz  jdk  jdk1.8.0_51

3、删掉压缩包

[hadoop@hadoop60 app]$ rm -rf apache-zookeeper-3.5.6-bin.tar.gz

4、把apache-zookeeper-3.5.6-bin改名为zookeeper-3.5.6

[hadoop@hadoop60 app]$ ls
apache-zookeeper-3.5.6-bin  jdk  jdk1.8.0_51
[hadoop@hadoop60 app]$ mv apache-zookeeper-3.5.6-bin/ zookeeper-3.5.6

5、创建软链接

[hadoop@hadoop60 app]$ ls
jdk  jdk1.8.0_51  zookeeper-3.5.6
[hadoop@hadoop60 app]$ ln -s zookeeper-3.5.6 zookeeper
[hadoop@hadoop60 app]$ 

6、修改zoo.cfg配置文件

（1）通过secureCRT把zoo.cfg配置文件传到Linux里的/home/hadoop/app/zookeeper-3.5.6/conf目录下
（2）编辑zoo.cfg，把最后三行里面的主机名修改成自己设置的主机名

vi zoo.cfg
server.1=hadoop60:2888:3888
server.2=hadoop61:2888:3888
server.3=hadoop62:2888:3888

7、 deploy.sh zookeeper-3.5.6 /home/hadoop/app/ slave：将Zookeeper安装目录整体分发到其他节点

[hadoop@hadoop60 conf]$ cd ..
[hadoop@hadoop60 zookeeper-3.5.6]$ cd ..
[hadoop@hadoop60 app]$ deploy.sh zookeeper-3.5.6 /home/hadoop/app/ slave

8、分别给从节点创建软链接

[hadoop@hadoop61 app]$ ln -s zookeeper-3.5.6 zookeeper
[hadoop@hadoop62 app]$ ln -s zookeeper-3.5.6 zookeeper

9、创建规划的目录 目录一：runRemoteCmd.sh “mkdir -p /home/hadoop/data/zookeeper/zkdate” all 目录二：runRemoteCmd.sh “mkdir -p /home/hadoop/data/zookeeper/zkdatalog” all

[hadoop@hadoop60 conf]$ cd ../..
[hadoop@hadoop60 app]$ runRemoteCmd.sh "mkdir -p /home/hadoop/data/zookeeper/zkdate" all
*******************hadoop60***********************
*******************hadoop61***********************
*******************hadoop62***********************
[hadoop@hadoop60 app]$ runRemoteCmd.sh "mkdir -p /home/hadoop/data/zookeeper/zkdatalog" all
*******************hadoop60***********************
*******************hadoop61***********************
*******************hadoop62***********************

10、修改每个节点服务编号

步骤：分别到各个节点，进入/home/hadoop/data/zookeeper/zkdata目录，创建文件myid，里面的内容分别填充为：1、2、3

[hadoop@hadoop60 zookeeper]$ cd zkdata
[hadoop@hadoop60 zkdata]$ ll
总用量 0
[hadoop@hadoop60 zkdata]$ touch myid
[hadoop@hadoop60 zkdata]$ ls
myid
[hadoop@hadoop60 zkdata]$ echo 1 > myid 
[hadoop@hadoop60 zkdata]$ cat myid 
1

[hadoop@hadoop61 zkdata]$ touch myid
[hadoop@hadoop61 zkdata]$ echo 2 > myid
[hadoop@hadoop61 zkdata]$ cat myid 
2

[hadoop@hadoop62 zkdata]$ touch myid
[hadoop@hadoop62 zkdata]$ echo 2 > myid 
[hadoop@hadoop62 zkdata]$ cat myid 
3

11、测试运行 （1）启动Zookeeper 命令： runRemoteCmd.sh “/home/hadoop/app/zookeeper/bin/zkServer.sh start” all

[hadoop@hadoop60 ~]$ runRemoteCmd.sh "/home/hadoop/app/zookeeper/bin/zkServer.sh start" all
*******************hadoop60***********************
ZooKeeper JMX enabled by default
Using config: /home/hadoop/app/zookeeper/bin/../conf/zoo.cfg
Starting zookeeper ... STARTED
*******************hadoop61***********************
ZooKeeper JMX enabled by default
Using config: /home/hadoop/app/zookeeper/bin/../conf/zoo.cfg
Starting zookeeper ... STARTED
*******************hadoop62***********************
ZooKeeper JMX enabled by default
Using config: /home/hadoop/app/zookeeper/bin/../conf/zoo.cfg
Starting zookeeper ... STARTED

（2）查看ZooKeeper状态

注：集群中有一个leader，多个follower，说明ZooKeeper集群状态是OK的

命令：== runRemoteCmd.sh “/home/hadoop/app/zookeeper/bin/zkServer.sh status” all==

[hadoop@hadoop60 ~]$ runRemoteCmd.sh "/home/hadoop/app/zookeeper/bin/zkServer.sh status" all
*******************hadoop60***********************
ZooKeeper JMX enabled by default
Using config: /home/hadoop/app/zookeeper/bin/../conf/zoo.cfg
Client port found: 2181. Client address: localhost.
Mode: follower
*******************hadoop61***********************
ZooKeeper JMX enabled by default
Using config: /home/hadoop/app/zookeeper/bin/../conf/zoo.cfg
Client port found: 2181. Client address: localhost.
Mode: leader
*******************hadoop62***********************
ZooKeeper JMX enabled by default
Using config: /home/hadoop/app/zookeeper/bin/../conf/zoo.cfg
Client port found: 2181. Client address: localhost.
Mode: follower

（3）查看ZooKeeper本身的数据结构，即本身有哪些目录

[hadoop@hadoop60 zookeeper]$ bin/zkCli.sh 
Connecting to localhost:2181
log4j:WARN No appenders could be found for logger (org.apache.zookeeper.ZooKeeper).
log4j:WARN Please initialize the log4j system properly.
log4j:WARN See http://logging.apache.org/log4j/1.2/faq.html#noconfig for more info.
Welcome to ZooKeeper!
JLine support is enabled

WATCHER::

WatchedEvent state:SyncConnected type:None path:null
[zk: localhost:2181(CONNECTED) 0] ls
ls [-s] [-w] [-R] path

注：待会安装hadoop集群，里面一些原数据信息都会存在ZooKeep目录数里面