USDP使用笔记（一） 制作Centos7.6大数据集群虚拟机

本次制作7台虚拟机，用于部署USDP大数据双集群。

硬盘尽量分给/的根目录。

[root@zhiyong1 ~]# cd /etc/sysconfig/network-scripts/
[root@zhiyong1 network-scripts]# cat ifcfg-ens33
TYPE="Ethernet"
PROXY_METHOD="none"
BROWSER_ONLY="no"
BOOTPROTO="static"
DEFROUTE="yes"
IPV4_FAILURE_FATAL="no"
IPV6INIT="yes"
IPV6_AUTOCONF="yes"
IPV6_DEFROUTE="yes"
IPV6_FAILURE_FATAL="no"
IPV6_ADDR_GEN_MODE="stable-privacy"
NAME="ens33"
UUID="f328c253-a094-4151-bbad-af3491690887"
DEVICE="ens33"
ONBOOT="yes"
IPADDR="192.168.88.100"
GATEWAY="192.168.88.2"
NETMASK="255.255.255.0"
DNS1="8.8.8.8"
DNS2="144.144.144.144"
IPV6_PRIVACY="no"
[root@zhiyong1 network-scripts]# systemctl restart network
[root@zhiyong1 network-scripts]# ifconfig
ens33: flags=4163  mtu 1500
        inet 192.168.88.100  netmask 255.255.255.0  broadcast 192.168.88.255
        inet6 fe80::316d:bc23:d637:9d86  prefixlen 64  scopeid 0x20
        ether 00:0c:29:ca:e8:cc  txqueuelen 1000  (Ethernet)
        RX packets 345  bytes 33709 (32.9 KiB)
        RX errors 0  dropped 0  overruns 0  frame 0
        TX packets 334  bytes 37763 (36.8 KiB)
        TX errors 0  dropped 0 overruns 0  carrier 0  collisions 0

lo: flags=73  mtu 65536
        inet 127.0.0.1  netmask 255.0.0.0
        inet6 ::1  prefixlen 128  scopeid 0x10
        loop  txqueuelen 1000  (Local Loopback)
        RX packets 0  bytes 0 (0.0 B)
        RX errors 0  dropped 0  overruns 0  frame 0
        TX packets 0  bytes 0 (0.0 B)
        TX errors 0  dropped 0 overruns 0  carrier 0  collisions 0

https://docs.ucloud.cn/usdp_community/2.0.x/release_notes

https://blog.csdn.net/wypblog/article/details/118716077

硬盘尽量分给/的根目录。

克隆出zhiyong3->zhiyong7共5台VMware虚拟机，方便使用MobaXterm修改配置。依次修改zhiyong3->zhiyong7的IP、host：

[root@zhiyong2 ~]# cat /etc/hostname
zhiyong3
[root@zhiyong2 ~]# reboot
[root@zhiyong3 ~]# cd /etc/sysconfig/network-scripts/
[root@zhiyong3 network-scripts]# vim ifcfg-ens33

vim修改为：

TYPE=Ethernet
PROXY_METHOD=none
BROWSER_ONLY=no
BOOTPROTO=static
DEFROUTE=yes
IPV4_FAILURE_FATAL=no
IPV6INIT=yes
IPV6_AUTOCONF=yes
IPV6_DEFROUTE=yes
IPV6_FAILURE_FATAL=no
IPV6_ADDR_GEN_MODE=stable-privacy
NAME=ens33
UUID=60bd7c41-3d6a-428d-82e8-2bf767d9c201 #这个要改
DEVICE=ens33
ONBOOT=yes
IPADDR=192.168.88.102 #这个要改
GATEWAY=192.168.88.2
NETMASK=255.255.255.0
DNS1=8.8.8.8

重启网络：

[root@zhiyong3 network-scripts]# systemctl restart network

#更换连接信息后才能连上
[root@zhiyong3 ~]# ifconfig
ens33: flags=4163  mtu 1500
        inet 192.168.88.102  netmask 255.255.255.0  broadcast 192.168.88.255
        inet6 fe80::4237:914c:f7f:81ab  prefixlen 64  scopeid 0x20
        ether 00:0c:29:17:a0:58  txqueuelen 1000  (Ethernet)
        RX packets 367  bytes 39985 (39.0 KiB)
        RX errors 0  dropped 0  overruns 0  frame 0
        TX packets 334  bytes 45258 (44.1 KiB)
        TX errors 0  dropped 0 overruns 0  carrier 0  collisions 0

lo: flags=73  mtu 65536
        inet 127.0.0.1  netmask 255.0.0.0
        inet6 ::1  prefixlen 128  scopeid 0x10
        loop  txqueuelen 1000  (Local Loopback)
        RX packets 32  bytes 2592 (2.5 KiB)
        RX errors 0  dropped 0  overruns 0  frame 0
        TX packets 32  bytes 2592 (2.5 KiB)
        TX errors 0  dropped 0 overruns 0  carrier 0  collisions 0

[root@zhiyong3 ~]# ping www.baidu.com
PING www.wshifen.com (103.235.46.39) 56(84) bytes of data.
64 bytes from 103.235.46.39 (103.235.46.39): icmp_seq=1 ttl=128 time=42.4 ms
64 bytes from 103.235.46.39 (103.235.46.39): icmp_seq=2 ttl=128 time=44.3 ms
64 bytes from 103.235.46.39 (103.235.46.39): icmp_seq=3 ttl=128 time=41.0 ms
64 bytes from 103.235.46.39 (103.235.46.39): icmp_seq=4 ttl=128 time=41.2 ms
64 bytes from 103.235.46.39 (103.235.46.39): icmp_seq=5 ttl=128 time=41.0 ms
64 bytes from 103.235.46.39 (103.235.46.39): icmp_seq=6 ttl=128 time=41.3 ms
64 bytes from 103.235.46.39 (103.235.46.39): icmp_seq=7 ttl=128 time=40.6 ms
64 bytes from 103.235.46.39 (103.235.46.39): icmp_seq=8 ttl=128 time=40.7 ms
64 bytes from 103.235.46.39 (103.235.46.39): icmp_seq=9 ttl=128 time=42.2 ms
64 bytes from 103.235.46.39 (103.235.46.39): icmp_seq=10 ttl=128 time=42.0 ms
64 bytes from 103.235.46.39 (103.235.46.39): icmp_seq=11 ttl=128 time=42.1 ms
^C
--- www.wshifen.com ping statistics ---
11 packets transmitted, 11 received, 0% packet loss, time 10132ms
rtt min/avg/max/mdev = 40.662/41.772/44.388/1.046 ms

还是低估了USDP对性能的要求。
后来更改为zhiyong2->zhiyong4为32G内存，以便组件全开，作为主力集群。
zhiyong5->zhiyong7依旧为16G内存，只开启必要的Zookeeper、HDFS、Hbase、Hive等组件，当备用集群。