前言

本次制作7台虚拟机,用于部署USDP大数据双集群。

Vmware配置

[外链图片转存失败,源站可能有防盗链机制,建议将图片保存下来直接上传(img-BMhhIyic-1646835689030)(E:\study\Linux\安装Centos7.assets\image-20220226004621649.png)]
在这里插入图片描述

网卡配置

[外链图片转存失败,源站可能有防盗链机制,建议将图片保存下来直接上传(img-KFJxiPLJ-1646835689032)(E:\study\Linux\安装Centos7.assets\image-20220226004409010.png)]

安装Master节点的zhiyong1

[外链图片转存失败,源站可能有防盗链机制,建议将图片保存下来直接上传(img-708Jv8M3-1646835689033)(E:\study\Linux\安装Centos7.assets\image-20220228213624091.png)]
硬盘尽量分给/的根目录。

配置静态IP

[root@zhiyong1 ~]# cd /etc/sysconfig/network-scripts/
[root@zhiyong1 network-scripts]# cat ifcfg-ens33
TYPE="Ethernet"
PROXY_METHOD="none"
BROWSER_ONLY="no"
BOOTPROTO="static"
DEFROUTE="yes"
IPV4_FAILURE_FATAL="no"
IPV6INIT="yes"
IPV6_AUTOCONF="yes"
IPV6_DEFROUTE="yes"
IPV6_FAILURE_FATAL="no"
IPV6_ADDR_GEN_MODE="stable-privacy"
NAME="ens33"
UUID="f328c253-a094-4151-bbad-af3491690887"
DEVICE="ens33"
ONBOOT="yes"
IPADDR="192.168.88.100"
GATEWAY="192.168.88.2"
NETMASK="255.255.255.0"
DNS1="8.8.8.8"
DNS2="144.144.144.144"
IPV6_PRIVACY="no"
[root@zhiyong1 network-scripts]# systemctl restart network
[root@zhiyong1 network-scripts]# ifconfig
ens33: flags=4163<UP,BROADCAST,RUNNING,MULTICAST>  mtu 1500
        inet 192.168.88.100  netmask 255.255.255.0  broadcast 192.168.88.255
        inet6 fe80::316d:bc23:d637:9d86  prefixlen 64  scopeid 0x20<link>
        ether 00:0c:29:ca:e8:cc  txqueuelen 1000  (Ethernet)
        RX packets 345  bytes 33709 (32.9 KiB)
        RX errors 0  dropped 0  overruns 0  frame 0
        TX packets 334  bytes 37763 (36.8 KiB)
        TX errors 0  dropped 0 overruns 0  carrier 0  collisions 0

lo: flags=73<UP,LOOPBACK,RUNNING>  mtu 65536
        inet 127.0.0.1  netmask 255.0.0.0
        inet6 ::1  prefixlen 128  scopeid 0x10<host>
        loop  txqueuelen 1000  (Local Loopback)
        RX packets 0  bytes 0 (0.0 B)
        RX errors 0  dropped 0  overruns 0  frame 0
        TX packets 0  bytes 0 (0.0 B)
        TX errors 0  dropped 0 overruns 0  carrier 0  collisions 0

https://docs.ucloud.cn/usdp_community/2.0.x/release_notes

https://blog.csdn.net/wypblog/article/details/118716077

安装Worker节点的zhiyong2:

[外链图片转存失败,源站可能有防盗链机制,建议将图片保存下来直接上传(img-Yw8NIcuT-1646835689034)(E:\study\Linux\安装Centos7.assets\image-20220228213753898.png)]

硬盘尽量分给/的根目录。

虚拟机克隆

克隆出zhiyong3->zhiyong7共5台VMware虚拟机,方便使用MobaXterm修改配置。依次修改zhiyong3->zhiyong7的IP、host:

[root@zhiyong2 ~]# cat /etc/hostname
zhiyong3
[root@zhiyong2 ~]# reboot
[root@zhiyong3 ~]# cd /etc/sysconfig/network-scripts/
[root@zhiyong3 network-scripts]# vim ifcfg-ens33

vim修改为:

TYPE=Ethernet
PROXY_METHOD=none
BROWSER_ONLY=no
BOOTPROTO=static
DEFROUTE=yes
IPV4_FAILURE_FATAL=no
IPV6INIT=yes
IPV6_AUTOCONF=yes
IPV6_DEFROUTE=yes
IPV6_FAILURE_FATAL=no
IPV6_ADDR_GEN_MODE=stable-privacy
NAME=ens33
UUID=60bd7c41-3d6a-428d-82e8-2bf767d9c201 #这个要改
DEVICE=ens33
ONBOOT=yes
IPADDR=192.168.88.102 #这个要改
GATEWAY=192.168.88.2
NETMASK=255.255.255.0
DNS1=8.8.8.8

重启网络:

[root@zhiyong3 network-scripts]# systemctl restart network

#更换连接信息后才能连上
[root@zhiyong3 ~]# ifconfig
ens33: flags=4163<UP,BROADCAST,RUNNING,MULTICAST>  mtu 1500
        inet 192.168.88.102  netmask 255.255.255.0  broadcast 192.168.88.255
        inet6 fe80::4237:914c:f7f:81ab  prefixlen 64  scopeid 0x20<link>
        ether 00:0c:29:17:a0:58  txqueuelen 1000  (Ethernet)
        RX packets 367  bytes 39985 (39.0 KiB)
        RX errors 0  dropped 0  overruns 0  frame 0
        TX packets 334  bytes 45258 (44.1 KiB)
        TX errors 0  dropped 0 overruns 0  carrier 0  collisions 0

lo: flags=73<UP,LOOPBACK,RUNNING>  mtu 65536
        inet 127.0.0.1  netmask 255.0.0.0
        inet6 ::1  prefixlen 128  scopeid 0x10<host>
        loop  txqueuelen 1000  (Local Loopback)
        RX packets 32  bytes 2592 (2.5 KiB)
        RX errors 0  dropped 0  overruns 0  frame 0
        TX packets 32  bytes 2592 (2.5 KiB)
        TX errors 0  dropped 0 overruns 0  carrier 0  collisions 0

[root@zhiyong3 ~]# ping www.baidu.com
PING www.wshifen.com (103.235.46.39) 56(84) bytes of data.
64 bytes from 103.235.46.39 (103.235.46.39): icmp_seq=1 ttl=128 time=42.4 ms
64 bytes from 103.235.46.39 (103.235.46.39): icmp_seq=2 ttl=128 time=44.3 ms
64 bytes from 103.235.46.39 (103.235.46.39): icmp_seq=3 ttl=128 time=41.0 ms
64 bytes from 103.235.46.39 (103.235.46.39): icmp_seq=4 ttl=128 time=41.2 ms
64 bytes from 103.235.46.39 (103.235.46.39): icmp_seq=5 ttl=128 time=41.0 ms
64 bytes from 103.235.46.39 (103.235.46.39): icmp_seq=6 ttl=128 time=41.3 ms
64 bytes from 103.235.46.39 (103.235.46.39): icmp_seq=7 ttl=128 time=40.6 ms
64 bytes from 103.235.46.39 (103.235.46.39): icmp_seq=8 ttl=128 time=40.7 ms
64 bytes from 103.235.46.39 (103.235.46.39): icmp_seq=9 ttl=128 time=42.2 ms
64 bytes from 103.235.46.39 (103.235.46.39): icmp_seq=10 ttl=128 time=42.0 ms
64 bytes from 103.235.46.39 (103.235.46.39): icmp_seq=11 ttl=128 time=42.1 ms
^C
--- www.wshifen.com ping statistics ---
11 packets transmitted, 11 received, 0% packet loss, time 10132ms
rtt min/avg/max/mdev = 40.662/41.772/44.388/1.046 ms

尾言

还是低估了USDP对性能的要求。
后来更改为zhiyong2->zhiyong4为32G内存,以便组件全开,作为主力集群。
zhiyong5->zhiyong7依旧为16G内存,只开启必要的Zookeeper、HDFS、HBase、Hive等组件,当备用集群。

Logo

华为开发者空间,是为全球开发者打造的专属开发空间,汇聚了华为优质开发资源及工具,致力于让每一位开发者拥有一台云主机,基于华为根生态开发、创新。

更多推荐