USDP使用笔记(一) 制作Centos7.6大数据集群虚拟机
制作7台虚拟机,准备安装大数据USDP集群
·
前言
本次制作7台虚拟机,用于部署USDP大数据双集群。
Vmware配置
网卡配置
安装Master节点的zhiyong1
硬盘尽量分给/的根目录。
配置静态IP
[root@zhiyong1 ~]# cd /etc/sysconfig/network-scripts/
[root@zhiyong1 network-scripts]# cat ifcfg-ens33
TYPE="Ethernet"
PROXY_METHOD="none"
BROWSER_ONLY="no"
BOOTPROTO="static"
DEFROUTE="yes"
IPV4_FAILURE_FATAL="no"
IPV6INIT="yes"
IPV6_AUTOCONF="yes"
IPV6_DEFROUTE="yes"
IPV6_FAILURE_FATAL="no"
IPV6_ADDR_GEN_MODE="stable-privacy"
NAME="ens33"
UUID="f328c253-a094-4151-bbad-af3491690887"
DEVICE="ens33"
ONBOOT="yes"
IPADDR="192.168.88.100"
GATEWAY="192.168.88.2"
NETMASK="255.255.255.0"
DNS1="8.8.8.8"
DNS2="144.144.144.144"
IPV6_PRIVACY="no"
[root@zhiyong1 network-scripts]# systemctl restart network
[root@zhiyong1 network-scripts]# ifconfig
ens33: flags=4163<UP,BROADCAST,RUNNING,MULTICAST> mtu 1500
inet 192.168.88.100 netmask 255.255.255.0 broadcast 192.168.88.255
inet6 fe80::316d:bc23:d637:9d86 prefixlen 64 scopeid 0x20<link>
ether 00:0c:29:ca:e8:cc txqueuelen 1000 (Ethernet)
RX packets 345 bytes 33709 (32.9 KiB)
RX errors 0 dropped 0 overruns 0 frame 0
TX packets 334 bytes 37763 (36.8 KiB)
TX errors 0 dropped 0 overruns 0 carrier 0 collisions 0
lo: flags=73<UP,LOOPBACK,RUNNING> mtu 65536
inet 127.0.0.1 netmask 255.0.0.0
inet6 ::1 prefixlen 128 scopeid 0x10<host>
loop txqueuelen 1000 (Local Loopback)
RX packets 0 bytes 0 (0.0 B)
RX errors 0 dropped 0 overruns 0 frame 0
TX packets 0 bytes 0 (0.0 B)
TX errors 0 dropped 0 overruns 0 carrier 0 collisions 0
https://docs.ucloud.cn/usdp_community/2.0.x/release_notes
https://blog.csdn.net/wypblog/article/details/118716077
安装Worker节点的zhiyong2:
硬盘尽量分给/的根目录。
虚拟机克隆
克隆出zhiyong3->zhiyong7共5台VMware虚拟机,方便使用MobaXterm修改配置。依次修改zhiyong3->zhiyong7的IP、host:
[root@zhiyong2 ~]# cat /etc/hostname
zhiyong3
[root@zhiyong2 ~]# reboot
[root@zhiyong3 ~]# cd /etc/sysconfig/network-scripts/
[root@zhiyong3 network-scripts]# vim ifcfg-ens33
vim修改为:
TYPE=Ethernet
PROXY_METHOD=none
BROWSER_ONLY=no
BOOTPROTO=static
DEFROUTE=yes
IPV4_FAILURE_FATAL=no
IPV6INIT=yes
IPV6_AUTOCONF=yes
IPV6_DEFROUTE=yes
IPV6_FAILURE_FATAL=no
IPV6_ADDR_GEN_MODE=stable-privacy
NAME=ens33
UUID=60bd7c41-3d6a-428d-82e8-2bf767d9c201 #这个要改
DEVICE=ens33
ONBOOT=yes
IPADDR=192.168.88.102 #这个要改
GATEWAY=192.168.88.2
NETMASK=255.255.255.0
DNS1=8.8.8.8
重启网络:
[root@zhiyong3 network-scripts]# systemctl restart network
#更换连接信息后才能连上
[root@zhiyong3 ~]# ifconfig
ens33: flags=4163<UP,BROADCAST,RUNNING,MULTICAST> mtu 1500
inet 192.168.88.102 netmask 255.255.255.0 broadcast 192.168.88.255
inet6 fe80::4237:914c:f7f:81ab prefixlen 64 scopeid 0x20<link>
ether 00:0c:29:17:a0:58 txqueuelen 1000 (Ethernet)
RX packets 367 bytes 39985 (39.0 KiB)
RX errors 0 dropped 0 overruns 0 frame 0
TX packets 334 bytes 45258 (44.1 KiB)
TX errors 0 dropped 0 overruns 0 carrier 0 collisions 0
lo: flags=73<UP,LOOPBACK,RUNNING> mtu 65536
inet 127.0.0.1 netmask 255.0.0.0
inet6 ::1 prefixlen 128 scopeid 0x10<host>
loop txqueuelen 1000 (Local Loopback)
RX packets 32 bytes 2592 (2.5 KiB)
RX errors 0 dropped 0 overruns 0 frame 0
TX packets 32 bytes 2592 (2.5 KiB)
TX errors 0 dropped 0 overruns 0 carrier 0 collisions 0
[root@zhiyong3 ~]# ping www.baidu.com
PING www.wshifen.com (103.235.46.39) 56(84) bytes of data.
64 bytes from 103.235.46.39 (103.235.46.39): icmp_seq=1 ttl=128 time=42.4 ms
64 bytes from 103.235.46.39 (103.235.46.39): icmp_seq=2 ttl=128 time=44.3 ms
64 bytes from 103.235.46.39 (103.235.46.39): icmp_seq=3 ttl=128 time=41.0 ms
64 bytes from 103.235.46.39 (103.235.46.39): icmp_seq=4 ttl=128 time=41.2 ms
64 bytes from 103.235.46.39 (103.235.46.39): icmp_seq=5 ttl=128 time=41.0 ms
64 bytes from 103.235.46.39 (103.235.46.39): icmp_seq=6 ttl=128 time=41.3 ms
64 bytes from 103.235.46.39 (103.235.46.39): icmp_seq=7 ttl=128 time=40.6 ms
64 bytes from 103.235.46.39 (103.235.46.39): icmp_seq=8 ttl=128 time=40.7 ms
64 bytes from 103.235.46.39 (103.235.46.39): icmp_seq=9 ttl=128 time=42.2 ms
64 bytes from 103.235.46.39 (103.235.46.39): icmp_seq=10 ttl=128 time=42.0 ms
64 bytes from 103.235.46.39 (103.235.46.39): icmp_seq=11 ttl=128 time=42.1 ms
^C
--- www.wshifen.com ping statistics ---
11 packets transmitted, 11 received, 0% packet loss, time 10132ms
rtt min/avg/max/mdev = 40.662/41.772/44.388/1.046 ms
尾言
还是低估了USDP对性能的要求。
后来更改为zhiyong2->zhiyong4为32G内存,以便组件全开,作为主力集群。
zhiyong5->zhiyong7依旧为16G内存,只开启必要的Zookeeper、HDFS、HBase、Hive等组件,当备用集群。
更多推荐
已为社区贡献7条内容
所有评论(0)