CentOS7下分布式系统GlusterFS安装配置

Posted 2020-08-31

一、主机规划

操作系统版本为CentOS 7.2.1511

node1:172.17.0.1 gfs1

node2:172.17.0.2 gfs2

node3:172.17.0.3 gfs3

node4:172.17.0.4 gfs

client:172.17.0.5 

二、安装：

1.在node1-4上安装glusterfs-server

yum install -y centos-release-gluster38

yum install -y glusterfs glusterfs-server glusterfs-fuse

设置开机自启动并启动

systemctl enable glusterd.service

systemctl start glusterd.service

2.在gfs1-gfs4节点上配置整个GlusterFS集群，把各个节点加入到集群

vim /etc/hosts

127.0.0.1   localhost localhost.localdomain localhost4 localhost4.localdomain4

::1         localhost localhost.localdomain localhost6 localhost6.localdomain6

172.17.0.1  gfs1

172.17.0.2  gfs2

172.17.0.3  gfs3

172.17.0.4  gfs4

[[email protected] ~]# gluster peer probe gfs1

[[email protected] ~]# gluster peer probe gfs2

[[email protected] ~]# gluster peer probe gfs3

[[email protected] ~]# gluster peer probe gfs4

3.查看节点状态

[[email protected] ~]#gluster peer status

4.在gfs{1-4}上创建数据存储目录

# mkdir -p  /usr/local/share/models

5.在gfs1上创建GlusterFS磁盘

注意：

加上replica 4就是4个节点中，每个节点都要把数据存储一次，就是一个数据存储4份，每个节点一份

如果不加replica 4，就是4个节点的磁盘空间整合成一个硬盘，

[[email protected] ~]#gluster volume create models replica 4 gfs1:/usr/local/share/models gfs2:/usr/local/share/models gfs3:/usr/local/share/models gfs4:/usr/local/share/models force

6.启动

[[email protected] ~]# gluster volume start models

客户端

1.部署GlusterFS客户端并mount GlusterFS文件系统

[[email protected] ~]# yum install -y centos-release-gluster38

[[email protected] ~]# yum install -y glusterfs glusterfs-fuse

[[email protected] ~]# mkdir -p /mnt/models

[[email protected] ~]# mount -t glusterfs -o ro gfs1:models /mnt/models/

2.查看效果

[[email protected] ~]# df -h

3.观察分布式文件系统的效果

umount /mnt/models

mount -t glusterfs -o rw gfs1:models /mnt/models/

[[email protected] ~]# cd /mnt/models/

[[email protected] mnt]# for i in `seq -w 10`; do mkdir $i ; done

[[email protected] models]# for i in `seq -w 10`; do mkdir $i ; done

[[email protected] models]# ll

total 40

drwxr-xr-x 2 root root 4096 Feb 14 21:56 01

drwxr-xr-x 2 root root 4096 Feb 14 21:59 02

drwxr-xr-x 2 root root 4096 Feb 14 21:56 03

drwxr-xr-x 2 root root 4096 Feb 14 21:56 04

drwxr-xr-x 2 root root 4096 Feb 14 21:56 05

drwxr-xr-x 2 root root 4096 Feb 14 21:56 06

drwxr-xr-x 2 root root 4096 Feb 14 21:59 07

drwxr-xr-x 2 root root 4096 Feb 14 21:56 08

drwxr-xr-x 2 root root 4096 Feb 14 21:56 09

drwxr-xr-x 2 root root 4096 Feb 14 21:59 10

分别在4台Server上查看新建的文件夹同步情况

[[email protected] ~]# ls /usr/local/share/models/ -l

total 0

drwxr-xr-x 2 root root 6 Feb 14 21:56 01

drwxr-xr-x 2 root root 6 Feb 14 21:59 02

drwxr-xr-x 2 root root 6 Feb 14 21:56 03

drwxr-xr-x 2 root root 6 Feb 14 21:56 04

drwxr-xr-x 2 root root 6 Feb 14 21:56 05

drwxr-xr-x 2 root root 6 Feb 14 21:56 06

drwxr-xr-x 2 root root 6 Feb 14 21:59 07

drwxr-xr-x 2 root root 6 Feb 14 21:56 08

drwxr-xr-x 2 root root 6 Feb 14 21:56 09

drwxr-xr-x 2 root root 6 Feb 14 21:59 10

可以看到4台服务器都同步过来了。

当单台Server出现故障，比如服务器断开连接的情况，创建一个文件需要比较长的时间。

但是当Server重新连上之后，文件可以及时的同步过来。

本文出自 “梦想人生” 博客，请务必保留此出处http://hzde0128.blog.51cto.com/918211/1898622