openshift 4 kvm+ovs install

Posted 2020-12-13 wandering-star

https://github.com/wangzheng422/docker_env/blob/master/redhat/ocp4/4.4/4.4.ovs.md

openshift 4 kvm+ovs install

openshift4在日常的安装场景中，有这样一个情况，就是需要在多台配置小一些的主机上，实现跨主机的集群安装，这就需要多个kvm跨主机通讯，本来使用bridge方式，搭配可直连的ip地址，是可以满足的，但是由于ip地址管理的限制，我们没有可以直连的ip地址，那么我们就需要ovs+vxlan的方式，来解决这个问题。

本文模拟2台主机，讲述如何配置ovs，以及如何启动kvm。

参考资料：

• https://stackoverflow.com/questions/30622680/kvm-ovs-bridged-network-how-to-configure
• https://stackoverflow.com/questions/31566658/setup-private-networking-between-two-hosts-and-two-vms-with-libvirt-openvswitc
• https://blog.csdn.net/wuliangtianzu/article/details/81870551
• https://pinrojas.com/2017/05/03/how-to-use-virt-install-to-connect-at-openvswitch-bridges/
• https://www.jianshu.com/p/658332deac99
• https://developer.gnome.org/NetworkManager/stable/nm-openvswitch.html

mtu 调整：

• https://www.cnblogs.com/JacZhu/p/11006738.html
• https://stackoom.com/question/3gFcR/无法在OVS隧道中捕获大于MTU-的流量
• https://serverfault.com/questions/680635/mtu-on-open-vswitch-bridge-port
• https://stackoverflow.com/questions/54398827/unable-to-capture-traffic-greater-than-mtu-1500-in-ovs-tunnel

vxlan

• https://blog.csdn.net/a363344923/article/details/98033856
• https://prolinuxhub.com/configure-start-up-scripts-for-ovs-on-centos-and-red-hat/

on redhat-01

yum -y install openvswitch2.11 NetworkManager-ovs
# install pkg for vnc and kvm

systemctl enable --now openvswitch
systemctl status openvswitch

systemctl enable --now libvirtd

cat << ‘EOF‘ > /etc/sysconfig/network-scripts/ifcfg-br-int 
DEVICE=br-int
ONBOOT=yes
DEVICETYPE=ovs
TYPE=OVSBridge
BOOTPROTO=static
HOTPLUG=no
IPADDR=192.168.7.1
PREFIX=24
MTU=1450
EOF

cat << ‘EOF‘ > /etc/sysconfig/network-scripts/ifcfg-vxlan1
DEVICE=vxlan1
ONBOOT=yes
DEVICETYPE=ovs
TYPE=OVSTunnel
OVS_BRIDGE=br-int
OVS_TUNNEL_TYPE=vxlan
OVS_TUNNEL_OPTIONS="options:remote_ip=172.29.159.100"
BOOTPROTO=static
HOTPLUG=no
EOF

systemctl restart network

ovs-vsctl show

ovs-vsctl set int br-int mtu_request=1450
# ovs-vsctl set int br-int mtu_request=[]

mkdir -p /data/kvm
cd /data/kvm

cat << ‘EOF‘ > ovsnet.xml
<network>
  <name>br-int</name>
  <forward mode=‘bridge‘/>
  <bridge name=‘br-int‘/>
  <virtualport type=‘openvswitch‘/>
</network>
EOF

virsh net-define ovsnet.xml
virsh net-start br-int
virsh net-autostart br-int

on redhat-02

 
yum -y install openvswitch2.11 NetworkManager-ovs
# install pkg for vnc and kvm

systemctl enable --now openvswitch
systemctl status openvswitch

systemctl enable --now libvirtd

ovs-vsctl show

cat << ‘EOF‘ > /etc/sysconfig/network-scripts/ifcfg-br-int 
DEVICE=br-int
ONBOOT=yes
DEVICETYPE=ovs
TYPE=OVSBridge
BOOTPROTO=static
HOTPLUG=no
IPADDR=192.168.7.2
PREFIX=24
MTU=1450
EOF

cat << ‘EOF‘ > /etc/sysconfig/network-scripts/ifcfg-vxlan1
DEVICE=vxlan1
ONBOOT=yes
DEVICETYPE=ovs
TYPE=OVSTunnel
OVS_BRIDGE=br-int
OVS_TUNNEL_TYPE=vxlan
OVS_TUNNEL_OPTIONS="options:remote_ip=172.29.159.99"
BOOTPROTO=static
HOTPLUG=no
EOF

systemctl restart network

ovs-vsctl show

ovs-vsctl set int br-int mtu_request=1450

mkdir -p /data/kvm
cd /data/kvm

cat << ‘EOF‘ > ovsnet.xml
<network>
  <name>br-int</name>
  <forward mode=‘bridge‘/>
  <bridge name=‘br-int‘/>
  <virtualport type=‘openvswitch‘/>
</network>
EOF

virsh net-define ovsnet.xml
virsh net-start br-int
virsh net-autostart br-int

# restore
virsh net-undefine br-int
virsh net-destroy br-int

创建虚拟机

mkdir -p /data/kvm
cd /data/kvm

lvremove -f datavg/helperlv
lvcreate -y -L 230G -n helperlv datavg

# 230G
virt-install --name="ocp4-aHelper" --vcpus=2 --ram=4096 --disk path=/dev/datavg/helperlv,device=disk,bus=virtio,format=raw --os-variant centos7.0 --network network:br-int,model=virtio --boot menu=on --location /data/kvm/rhel-server-7.8-x86_64-dvd.iso --initrd-inject /data/kvm/helper-ks.cfg --extra-args "inst.ks=file:/helper-ks.cfg"