Docker多台宿主机间的容器互联-centos7
2016-03-23 16:28
1121 查看
如果要在生产和测试环境大规模采用docker技术,首先就需要解决不同物理机建的docker容器互联问题。本文介绍在centos7环境下采用open vswitch实现不同物理服务器上的docker容器互联的配置。 环境介绍:Server1: 192.168.115.5/24 Server2: 192.168.115.6/24 一:在Server1和Server2上分别用rpm方式安装docker并启动服务# yum list *docker*
# yum -y install docker
# service docker start
Redirecting to /bin/systemctl start docker.service
![](https://oscdn.geek-share.com/Uploads/Images/Content/201603/1b841431b02fee1686daad3e4cd6f3ef.png)
二: 在Server1和Server2上分别安装open vswitch
# yum -y install wget openssl-devel kernel-devel
# yum groupinstall "Development Tools"
$ wget http://openvswitch.org/releases/openvswitch-2.3.0.tar.gz $ tar -zxvpf openvswitch-2.3.0.tar.gz
$ mkdir -p ~/rpmbuild/SOURCES
$ sed 's/openvswitch-kmod, //g' openvswitch-2.3.0/rhel/openvswitch.spec > openvswitch-2.3.0/rhel/openvswitch_no_kmod.spec
$ cp openvswitch-2.3.0.tar.gz rpmbuild/SOURCES/
$ rpmbuild -bb --without check ~/openvswitch-2.3.0/rhel/openvswitch_no_kmod.spec
$ exit
# yum localinstall ~/rpmbuild/RPMS/x86_64/openvswitch-2.3.0-1.x86_64.rpm
# mkdir /etc/openvswitch
# setenforce 0
# systemctl start openvswitch.service
# systemctl status openvswitch.service -l
![](https://oscdn.geek-share.com/Uploads/Images/Content/201603/96b3713a669d7d846ba1242f3e083170.png)
三:在Server1和Server2上建立OVS Bridge并配置路由修改文件 /etc/docker/daemon.json 添加内容 "bip": "ip/netmask" [ 切勿与宿主机同网段 ] 为172.17.1.1/24
![](https://oscdn.geek-share.com/Uploads/Images/Content/201603/fd921f3ba20e049e91d07baba0629f4d.png)
重启docker服务
Server1: docker容器内网ip网段172.17.1.0/24# cat /proc/sys/net/ipv4/ip_forward
1
# ovs-vsctl add-br obr0
# ovs-vsctl add-port obr0 gre0 -- set Interface gre0 type=gre options:remote_ip=192.168.115.5
# brctl addbr kbr0
# brctl addif kbr0 obr0
# ip link set dev docker0 down
# ip link del dev docker0
# vi /etc/sysconfig/network-scripts/ifcfg-kbr0
DEVICE=kbr0
ONBOOT=yes
BOOTPROTO=static
IPADDR=172.17.1.1
NETMASK=255.255.255.0
GATEWAY=172.17.1.0
USERCTL=no
TYPE=Bridge
IPV6INIT=no
# cat /etc/sysconfig/network-scripts/route-ens32
172.17.2.0/24 via 192.168.115.6 dev ens32
# systemctl restart network.service
![](https://oscdn.geek-share.com/Uploads/Images/Content/201603/164fdc92eac8dccc7f612d25429c31ce.png)
修改文件 /etc/docker/daemon.json 添加内容 "bip": "ip/netmask" [ 切勿与宿主机同网段 ] 为172.17.2.1/24重启docker服务
Server2: docker容器内网ip网段172.17.2.0/24# cat /proc/sys/net/ipv4/ip_forward
1
# ovs-vsctl add-br obr0
# ovs-vsctl add-port obr0 gre0 -- set Interface gre0 type=gre options:remote_ip=192.168.115.6
# brctl addbr kbr0
# brctl addif kbr0 obr0
# ip link set dev docker0 down
# ip link del dev docker0
# vi /etc/sysconfig/network-scripts/ifcfg-kbr0
DEVICE=kbr0
ONBOOT=yes
BOOTPROTO=static
IPADDR=172.17.2.1
NETMASK=255.255.255.0
GATEWAY=172.17.2.0
USERCTL=no
TYPE=Bridge
IPV6INIT=no
# cat /etc/sysconfig/network-scripts/route-ens32
172.17.1.0/24 via 192.168.115.5 dev ens32
# systemctl restart network.service
![](https://oscdn.geek-share.com/Uploads/Images/Content/201603/e8ecd62792001f6c1e4610f2f09f6ab8.png)
四:启动容器测试Server1和Server2上修改docker启动的虚拟网卡绑定为kbr0,重启docker进程
![](https://oscdn.geek-share.com/Uploads/Images/Content/201603/3faf1dd029a749fcbfdef68a4b068b59.png)
Server1和Server2上修改docker启动的虚拟网卡绑定为kbr0,重启docker进程
![](https://oscdn.geek-share.com/Uploads/Images/Content/201603/42bd7da6ec4fa0767b800b39c3935f83.png)
Server2:# docker run -idt --name test2 daocloud.io/centos /bin/bash
![](https://oscdn.geek-share.com/Uploads/Images/Content/201603/0c1ddf913fd02d8a33de77b788b223ad.png)
Server1:
![](https://oscdn.geek-share.com/Uploads/Images/Content/201603/2b26a9aa841dbd5126192906e6d4b916.png)
如果ping不同查看宿主机的路由情况route –n是否有对端主机的路由,如果没有手动添加route add –net 172.17.2.0/24 gw 192.168.115.6 即可
# yum -y install docker
# service docker start
Redirecting to /bin/systemctl start docker.service
![](https://oscdn.geek-share.com/Uploads/Images/Content/201603/1b841431b02fee1686daad3e4cd6f3ef.png)
二: 在Server1和Server2上分别安装open vswitch
# yum -y install wget openssl-devel kernel-devel
# yum groupinstall "Development Tools"
$ wget http://openvswitch.org/releases/openvswitch-2.3.0.tar.gz $ tar -zxvpf openvswitch-2.3.0.tar.gz
$ mkdir -p ~/rpmbuild/SOURCES
$ sed 's/openvswitch-kmod, //g' openvswitch-2.3.0/rhel/openvswitch.spec > openvswitch-2.3.0/rhel/openvswitch_no_kmod.spec
$ cp openvswitch-2.3.0.tar.gz rpmbuild/SOURCES/
$ rpmbuild -bb --without check ~/openvswitch-2.3.0/rhel/openvswitch_no_kmod.spec
$ exit
# yum localinstall ~/rpmbuild/RPMS/x86_64/openvswitch-2.3.0-1.x86_64.rpm
# mkdir /etc/openvswitch
# setenforce 0
# systemctl start openvswitch.service
# systemctl status openvswitch.service -l
![](https://oscdn.geek-share.com/Uploads/Images/Content/201603/96b3713a669d7d846ba1242f3e083170.png)
三:在Server1和Server2上建立OVS Bridge并配置路由修改文件 /etc/docker/daemon.json 添加内容 "bip": "ip/netmask" [ 切勿与宿主机同网段 ] 为172.17.1.1/24
![](https://oscdn.geek-share.com/Uploads/Images/Content/201603/fd921f3ba20e049e91d07baba0629f4d.png)
重启docker服务
Server1: docker容器内网ip网段172.17.1.0/24# cat /proc/sys/net/ipv4/ip_forward
1
# ovs-vsctl add-br obr0
# ovs-vsctl add-port obr0 gre0 -- set Interface gre0 type=gre options:remote_ip=192.168.115.5
# brctl addbr kbr0
# brctl addif kbr0 obr0
# ip link set dev docker0 down
# ip link del dev docker0
# vi /etc/sysconfig/network-scripts/ifcfg-kbr0
DEVICE=kbr0
ONBOOT=yes
BOOTPROTO=static
IPADDR=172.17.1.1
NETMASK=255.255.255.0
GATEWAY=172.17.1.0
USERCTL=no
TYPE=Bridge
IPV6INIT=no
# cat /etc/sysconfig/network-scripts/route-ens32
172.17.2.0/24 via 192.168.115.6 dev ens32
# systemctl restart network.service
![](https://oscdn.geek-share.com/Uploads/Images/Content/201603/164fdc92eac8dccc7f612d25429c31ce.png)
修改文件 /etc/docker/daemon.json 添加内容 "bip": "ip/netmask" [ 切勿与宿主机同网段 ] 为172.17.2.1/24重启docker服务
Server2: docker容器内网ip网段172.17.2.0/24# cat /proc/sys/net/ipv4/ip_forward
1
# ovs-vsctl add-br obr0
# ovs-vsctl add-port obr0 gre0 -- set Interface gre0 type=gre options:remote_ip=192.168.115.6
# brctl addbr kbr0
# brctl addif kbr0 obr0
# ip link set dev docker0 down
# ip link del dev docker0
# vi /etc/sysconfig/network-scripts/ifcfg-kbr0
DEVICE=kbr0
ONBOOT=yes
BOOTPROTO=static
IPADDR=172.17.2.1
NETMASK=255.255.255.0
GATEWAY=172.17.2.0
USERCTL=no
TYPE=Bridge
IPV6INIT=no
# cat /etc/sysconfig/network-scripts/route-ens32
172.17.1.0/24 via 192.168.115.5 dev ens32
# systemctl restart network.service
![](https://oscdn.geek-share.com/Uploads/Images/Content/201603/e8ecd62792001f6c1e4610f2f09f6ab8.png)
四:启动容器测试Server1和Server2上修改docker启动的虚拟网卡绑定为kbr0,重启docker进程
![](https://oscdn.geek-share.com/Uploads/Images/Content/201603/3faf1dd029a749fcbfdef68a4b068b59.png)
Server1和Server2上修改docker启动的虚拟网卡绑定为kbr0,重启docker进程
![](https://oscdn.geek-share.com/Uploads/Images/Content/201603/42bd7da6ec4fa0767b800b39c3935f83.png)
Server2:# docker run -idt --name test2 daocloud.io/centos /bin/bash
![](https://oscdn.geek-share.com/Uploads/Images/Content/201603/0c1ddf913fd02d8a33de77b788b223ad.png)
Server1:
![](https://oscdn.geek-share.com/Uploads/Images/Content/201603/2b26a9aa841dbd5126192906e6d4b916.png)
如果ping不同查看宿主机的路由情况route –n是否有对端主机的路由,如果没有手动添加route add –net 172.17.2.0/24 gw 192.168.115.6 即可
相关文章推荐
- centos6.5上安装docker
- docker容器的网络信息查看
- 在windows下的安装Docker的教程
- 8个你可能不知道的Docker知识
- 在Docker中自动化部署Ruby on Rails的教程
- 搭建基于Docker的PHP开发环境的详细教程
- 利用OpenVSwitch在多台主机上部署Docker的教程
- ubuntu14.04+docker的安装及使用
- Docker 清理命令集锦
- 再Docker中架设完整的WordPress站点全攻略
- 基于 Docker 开发 NodeJS 应用
- 使用Docker来加速构建Android应用的基本部署思路解析
- 在Docker上部署Python的Flask框架的教程
- 在Docker上开始部署Python应用的教程
- 详解在Python和IPython中使用Docker
- 使用IPython来操作Docker容器的入门指引
- OSX下brew安装docker(boot2docker)
- docker 设置TLS远程访问
- mesos + marathon + docker部署
- docker-registry server部署