mysql5.6GTID实现主从复制、读写分离

mysql5.6GTID实现主从复制、读写分离

环境：主机1：centos7-master主机2：centos7-slave主机3：sentos6.5-mysql-proxy

一、安装mysql

主机1、主机2分别执行以下命令安装mysql5.61、擦好看系统自带的mysql并卸载

[root@localhost ~]# cat /etc/redhat-releaseCentOS Linux release 7.1.1503 (Core)[root@localhost ~]# rpm -qa | grep  mariadbmariadb-libs-5.5.41-2.el7_0.x86_64[root@localhost ~]# rpm -e --nodeps mariadb-libs-5.5.41-2.el7_0.x86_64

2、下载mysql5.6下载地址：https://edelivery.oracle.com/EPD/Search/handle_go或者百度网盘：http://pan.baidu.com/s/1dDu6n9R3、创建目录、用户并复制相关文件

[root@localhost ~]# mkdir -pv /mydata/data[root@localhost ~]# useradd -r mysql[root@localhost ~]# cd /[root@localhost /]# chown -R mysql:mysql mydata/data/[root@localhost local]# tar xvf mysql-5.6.30-linux-glibc2.5-x86_64.tar.gz -C  /usr/local/[root@localhost local]# ln -sv mysql-5.6.30-linux-glibc2.5-x86_64/ mysql[root@localhost local]# cd mysql[root@localhost mysql]# chown  -R root:mysql ./*[root@localhost mysql]# cp support-files/mysql.server /etc/init.d/mysqld[root@localhost mysql]# cp  support-files/my-default.cnf /etc/my.cnf[root@localhost mysql]# chkconfig  --add mysqld[root@localhost mysql]# ./scripts/mysql_install_db --user=mysql --datadir=/mydata/data --basedir=/usr/local/mysql

二、my.cnf配置

master上my.cnf

[mysqld]binlog-format=ROWlog-bin=master-binlog-slave-updates=truegtid-mode=onenforce-gtid-consistency=truemaster-info-repository=TABLErelay-log-info-repository=TABLEsync-master-info=1slave-parallel-workers=2binlog-checksum=CRC32master-verify-checksum=1slave-sql-verify-checksum=1binlog-rows-query-log_events=1server-id=1report-port=3306port=3306datadir=/mydata/datasocket=/tmp/mysql.sockreport-host=yuan

slave上my.cnf

[mysqld]binlog-format=ROWlog-slave-updates=truegtid-mode=onenforce-gtid-consistency=truemaster-info-repository=TABLErelay-log-info-repository=TABLEsync-master-info=1slave-parallel-workers=2binlog-checksum=CRC32master-verify-checksum=1slave-sql-verify-checksum=1binlog-rows-query-log_events=1server-id=11report-port=3306port=3306log-bin=mysql-bin.logdatadir=/mydata/datasocket=/tmp/mysql.sockreport-host=yuan1#innodb_force_recovery = 1

主授权用户

mysql> show global variables like '%uuid%';mysql> grant REPLICATION SLAVE ON *.* to 'repluser'@'192.168.75.%' IDENTIFIED BY 'asd123';Query OK, 0 rows affected (0.00 sec)mysql> FLUSH PRIVILEGES;

slave连接master

mysql> CHANGE MASTER TO MASTER_HOST='192.168.75.158', MASTER_USER='repluser', MASTER_PASSWORD='asd123',MASTER_AUTO_POSITION=1;查看状态mysql> SHOW SLAVE STATUS\G;启动Slave_IO_Running: YesSlave_SQL_Running: Yesmysql> SHOW SLAVE STATUS\G;

master创建样例数据库

mysql> create database mydb;mysql> show datadbs;mysql> show slave hosts;

三、mysql-proxy安装与配置

1、安装mysql-proxy下载地址http://downloads.mysql.com/archives/get/file/mysql-proxy-0.8.5-linux-el6-x86-32bit.tar.gz主机3上配置

[root@yuan ~]# rpm -qa |grep lua[root@yuan ~]# tar xf mysql-proxy-0.8.5-linux-el6-x86-32bit.tar.gz -C /usr/local/[root@yuan ~]# cd /usr/local/[root@yuan local]# useradd mysql-proxy -r[root@yuan local]# ln -sv mysql-proxy-0.8.5-linux-el6-x86-32bit/ mysql-proxy"mysql-proxy" -> "mysql-proxy-0.8.5-linux-el6-x86-32bit/"[root@yuan mysql-proxy]# .  /etc/profile.d/mysql-proxy.shexport PATH=$PATH:/usr/local/mysql-proxy/bin

复制如下内容建立admin.lua文件，将其保存至/usr/local/mysql-proxy/share/doc/mysql-proxy/目录中。

function set_error(errmsg)proxy.response = {type = proxy.MYSQLD_PACKET_ERR,errmsg = errmsg or "error"}endfunction read_query(packet)if packet:byte() ~= proxy.COM_QUERY thenset_error("[admin] we only handle text-based queries (COM_QUERY)")return proxy.PROXY_SEND_RESULTendlocal query = packet:sub(2)local rows = { }local fields = { }if query:lower() == "select * from backends" thenfields = {{ name = "backend_ndx",type = proxy.MYSQL_TYPE_LONG },{ name = "address",type = proxy.MYSQL_TYPE_STRING },{ name = "state",type = proxy.MYSQL_TYPE_STRING },{ name = "type",type = proxy.MYSQL_TYPE_STRING },{ name = "uuid",type = proxy.MYSQL_TYPE_STRING },{ name = "connected_clients",type = proxy.MYSQL_TYPE_LONG },}for i = 1, #proxy.global.backends dolocal states = {"unknown","up","down"}local types = {"unknown","rw","ro"}local b = proxy.global.backends[i]rows[#rows + 1] = {i,b.dst.name,          -- configured backend addressstates[b.state + 1], -- the C-id is pushed down starting at 0types[b.type + 1],   -- the C-id is pushed down starting at 0b.uuid,              -- the MySQL Server's UUID if it is managedb.connected_clients  -- currently connected clients}endelseif query:lower() == "select * from help" thenfields = {{ name = "command",type = proxy.MYSQL_TYPE_STRING },{ name = "description",type = proxy.MYSQL_TYPE_STRING },}rows[#rows + 1] = { "SELECT * FROM help", "shows this help" }rows[#rows + 1] = { "SELECT * FROM backends", "lists the backends and their state" }elseset_error("use 'SELECT * FROM help' to see the supported commands")return proxy.PROXY_SEND_RESULTendproxy.response = {type = proxy.MYSQLD_PACKET_OK,resultset = {fields = fields,rows = rows}}return proxy.PROXY_SEND_RESULTend

启动

[root@yuan bin]# mysql-proxy --daemon --log-level=debug --log-file=/var/log/mysql-proxy.log --plugins="proxy" --proxy-backend-addresses='192.168.75.158:3306' --proxy-read-only-backend-addresses='192.168.75.172:3306' --proxy-lua-script="/usr/local/mysql-proxy/share/doc/mysql-proxy/rw-splitting.lua" --plugins=admin --admin-username="admin" --admin-password="admin" --admin-lua-script="/usr/local/mysql-proxy/share/doc/mysql-proxy/admin.lua"#查看端口[root@yuan ~]# netstat -ntlpActive Internet connections (only servers)Proto Recv-Q Send-Q Local Address               Foreign Address             State       PID/Program nametcp        0      0 0.0.0.0:4040                0.0.0.0:*                   LISTEN      1873/mysql-proxytcp        0      0 0.0.0.0:4041                0.0.0.0:*                   LISTEN      1873/mysql-proxy[root@yuan bin]# tail /var/log/mysql-proxy.log 

2016-07-22 16:14:13: (critical) mysql-proxy-cli.c:599: Failure from chassis_mainloop. Shutting down.2016-07-22 16:14:13: (message) Initiating shutdown, requested from mysql-proxy-cli.c:6002016-07-22 16:14:13: (message) shutting down normally, exit code is: 12016-07-22 16:19:42: (critical) plugin proxy 0.8.5 started2016-07-22 16:19:42: (critical) plugin admin 0.8.5 started2016-07-22 16:19:42: (debug) max open file-descriptors = 10242016-07-22 16:19:42: (message) proxy listening on port :<span style="color:#ff0000;">4040</span>2016-07-22 16:19:42: (message) added read/write backend: <span style="color:#ff0000;">192.168.75.158:3306</span>2016-07-22 16:19:42: (message) added read-only backend: <span style="color:#ff0000;">192.168.75.172:3306</span>2016-07-22 16:19:42: (message) admin-server listening on port :4041

主上创建可以远程登陆的账号

mysql> grant all on *.* to 'root'@'192.168.%.%' identified by 'hadoop';mysql> show global variables like '%name%';mysql> set @@globbal.skip_name_resolve=ON;

四、测试

主机2上测试，登录代理主机3

[root@centos mysql]# mysql -uadmin  -h192.168.75.185 --port=4041 -padminmysql> select * from backends;+-------------+---------------------+-------+------+------+-------------------+| backend_ndx | address             | state | type | uuid | connected_clients |+-------------+---------------------+-------+------+------+-------------------+|           1 | 192.168.75.158:3306 | up    | rw   | NULL |                 0 ||           2 | 192.168.75.172:3306 | up    | ro   | NULL |                 0 |+-------------+---------------------+-------+------+------+-------------------+2 rows in set (0.00 sec)

[root@centos mysql]# mysql -uroot  -h192.168.75.185 --port=4040 -p

附录以下是mage运维教程笔记MySQL 5.6引入的GTID(Global Transaction IDs)使得其复制功能的配置、监控及管理变得更加易于实现，且更加健壮。要在MySQL 5.6中使用复制功能，其服务配置段[mysqld]中于少应该定义如下选项：binlog-format：二进制日志的格式，有row、statement和mixed几种类型；需要注意的是：当设置隔离级别为READ-COMMITED必须设置二进制日志格式为ROW，现在MySQL官方认为STATEMENT这个已经不再适合继续使用；但mixed类型在默认的事务隔离级别下，可能会导致主从数据不一致；log-slave-updates、gtid-mode、enforce-gtid-consistency、report-port和report-host：用于启动GTID及满足附属的其它需求；master-info-repository和relay-log-info-repository：启用此两项，可用于实现在崩溃时保证二进制及从服务器安全的功能；sync-master-info：启用之可确保无信息丢失；slave-paralles-workers：设定从服务器的SQL线程数；0表示关闭多线程复制功能；binlog-checksum、master-verify-checksum和slave-sql-verify-checksum：启用复制有关的所有校验功能；binlog-rows-query-log-events：启用之可用于在二进制日志记录事件相关的信息，可降低故障排除的复杂度；log-bin：启用二进制日志，这是保证复制功能的基本前提；server-id：同一个复制拓扑中的所有服务器的id号必须惟一；report-host：The host name or IP address of the slave to be reported to the master during slave registration. This value appears in the output of SHOW SLAVE HOSTS on the master server.report-port:The TCP/IP port number for connecting to the slave, to be reported to the master during slave registration.master-info-repository:The setting of this variable determines whether the slave logs master status and connection information to a FILE (master.info), or to a TABLE (mysql.slave_master_info)relay-log-info-repository：This option causes the server to log its relay log info to a file or a table.log_slave_updates：Whether updates received by a slave server from a master server should be logged to the slave's own binary log. Binary logging must be enabled on the slave for this variable to have any effect.enforce_gtid_consistency：一、简单主从模式配置步骤1、配置主从节点的服务配置文件1.1、配置master节点：[mysqld]binlog-format=ROWlog-bin=master-binlog-slave-updates=truegtid-mode=onenforce-gtid-consistency=truemaster-info-repository=TABLErelay-log-info-repository=TABLEsync-master-info=1slave-parallel-workers=2binlog-checksum=CRC32master-verify-checksum=1slave-sql-verify-checksum=1binlog-rows-query-log_events=1server-id=1report-port=3306port=3306datadir=/mydata/datasocket=/tmp/mysql.sockreport-host=master.magedu.com1.2、配置slave节点：[mysqld]binlog-format=ROWlog-slave-updates=truegtid-mode=onenforce-gtid-consistency=truemaster-info-repository=TABLErelay-log-info-repository=TABLEsync-master-info=1slave-parallel-workers=2binlog-checksum=CRC32master-verify-checksum=1slave-sql-verify-checksum=1binlog-rows-query-log_events=1server-id=11report-port=3306port=3306log-bin=mysql-bin.logdatadir=/mydata/datasocket=/tmp/mysql.sockreport-host=slave.magedu.cominnodb_force_recovery = 12、创建复制用户mysql> GRANT REPLICATION SLAVE ON *.* TO repluser@172.16.100.7 IDENTIFIED BY 'replpass';说明：172.16.100.7是从节点服务器；如果想一次性授权更多的节点，可以自行根据需要修改；3、为备节点提供初始数据集锁定主表，备份主节点上的数据，将其还原至从节点；如果没有启用GTID，在备份时需要在master上使用show master status命令查看二进制日志文件名称及事件位置，以便后面启动slave节点时使用。4、启动从节点的复制线程如果启用了GTID功能，则使用如下命令：mysql> CHANGE MASTER TO MASTER_HOST='master.magedu.com', MASTER_USER='repluser', MASTER_PASSWORD='replpass', MASTER_AUTO_POSITION=1;没启用GTID，需要使用如下命令：slave> CHANGE MASTER TO MASTER_HOST='172.16.100.6',-> MASTER_USER='repluser',-> MASTER_PASSWORD='replpass',-> MASTER_LOG_FILE='master-bin.000003',-> MASTER_LOG_POS=1174;二、半同步复制1、分别在主从节点上安装相关的插件master> INSTALL PLUGIN rpl_semi_sync_master SONAME 'semisync_master.so';slave> INSTALL PLUGIN rpl_semi_sync_slave SONAME 'semisync_slave.so';2、启用半同步复制在master上的配置文件中，添加rpl_semi_sync_master_enabled=ON在至少一个slave节点的配置文件中添加rpl_semi_sync_slave_enabled=ON而后重新启动mysql服务即可生效。或者，也可以mysql服务上动态启动其相关功能：master> SET GLOBAL rpl_semi_sync_master_enabled = ON;slave> SET GLOBAL rpl_semi_sync_slave_enabled = ON;slave> STOP SLAVE IO_THREAD; START SLAVE IO_THREAD;3、确认半同步功能已经启用master> CREATE DATABASE magedudb;master> SHOW STATUS LIKE 'Rpl_semi_sync_master_yes_tx';slave> SHOW DATABASES;三、MySQL Proxy1、源码安装时，MySQL proxy的依赖关系：libevent 1.x or higher (1.3b or later is preferred).lua 5.1.x or higher.glib2 2.6.0 or higher.pkg-config.libtool 1.5 or higher.MySQL 5.0.x or higher developer files.2、安装# tar zxf mysql-proxy-0.8.2.tar.gz# cd mysql-proxy-0.8.2# ./configure# make# make check如果管理员有密码，上面的步骤则需要使用如下格式进行：# MYSQL_PASSWORD=root_pwd make check# make install默认情况下， mysql-proxy安装在/usr/local/sbin/mysql-proxy，而Lua示例脚本安装在/usr/local/share目录中。3、配置指令mysql proxy的各配置参数请参见官方文档，http://dev.mysql.com/doc/refman/5.6/en/mysql-proxy-configuration.html使用rpm包在rhel6上安装mysql-proxy-0.8.2，其会提供配置文件及服务脚本，但没有提供读写分享的脚本。/etc/sysconfig/mysql-proxy文件用于定义mysql-proxy的启动参数。ADMIN_USER – the user for the proxy's admin interface. You can leave the default admin user.ADMIN_PASSWORD – the password for the admin user in clear text. Change the default password for better security.ADMIN_LUA_SCRIPT – the admin script in the Lua programming language. Without this script the admin interface cannot work. You can leave the default value.PROXY_USER – the system user under which the proxy will work. By default it is mysql-proxy, and it's safe to leave it as is.PROXY_OPTIONS – proxy options such as logging level, plugins, and Lua scripts to be loaded.其中PROXY_OPTIONS是最常用的一个选项，用于定义mysql-proxy工作时的重要参数，例如：PROXY_OPTIONS="--daemon --log-level=info --log-use-syslog --plugins=proxy --plugins=admin --proxy-backend-addresses=192.168.1.102:3306 --proxy-read-only-backend-addresses=192.168.1.105:3306 --proxy-lua-script=/usr/lib/mysql-proxy/lua/proxy/rw-splitting.lua"四、安装配置mysql-proxy:4.1 下载所需要的版本，这里的系统平台为rhel6.4 32位系统，因此就以mysql-proxy-0.8.3-linux-glibc2.3-x86-32bit.tar.gz为例。# tar xf mysql-proxy-0.8.3-linux-glibc2.3-x86-32bit.tar.gz -C /usr/local# cd /usr/local# ln -sv mysql-proxy-0.8.3-linux-glibc2.3-x86-32bit mysql-proxy添加代理用户# useradd mysql-proxy4.2 为mysql-proxy提供SysV服务脚本，内容如下所示#!/bin/bash## mysql-proxy This script starts and stops the mysql-proxy daemon## chkconfig: - 78 30# processname: mysql-proxy# description: mysql-proxy is a proxy daemon for mysql# Source function library.. /etc/rc.d/init.d/functionsprog="/usr/local/mysql-proxy/bin/mysql-proxy"# Source networking configuration.if [ -f /etc/sysconfig/network ]; then. /etc/sysconfig/networkfi# Check that networking is up.[ ${NETWORKING} = "no" ] && exit 0# Set default mysql-proxy configuration.ADMIN_USER="admin"ADMIN_PASSWD="admin"ADMIN_LUA_SCRIPT="/usr/local/mysql-proxy/share/doc/mysql-proxy/admin.lua"PROXY_OPTIONS="--daemon"PROXY_PID=/var/run/mysql-proxy.pidPROXY_USER="mysql-proxy"# Source mysql-proxy configuration.if [ -f /etc/sysconfig/mysql-proxy ]; then. /etc/sysconfig/mysql-proxyfiRETVAL=0start() {echo -n $"Starting $prog: "daemon $prog $PROXY_OPTIONS --pid-file=$PROXY_PID --log-level=debug --log-file=/var/log/mysql-proxy.log --proxy-address="$PROXY_ADDRESS" --user=$PROXY_USER --admin-username="$ADMIN_USER" --admin-lua-script="$ADMIN_LUA_SCRIPT" --admin-password="$ADMIN_PASSWORD"RETVAL=$?echoif [ $RETVAL -eq 0 ]; thentouch /var/lock/subsys/mysql-proxyfi}stop() {echo -n $"Stopping $prog: "killproc -p $PROXY_PID -d 3 $progRETVAL=$?echoif [ $RETVAL -eq 0 ]; thenrm -f /var/lock/subsys/mysql-proxyrm -f $PROXY_PIDfi}# See how we were called.case "$1" instart)start;;stop)stop;;restart)stopstart;;condrestart|try-restart)if status -p $PROXY_PIDFILE $prog >&/dev/null; thenstopstartfi;;status)status -p $PROXY_PID $prog;;*)echo "Usage: $0 {start|stop|restart|reload|status|condrestart|try-restart}"RETVAL=1;;esacexit $RETVAL将上述内容保存为/etc/rc.d/init.d/mysql-proxy，给予执行权限，而后加入到服务列表。# chmod +x /etc/rc.d/init.d/mysql-proxy# chkconfig --add mysql-proxy4.3 为服务脚本提供配置文件/etc/sysconfig/mysql-proxy，内容如下所示：# Options for mysql-proxyADMIN_USER="admin"ADMIN_PASSWORD="admin"ADMIN_ADDRESS=""ADMIN_LUA_SCRIPT="/usr/local/mysql-proxy/share/doc/mysql-proxy/admin.lua"PROXY_ADDRESS=""PROXY_USER="mysql-proxy"PROXY_OPTIONS="--daemon --log-level=info --log-use-syslog"其中最后一行，需要按实际场景进行修改，例如：PROXY_OPTIONS="--daemon --log-level=info --log-use-syslog --plugins=proxy --plugins=admin --proxy-backend-addresses=172.16.100.6:3306 --proxy-read-only-backend-addresses=172.16.100.7:3306 --proxy-lua-script=/usr/local/mysql-proxy/share/doc/mysql-proxy/rw-splitting.lua"其中的proxy-backend-addresses选项和proxy-read-only-backend-addresses选项均可重复使用多次，以实现指定多个读写服务器或只读服务器。4.4 mysql-proxy的配置选项mysql-proxy的配置选项大致可分为帮助选项、管理选项、代理选项及应用程序选项几类，下面一起去介绍它们。--help--help-admin--help-proxy--help-all ———— 以上四个选项均用于获取帮助信息；--proxy-address=host:port ———— 代理服务监听的地址和端口；--admin-address=host:port ———— 管理模块监听的地址和端口；--proxy-backend-addresses=host:port ———— 后端mysql服务器的地址和端口；--proxy-read-only-backend-addresses=host:port ———— 后端只读mysql服务器的地址和端口；--proxy-lua-script=file_name ———— 完成mysql代理功能的Lua脚本；--daemon ———— 以守护进程模式启动mysql-proxy；--keepalive ———— 在mysql-proxy崩溃时尝试重启之；--log-file=/path/to/log_file_name ———— 日志文件名称；--log-level=level ———— 日志级别；--log-use-syslog ———— 基于syslog记录日志；--plugins=plugin,.. ———— 在mysql-proxy启动时加载的插件；--user=user_name ———— 运行mysql-proxy进程的用户；--defaults-file=/path/to/conf_file_name ———— 默认使用的配置文件路径；其配置段使用[mysql-proxy]标识；--proxy-skip-profiling ———— 禁用profile；--pid-file=/path/to/pid_file_name ———— 进程文件名；5、复制如下内容建立admin.lua文件，将其保存至/usr/local/mysql-proxy/share/doc/mysql-proxy/目录中。--[[ $%BEGINLICENSE%$Copyright (c) 2007, 2012, Oracle and/or its affiliates. All rights reserved.This program is free software; you can redistribute it and/ormodify it under the terms of the GNU General Public License aspublished by the Free Software Foundation; version 2 of theLicense.This program is distributed in the hope that it will be useful,but WITHOUT ANY WARRANTY; without even the implied warranty ofMERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See theGNU General Public License for more details.You should have received a copy of the GNU General Public Licensealong with this program; if not, write to the Free SoftwareFoundation, Inc., 51 Franklin St, Fifth Floor, Boston, MA02110-1301 USA$%ENDLICENSE%$ --]]function set_error(errmsg)proxy.response = {type = proxy.MYSQLD_PACKET_ERR,errmsg = errmsg or "error"}endfunction read_query(packet)if packet:byte() ~= proxy.COM_QUERY thenset_error("[admin] we only handle text-based queries (COM_QUERY)")return proxy.PROXY_SEND_RESULTendlocal query = packet:sub(2)local rows = { }local fields = { }if query:lower() == "select * from backends" thenfields = {{ name = "backend_ndx",type = proxy.MYSQL_TYPE_LONG },{ name = "address",type = proxy.MYSQL_TYPE_STRING },{ name = "state",type = proxy.MYSQL_TYPE_STRING },{ name = "type",type = proxy.MYSQL_TYPE_STRING },{ name = "uuid",type = proxy.MYSQL_TYPE_STRING },{ name = "connected_clients",type = proxy.MYSQL_TYPE_LONG },}for i = 1, #proxy.global.backends dolocal states = {"unknown","up","down"}local types = {"unknown","rw","ro"}local b = proxy.global.backends[i]rows[#rows + 1] = {i,b.dst.name, -- configured backend addressstates[b.state + 1], -- the C-id is pushed down starting at 0types[b.type + 1], -- the C-id is pushed down starting at 0b.uuid, -- the MySQL Server's UUID if it is managedb.connected_clients -- currently connected clients}endelseif query:lower() == "select * from help" thenfields = {{ name = "command",type = proxy.MYSQL_TYPE_STRING },{ name = "description",type = proxy.MYSQL_TYPE_STRING },}rows[#rows + 1] = { "SELECT * FROM help", "shows this help" }rows[#rows + 1] = { "SELECT * FROM backends", "lists the backends and their state" }elseset_error("use 'SELECT * FROM help' to see the supported commands")return proxy.PROXY_SEND_RESULTendproxy.response = {type = proxy.MYSQLD_PACKET_OK,resultset = {fields = fields,rows = rows}}return proxy.PROXY_SEND_RESULTend6、测试6.1 管理功能测试# mysql -uadmin -padmin -h172.16.100.107 --port=4041Welcome to the MySQL monitor. Commands end with ; or \g.Your MySQL connection id is 1Server version: 5.0.99-agent-adminType 'help;' or '\h' for help. Type '\c' to clear the buffer.mysql> SELECT * FROM backends;+-------------+-------------------+-------+------+------+-------------------+| backend_ndx | address | state | type | uuid | connected_clients |+-------------+-------------------+-------+------+------+-------------------+| 1 | 172.16.100.6:3306 | up | rw | NULL | 0 || 2 | 172.16.100.7:3306 | up | ro | NULL | 0 |+-------------+-------------------+-------+------+------+-------------------+2 rows in set (0.00 sec)6.2 读写分离测试# mysql -uroot -pmagedu.com -h172.16.100.107 --port=4040下面的读写分享脚本是由mysql-proxy-0.8.3提供了，将其复制保存为/usr/lib/mysql-proxy/lua/proxy/rw-splitting.lua，就可以启动服务了。--[[ $%BEGINLICENSE%$Copyright (c) 2007, 2012, Oracle and/or its affiliates. All rights reserved.This program is free software; you can redistribute it and/ormodify it under the terms of the GNU General Public License aspublished by the Free Software Foundation; version 2 of theLicense.This program is distributed in the hope that it will be useful,but WITHOUT ANY WARRANTY; without even the implied warranty ofMERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See theGNU General Public License for more details.You should have received a copy of the GNU General Public Licensealong with this program; if not, write to the Free SoftwareFoundation, Inc., 51 Franklin St, Fifth Floor, Boston, MA02110-1301 USA$%ENDLICENSE%$ --]]----- a flexible statement based load balancer with connection pooling---- * build a connection pool of min_idle_connections for each backend and maintain-- its size-- *----local commands = require("proxy.commands")local tokenizer = require("proxy.tokenizer")local lb = require("proxy.balance")local auto_config = require("proxy.auto-config")--- config---- connection poolif not proxy.global.config.rwsplit thenproxy.global.config.rwsplit = {min_idle_connections = 4,max_idle_connections = 8,is_debug = false}end----- read/write splitting sends all non-transactional SELECTs to the slaves---- is_in_transaction tracks the state of the transactionslocal is_in_transaction = false-- if this was a SELECT SQL_CALC_FOUND_ROWS ... stay on the same connectionslocal is_in_select_calc_found_rows = false----- get a connection to a backend---- as long as we don't have enough connections in the pool, create new connections--function connect_server()local is_debug = proxy.global.config.rwsplit.is_debug-- make sure that we connect to each backend at least ones to-- keep the connections to the servers alive---- on read_query we can switch the backends again to another backendif is_debug thenprint()print("[connect_server] " .. proxy.connection.client.src.name)endlocal rw_ndx = 0-- init all backendsfor i = 1, #proxy.global.backends dolocal s = proxy.global.backends[i]local pool = s.pool -- we don't have a username yet, try to find a connections which is idlinglocal cur_idle = pool.users[""].cur_idle_connectionspool.min_idle_connections = proxy.global.config.rwsplit.min_idle_connectionspool.max_idle_connections = proxy.global.config.rwsplit.max_idle_connectionsif is_debug thenprint(" [".. i .."].connected_clients = " .. s.connected_clients)print(" [".. i .."].pool.cur_idle = " .. cur_idle)print(" [".. i .."].pool.max_idle = " .. pool.max_idle_connections)print(" [".. i .."].pool.min_idle = " .. pool.min_idle_connections)print(" [".. i .."].type = " .. s.type)print(" [".. i .."].state = " .. s.state)end-- prefer connections to the masterif s.type == proxy.BACKEND_TYPE_RW ands.state ~= proxy.BACKEND_STATE_DOWN andcur_idle < pool.min_idle_connections thenproxy.connection.backend_ndx = ibreakelseif s.type == proxy.BACKEND_TYPE_RO ands.state ~= proxy.BACKEND_STATE_DOWN andcur_idle < pool.min_idle_connections thenproxy.connection.backend_ndx = ibreakelseif s.type == proxy.BACKEND_TYPE_RW ands.state ~= proxy.BACKEND_STATE_DOWN andrw_ndx == 0 thenrw_ndx = iendendif proxy.connection.backend_ndx == 0 thenif is_debug thenprint(" [" .. rw_ndx .. "] taking master as default")endproxy.connection.backend_ndx = rw_ndxend-- pick a random backend---- we someone have to skip DOWN backends-- ok, did we got a backend ?if proxy.connection.server thenif is_debug thenprint(" using pooled connection from: " .. proxy.connection.backend_ndx)end-- stay with itreturn proxy.PROXY_IGNORE_RESULTendif is_debug thenprint(" [" .. proxy.connection.backend_ndx .. "] idle-conns below min-idle")end-- open a new connectionend----- put the successfully authed connection into the connection pool---- @param auth the context information for the auth---- auth.packet is the packetfunction read_auth_result( auth )if is_debug thenprint("[read_auth_result] " .. proxy.connection.client.src.name)endif auth.packet:byte() == proxy.MYSQLD_PACKET_OK then-- auth was fine, disconnect from the serverproxy.connection.backend_ndx = 0elseif auth.packet:byte() == proxy.MYSQLD_PACKET_EOF then-- we received either a---- * MYSQLD_PACKET_ERR and the auth failed or-- * MYSQLD_PACKET_EOF which means a OLD PASSWORD (4.0) was sentprint("(read_auth_result) ... not ok yet");elseif auth.packet:byte() == proxy.MYSQLD_PACKET_ERR then-- auth failedendend----- read/write splittingfunction read_query( packet )local is_debug = proxy.global.config.rwsplit.is_debuglocal cmd = commands.parse(packet)local c = proxy.connection.clientlocal r = auto_config.handle(cmd)if r then return r endlocal tokenslocal norm_query-- looks like we have to forward this statement to a backendif is_debug thenprint("[read_query] " .. proxy.connection.client.src.name)print(" current backend = " .. proxy.connection.backend_ndx)print(" client default db = " .. c.default_db)print(" client username = " .. c.username)if cmd.type == proxy.COM_QUERY thenprint(" query = " .. cmd.query)endendif cmd.type == proxy.COM_QUIT then-- don't send COM_QUIT to the backend. We manage the connection-- in all aspects.proxy.response = {type = proxy.MYSQLD_PACKET_OK,}if is_debug thenprint(" (QUIT) current backend = " .. proxy.connection.backend_ndx)endreturn proxy.PROXY_SEND_RESULTend-- COM_BINLOG_DUMP packet can't be balanced---- so we must send it always to the masterif cmd.type == proxy.COM_BINLOG_DUMP then-- if we don't have a backend selected, let's pick the master--if proxy.connection.backend_ndx == 0 thenproxy.connection.backend_ndx = lb.idle_failsafe_rw()endreturnendproxy.queries:append(1, packet, { resultset_is_needed = true })-- read/write splitting---- send all non-transactional SELECTs to a slaveif not is_in_transaction andcmd.type == proxy.COM_QUERY thentokens = tokens or assert(tokenizer.tokenize(cmd.query))local stmt = tokenizer.first_stmt_token(tokens)if stmt.token_name == "TK_SQL_SELECT" thenis_in_select_calc_found_rows = falselocal is_insert_id = falsefor i = 1, #tokens dolocal token = tokens[i]-- SQL_CALC_FOUND_ROWS + FOUND_ROWS() have to be executed-- on the same connection-- print("token: " .. token.token_name)-- print(" val: " .. token.text)if not is_in_select_calc_found_rows and token.token_name == "TK_SQL_SQL_CALC_FOUND_ROWS" thenis_in_select_calc_found_rows = trueelseif not is_insert_id and token.token_name == "TK_LITERAL" thenlocal utext = token.text:upper()if utext == "LAST_INSERT_ID" orutext == "@@INSERT_ID" thenis_insert_id = trueendend-- we found the two special token, we can't find moreif is_insert_id and is_in_select_calc_found_rows thenbreakendend-- if we ask for the last-insert-id we have to ask it on the original-- connectionif not is_insert_id thenlocal backend_ndx = lb.idle_ro()if backend_ndx > 0 thenproxy.connection.backend_ndx = backend_ndxendelseprint(" found a SELECT LAST_INSERT_ID(), staying on the same backend")endendend-- no backend selected yet, pick a masterif proxy.connection.backend_ndx == 0 then-- we don't have a backend right now---- let's pick a master as a good default--proxy.connection.backend_ndx = lb.idle_failsafe_rw()end-- by now we should have a backend---- in case the master is down, we have to close the client connections-- otherwise we can go onif proxy.connection.backend_ndx == 0 thenreturn proxy.PROXY_SEND_QUERYendlocal s = proxy.connection.server-- if client and server db don't match, adjust the server-side---- skip it if we send a INIT_DB anywayif cmd.type ~= proxy.COM_INIT_DB andc.default_db and c.default_db ~= s.default_db thenprint(" server default db: " .. s.default_db)print(" client default db: " .. c.default_db)print(" syncronizing")proxy.queries:prepend(2, string.char(proxy.COM_INIT_DB) .. c.default_db, { resultset_is_needed = true })end-- send to masterif is_debug thenif proxy.connection.backend_ndx > 0 thenlocal b = proxy.global.backends[proxy.connection.backend_ndx]print(" sending to backend : " .. b.dst.name);print(" is_slave : " .. tostring(b.type == proxy.BACKEND_TYPE_RO));print(" server default db: " .. s.default_db)print(" server username : " .. s.username)endprint(" in_trans : " .. tostring(is_in_transaction))print(" in_calc_found : " .. tostring(is_in_select_calc_found_rows))print(" COM_QUERY : " .. tostring(cmd.type == proxy.COM_QUERY))endreturn proxy.PROXY_SEND_QUERYend----- as long as we are in a transaction keep the connection-- otherwise release it so another client can use itfunction read_query_result( inj )local is_debug = proxy.global.config.rwsplit.is_debuglocal res = assert(inj.resultset)local flags = res.flagsif inj.id ~= 1 then-- ignore the result of the USE <default_db>-- the DB might not exist on the backend, what do do ?--if inj.id == 2 then-- the injected INIT_DB failed as the slave doesn't have this DB-- or doesn't have permissions to read from itif res.query_status == proxy.MYSQLD_PACKET_ERR thenproxy.queries:reset()proxy.response = {type = proxy.MYSQLD_PACKET_ERR,errmsg = "can't change DB ".. proxy.connection.client.default_db .." to on slave " .. proxy.global.backends[proxy.connection.backend_ndx].dst.name}return proxy.PROXY_SEND_RESULTendendreturn proxy.PROXY_IGNORE_RESULTendis_in_transaction = flags.in_translocal have_last_insert_id = (res.insert_id and (res.insert_id > 0))if not is_in_transaction andnot is_in_select_calc_found_rows andnot have_last_insert_id then-- release the backendproxy.connection.backend_ndx = 0elseif is_debug thenprint("(read_query_result) staying on the same backend")print(" in_trans : " .. tostring(is_in_transaction))print(" in_calc_found : " .. tostring(is_in_select_calc_found_rows))print(" have_insert_id : " .. tostring(have_last_insert_id))endend----- close the connections if we have enough connections in the pool---- @return nil - close connection-- IGNORE_RESULT - store connection in the poolfunction disconnect_client()local is_debug = proxy.global.config.rwsplit.is_debugif is_debug thenprint("[disconnect_client] " .. proxy.connection.client.src.name)end-- make sure we are disconnection from the connection-- to move the connection into the poolproxy.connection.backend_ndx = 0end