应用端连接codis 3.0.3提示Proxy list is empty的处理

一.问题描述

应用端连接代码：

JedisResourcePool jedisPool = RoundRobinJedisPool.create().

curatorClient("192.168.30.103:2181,192.168.30.104:2181,192.168.30.105:2181", 30000).

timeoutMs(3000).

zkProxyDir("/zk/codis/db_hls_prod/proxy").password('xxxx').build();

Jedis jedis = jedisPool.getResource();

jedis.set("foo", "bar");

String value = jedis.get("foo");

System.out.println(value);

通过zk连接codis提示：Proxy list is empty。

二.问题分析

1.proxy状态查看：

[apps@mvxl2579 codis]$ /apps/svr/codis/bin/codis-admin --dashboard=192.168.30.103:18080 --proxy-status

通过codis FE查看proxy状态都正常.

2.通过proxy连接redis正常3.在ZK中查看proxy状态

[zk: 127.0.0.1:2181(CONNECTED) 8] ls /codis3/hls_prod/proxy

[proxy-634208a9ba753e5e927260d0ced93687, proxy-f82e0afb962642f25de2411dd04a3198, proxy-218cee9b567b604af0a3939b84f2529d, proxy-6dd30d40f676564495d56ab16211e039, proxy-815867a35f921bcc3abb02109cca1f75, proxy-9f04676d4e82b2ba7e8f8c3a3faeee28]

[zk: 127.0.0.1:2181(CONNECTED) 9] get /codis3/hls_prod/proxy/proxy-9f04676d4e82b2ba7e8f8c3a3faeee28

{

"id": 4,

"token": "9f04676d4e82b2ba7e8f8c3a3faeee28",

"start_time": "2016-07-01 16:42:39.219656807 +0800 CST",

"admin_addr": "192.168.30.104:11080",

"proto_type": "tcp4",

"proxy_addr": "192.168.30.104:19000",

"product_name": "hls_prod",

"pid": 3336,

"pwd": "/apps/sh/codis",

"sys": "Linux mvxl2580 2.6.32-504.el6.x86_64 #1 SMP Wed Oct 15 04:27:16 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux"

}

cZxid = 0x2000c4328

ctime = Fri Jul 01 16:42:42 CST 2016

mZxid = 0x2000c4329

mtime = Fri Jul 01 16:42:42 CST 2016

pZxid = 0x2000c4328

cversion = 0

dataVersion = 1

aclVersion = 0

ephemeralOwner = 0x0

dataLength = 427

numChildren = 0

没发现什么异常，但从以下网站上查到解决办法。参考：https://github.com/CodisLabs/jodis/issues/10

三.问题处理

1.修改codis3的proxy.toml文件

# Set jodis address & session timeout.

jodis_addr = "192.168.30.103:2181，192.168.30.104:2181，192.168.30.105:2181"

jodis_addr必须设置

2.修改jodis的zkProxyDir

zkProxyDir("/zk/codis/db_hls_prod/proxy")

结论：

1.codis 3.x 里面，proxy 注册目录换成了 /codis3/xxx/proxy/yyy，同时也会写入 /zk/codis/db_xxx/proxy/yyy 以兼容 jodis。

Zookeeper在/zk/codis/db_hls_prod/proxy下存储的消息如下，满足jodis获取CodisProxyInfo消息体

[zk: 127.0.0.1:2181(CONNECTED) 4] ls /zk/codis/db_hls_prod/proxy

[815867a35f921bcc3abb02109cca1f75, 6dd30d40f676564495d56ab16211e039, 9f04676d4e82b2ba7e8f8c3a3faeee28]

[zk: 127.0.0.1:2181(CONNECTED) 5] get /zk/codis/db_hls_prod/proxy/9f04676d4e82b2ba7e8f8c3a3faeee28

{

"addr": "192.168.30.104:19000",

"start_at": "2016-07-01 16:42:39.219656807 +0800 CST",

"state": "online",

"token": "9f04676d4e82b2ba7e8f8c3a3faeee28"

}

cZxid = 0x2000c432b

ctime = Fri Jul 01 16:42:42 CST 2016

mZxid = 0x2000c432b

mtime = Fri Jul 01 16:42:42 CST 2016

pZxid = 0x2000c432b

cversion = 0

dataVersion = 0

aclVersion = 0

ephemeralOwner = 0x2550b2029dbbccd

dataLength = 167

numChildren = 0

2.codis的proxy需要指定jodis