RabbitMQ单机集群搭建

搭建前容我先吐槽下，因为第一次接触rabbitmq，从安装到启动到查看rabbitmq-web页面，这些都比较简单，但是关于单机部署多个实例，我按照资料设置，总会遇到各种问题，书本，博文，百度了很多，几乎千片一律，不过最后还是在谷歌上搜到了蛛丝马迹, 由于我们使用的版本太新了，所以有些资料自然就过期了！

下面开始正式搭建：

系统：mac

rabbitmq:3.6.9，当前时间最新版。

1.安装步骤略。

（建议使用命令brew install rabbitmq， 安装卸载都比较方便）

2.正式启动时，先了解几个概念

a. 先启动默认rabbit

到rabbitmq安装目录的sbin目录下
$ ./rabbitmq-server -detached

(后台式启动，缺点部分错误显示不出来，我就被坑了，可以使用不加【-detached】方式启动，缺点多开几个终端窗口。)

b. 查看状态

zhanghuilongdeMacBook-Pro:sbin zhanghuilong$ ./rabbitmqctl status
Status of node rabbit@localhost ...
[{pid,21180},
{running_applications,
[{rabbitmq_management_visualiser,"RabbitMQ Visualiser","3.6.9"},
{rabbitmq_management,"RabbitMQ Management Console","3.6.9"},
{rabbitmq_stomp,"RabbitMQ STOMP plugin","3.6.9"},
{rabbitmq_amqp1_0,"AMQP 1.0 support for RabbitMQ","3.6.9"},
{rabbitmq_management_agent,"RabbitMQ Management Agent","3.6.9"},
{rabbitmq_mqtt,"RabbitMQ MQTT Adapter","3.6.9"},
{rabbitmq_web_dispatch,"RabbitMQ Web Dispatcher","3.6.9"},
{rabbit,"RabbitMQ","3.6.9"},
{os_mon,"CPO  CXC 138 46","2.4.2"},
{amqp_client,"RabbitMQ AMQP Client","3.6.9"},
{rabbit_common,
"Modules shared by rabbitmq-server and rabbitmq-erlang-client",
"3.6.9"},
{compiler,"ERTS  CXC 138 10","7.0.4"},
{xmerl,"XML parser","1.3.13"},
{cowboy,"Small, fast, modular HTTP server.","1.0.4"},
{ranch,"Socket acceptor pool for TCP protocols.","1.3.0"},
{ssl,"Erlang/OTP SSL application","8.1.1"},
{public_key,"Public key infrastructure","1.4"},
{cowlib,"Support library for manipulating Web protocols.","1.0.2"},
{inets,"INETS  CXC 138 49","6.3.6"},
{asn1,"The Erlang ASN1 compiler version 4.0.4","4.0.4"},
{crypto,"CRYPTO","3.7.3"},
{sasl,"SASL  CXC 138 11","3.0.3"},
{mnesia,"MNESIA  CXC 138 12","4.14.3"},
{syntax_tools,"Syntax tools","2.1.1"},
{stdlib,"ERTS  CXC 138 10","3.3"},
{kernel,"ERTS  CXC 138 10","5.2"}]},
{os,{unix,darwin}},
{erlang_version,
"Erlang/OTP 19 [erts-8.3] [source] [64-bit] [smp:4:4] [async-threads:64] [hipe] [kernel-poll:true] [dtrace]\n"},
{memory,
[{total,64052888},
{connection_readers,0},
{connection_writers,0},
{connection_channels,0},
{connection_other,2848},
{queue_procs,2848},
{queue_slave_procs,0},
{plugins,2143792},
{other_proc,21306640},
{mnesia,68232},
{metrics,195768},
{mgmt_db,520592},
{msg_index,90240},
{other_ets,2840016},
{binary,149864},
{code,25297221},
{atom,1041593},
{other_system,10586154}]},
{alarms,[]},
**核心点：**
{listeners,
[{clustering,25672,"::"},
{amqp,5672,"127.0.0.1"},
{mqtt,1883,"::"},
{stomp,61613,"::"},
{http,15672,"::"}]},

{vm_memory_high_watermark,0.4},
{vm_memory_limit,2799457075},
{disk_free_limit,50000000},
{disk_free,175823912960},
{file_descriptors,
[{total_limit,7068},
{total_used,2},
{sockets_limit,6359},
{sockets_used,0}]},
{processes,[{limit,1048576},{used,370}]},
{run_queue,0},
{uptime,34586},
{kernel,{net_ticktime,60}}]

一般的文章或者书籍，上来就会让你执行类似于下面的命令：

不过我觉得对于新人来说过于简陋和不负责任！！！

RABBITMQ_NODE_PORT=5672 RABBITMQ_NODENAME=rabbit1 rabbitmq-server -detached
RABBITMQ_NODE_PORT=5673 RABBITMQ_NODENAME=rabbit2 rabbitmq-server -detached
RABBITMQ_NODE_PORT=5674 RABBITMQ_NODENAME=rabbit3 rabbitmq-server -detached

如果你按照类似的文章操作，也许你会成功，但我想大多数可能会遇到错误提示，而且很棘手，让人很无语。

官方文档中关于集群的指导中也是这样提到



我们从刚刚贴出的第一个节点的status 可以看到，这样的一段记录

zhanghuilongdeMacBook-Pro:sbin zhanghuilong$ ./rabbitmqctl status
Status of node rabbit@localhost ...
....略...

{listeners,
[{clustering,25672,"::"},
{amqp,5672,"127.0.0.1"},
{mqtt,1883,"::"},
{stomp,61613,"::"},
{http,15672,"::"}]},

默认启动的是rabbit@localhost

如果在启动过程，你不指定hostname,那默认都是localhost,假如你的hosts又没有配置127.0.0.1 localhost 的话，就会报下面的错了。

ERROR: epmd error for host localhost: nxdomain (non-existing domain)

3.启动第一个节点

下面的一张截图是我配置了hosts，指定了特定hostname启动的,当然你也可以指定 为localhost。

RABBITMQ_NODE_PORT=5672 RABBITMQ_NODENAME=rabbit@zhanghuilongdeMacBook-Pro ./rabbitmq-server

成功后的web：http://127.0.0.1:15672/#/



接着上面的，启动第二个节点，如果我们还是按照

RABBITMQ_NODE_PORT=5673 RABBITMQ_NODENAME=rabbit_1@zhanghuilongdeMacBook-Pro rabbitmq-server -detached

你可能发现不了什么，假如你去掉-detached 你会发现，最后你得到了一个这样的错误信息：崩溃了的信息。。。

Crash dump is being written to: erl_crash.dump...done

往上翻信息或者查看日志，你会看到这样的提示：

BOOT FAILED
===========

Error description:
{could_not_start,rabbitmq_mqtt,
{{shutdown,
{failed_to_start_child,'rabbit_mqtt_listener_sup_:::1883',
{shutdown,
{failed_to_start_child,
{ranch_listener_sup,{acceptor,{0,0,0,0,0,0,0,0},1883}},
{shutdown,
{failed_to_start_child,ranch_acceptors_sup,
{listen_error,
{acceptor,{0,0,0,0,0,0,0,0},1883},
eaddrinuse}}}}}}},
{rabbit_mqtt,start,[normal,[]]}}}

那问题很明显了,端口监听这个位置 ‘rabbit_mqtt_listener_sup_:::1883出现问题了。

详细看下：http://www.rabbitmq.com/clustering.html#overview-hostname-requirements

你就会理解了。如何正确启动第二节点呢？可想而知在端口上要避免冲突，就需要设置一些必要的参数了。

3. 启动第二个节点

#节点2
RABBITMQ_NODE_PORT=5673 RABBITMQ_SERVER_START_ARGS="-rabbitmq_management listener [{port,15673}] -rabbitmq_stomp tcp_listeners [61614] -rabbitmq_mqtt  tcp_listeners [1884]" RABBITMQ_NODENAME=rabbit1 ./rabbitmq-server -detached

如果启动正常,会显示下面的提示：

zhanghuilongdeMacBook-Pro:sbin zhanghuilong$ RABBITMQ_NODE_PORT=5673 RABBITMQ_SERVER_START_ARGS="-rabbitmq_management listener [{port,15673}] -rabbitmq_stomp tcp_listeners [61614] -rabbitmq_mqtt  tcp_listeners [1884]" RABBITMQ_NODENAME=rabbit1@zhanghuilongdeMacBook-Pro ./rabbitmq-server -detached
Warning: PID file not written; -detached was passed.
zhanghuilongdeMacBook-Pro:sbin zhanghuilong$

当然，你也可以查看当前节点状态，注意不能使用:./rabbitmqctl status,否则会如下所示：

zhanghuilongdeMacBook-Pro:sbin zhanghuilong$ ./rabbitmqctl status
Status of node rabbit@localhost ...
Error: unable to connect to node rabbit@localhost: nodedown

DIAGNOSTICS
===========

attempted to contact: [rabbit@localhost]

rabbit@localhost:
* unable to connect to epmd (port 4369) on localhost: nxdomain (non-existing domain)

current node details:
- node name: 'rabbitmq-cli-01@zhanghuilongdeMacBook-Pro'
- home dir: /Users/zhanghuilong
- cookie hash: bolAngw+/LHA74YduKm11w==

这里需要指定节点名称：./rabbitmqctl status -n rabbit1

zhanghuilongdeMacBook-Pro:sbin zhanghuilong$ ./rabbitmqctl status  -n rabbit1
Status of node 'rabbit1@zhanghuilongdeMacBook-Pro' ...
[{pid,41257},
{running_applications,
[{rabbitmq_management_visualiser,"RabbitMQ Visualiser","3.6.9"},
...

同理你可以启动节点3，相应的端口号+1即可，只要不冲突就行。

#节点3
RABBITMQ_NODE_PORT=5674 RABBITMQ_SERVER_START_ARGS="-rabbitmq_management listener [{port,15674}] -rabbitmq_stomp tcp_listeners [61615] -rabbitmq_mqtt tcp_listeners [1885]" RABBITMQ_NODENAME=rabbit2 ./rabbitmq-server -detached

这样的话你可以通过：http://127.0.0.1:15672/#/，http://127.0.0.1:15673/#/ ，http://127.0.0.1:15674/#/

访问web查看相关节点是否真的存在。下面就是如何实现集群操作了。

4.集群操作

建议在操作集群前，先了解集群架构中的，RabbitMQ元数据的概念，以及集群中队列和交换机（器）的行为。—这句属于废话，不了解谁神经病来搭建集群。废话可以略过。

a.把节点rabbit1 加入 rabbit中

1.停止第二个节点的应用程序

./rabbitmqctl -n rabbit1@zhanghuilongdeMacBook-Pro stop_app

2.重新设置第二个节点的元数据和状态为清空状态。

./rabbitmqctl -n rabbit1@zhanghuilongdeMacBook-Pro reset

3.加入第一节点

./rabbitmqctl -n rabbit1@zhanghuilongdeMacBook-Pro join_cluster rabbit@zhanghuilongdeMacBook-Pro

4.重新启动第二节点

./rabbitmqctl -n rabbit1@zhanghuilongdeMacBook-Pro start_app

以下是具体的过程：

  zhanghuilongdeMacBook-Pro:sbin zhanghuilong$ ./rabbitmqctl -n rabbit1@zhanghuilongdeMacBook-Pro stop_app
Stopping rabbit application on node 'rabbit1@zhanghuilongdeMacBook-Pro' ...
zhanghuilongdeMacBook-Pro:sbin zhanghuilong$ ./rabbitmqctl -n rabbit1@zhanghuilongdeMacBook-Pro reset
Resetting node 'rabbit1@zhanghuilongdeMacBook-Pro' ...
zhanghuilongdeMacBook-Pro:sbin zhanghuilong$ ./rabbitmqctl -n rabbit1@zhanghuilongdeMacBook-Pro join_cluster rabbit@zhanghuilongdeMacBook-Pro
Clustering node 'rabbit1@zhanghuilongdeMacBook-Pro' with 'rabbit@zhanghuilongdeMacBook-Pro' ...
zhanghuilongdeMacBook-Pro:sbin zhanghuilong$./rabbitmqctl -n rabbit1@zhanghuilongdeMacBook-Pro start_app
Starting node 'rabbit1@zhanghuilongdeMacBook-Pro' ...
zhanghuilongdeMacBook-Pro:sbin zhanghuilong$

now,你可以到web端看到集群已经存在了！！！。。。斯巴拉稀

b.把rabbit2加入rabbit

步骤同a的1234，其中注意点是，如果你需要设置第三个集群节点为内存模式，而非磁盘模式，可以参考当前版本的命令提示，在最后加上

–ram 参数

Commands:
stop [<pid_file>]
stop_app
start_app
wait <pid_file>
reset
force_reset
rotate_logs <suffix>
hipe_compile <directory>

join_cluster <clusternode> [--ram]

添加第三节点的完整命令

zhanghuilongdeMacBook-Pro:sbin zhanghuilong$ ./rabbitmqctl -n rabbit2@zhanghuilongdeMacBook-Pro stop_app
Stopping rabbit application on node 'rabbit2@zhanghuilongdeMacBook-Pro' ...
zhanghuilongdeMacBook-Pro:sbin zhanghuilong$ ./rabbitmqctl -n rabbit2@zhanghuilongdeMacBook-Pro reset
Resetting node 'rabbit2@zhanghuilongdeMacBook-Pro' ...
zhanghuilongdeMacBook-Pro:sbin zhanghuilong$ ./rabbitmqctl -n rabbit2@zhanghuilongdeMacBook-Pro join_cluster rabbit@zhanghuilongdeMacBook-Pro --ram
Clustering node 'rabbit2@zhanghuilongdeMacBook-Pro' with 'rabbit@zhanghuilongdeMacBook-Pro' ...
zhanghuilongdeMacBook-Pro:sbin zhanghuilong$ ./rabbitmqctl -n rabbit2@zhanghuilongdeMacBook-Pro start_app
Starting node 'rabbit2@zhanghuilongdeMacBook-Pro' ...
zhanghuilongdeMacBook-Pro:sbin zhanghuilong$

查看集群状态

./rabbitmqctl cluster_status -n rabbit@zhanghuilongdeMacBook-Pro

zhanghuilongdeMacBook-Pro:sbin zhanghuilong$ ./rabbitmqctl cluster_status -n rabbit@zhanghuilongdeMacBook-Pro
Cluster status of node 'rabbit@zhanghuilongdeMacBook-Pro' ...
[{nodes,[{disc,['rabbit1@zhanghuilongdeMacBook-Pro',
'rabbit@zhanghuilongdeMacBook-Pro']},
{ram,['rabbit2@zhanghuilongdeMacBook-Pro']}]},
{running_nodes,['rabbit2@zhanghuilongdeMacBook-Pro',
'rabbit1@zhanghuilongdeMacBook-Pro',
'rabbit@zhanghuilongdeMacBook-Pro']},
{cluster_name,<<"rabbit@zhanghuilongdemacbook-pro">>},
{partitions,[]},
{alarms,[{'rabbit2@zhanghuilongdeMacBook-Pro',[]},
{'rabbit1@zhanghuilongdeMacBook-Pro',[]},
{'rabbit@zhanghuilongdeMacBook-Pro',[]}]}]

到web端看下效果吧：



点击节点名称可以查看详细信息，





节点2 和节点3 分别被设置为 磁盘 和 内存类型。

至此，集群搭建完毕, 由于我也是初次学习rabbitmq,如果有理解有误的地方，麻烦给指出来，也好一起交流学习下！