高性能RabbitMQ
1,什么是RabbitMq
RabbitMQ是实现了高级消息队列协议(AMQP)的开源消息代理软件(亦称面向消息的中间件)。RabbitMQ服务器是用Erlang语言编写的,而集群和故障转移是构建在开放电信平台框架上的。所有主要的编程语言均有与代理接口通讯的客户端库。
2,几种MQ对比
RabbitMQ 是用Erlang 语言进行开发的,一款设计之初就是抗高并发的语言

3,RabbitMQ 安装
1.下载并安装erlang,下载地址:http://www.erlang.org/download
2.配置erlang环境变量信息
新增环境变量ERLANG_HOME=erlang的安装地址
将%ERLANG_HOME%\bin加入到path中
3.下载并安装RabbitMQ,下载地址:http://www.rabbitmq.com/download.html 注意: RabbitMQ 它依赖于Erlang,需要先安装Erlang。
RabbitMQ 管理平台地址 http://127.0.0.1:15672
默认账号:guest/guest 用户可以自己创建新的账号
https://blog.csdn.net/qq_35098526/article/details/80009424 安装之后启动不了,可以在sbin 里面:
输入:rabbitmq-plugins enable rabbitmq_management (先定位到rabbitmq安装目录)命令,出现plugins安装成功的提示。
过程:
Microsoft Windows [Version 10.0.17134.950]
C:\Program Files\RabbitMQ Server>
C:\Program Files\RabbitMQ Server>cd rabbitmq_server-3.7.
C:\Program Files\RabbitMQ Server\rabbitmq_server-3.7.>cd sbin
C:\Program Files\RabbitMQ Server\rabbitmq_server-3.7.\sbin>rabbitmq-plugins enable rabbitmq_management
Enabling plugins on node rabbit@DESKTOP-2MDM24J:
rabbitmq_management
The following plugins have been configured:
rabbitmq_management
rabbitmq_management_agent
rabbitmq_web_dispatch
Applying plugin configuration to rabbit@DESKTOP-2MDM24J...
The following plugins have been enabled:
rabbitmq_management
rabbitmq_management_agent
rabbitmq_web_dispatch started plugins.
4,RabbitMQ 五种队列形式
1.点对点队列,也可以叫做简单队列
生产者投递的消息,每次只准一个消费者来消费,如果消费者集群的话,消息会被均摊。
例如:50 个消息,2个消费者,消费者1会消费奇数,消费者2会消费偶数,两个消费者不受影响,各自消费各自的消息
producer:
public class Producer {
private static final String QUEUE_NAME = "rabbitmq_simple_queue_one";
public static void main(String[] args) throws IOException, TimeoutException {
Connection connection = MQConnectionUtils.getConnection();
// 创建通道
Channel channel = connection.createChannel();
// 3.创建队列声明
channel.queueDeclare(QUEUE_NAME, false, false, false, null);
for (int i = 0; i < 50; i++) {
String msg = "Hello, World :" + i;
System.out.println(msg);
channel.basicPublish("", QUEUE_NAME, null, msg.getBytes());
}
channel.close();
connection.close();
}
}
consumer1:
public class Consumer {
private static final String QUEUE_NAME = "rabbitmq_simple_queue_one";
public static void main(String[] args) throws IOException, TimeoutException {
System.out.println("consumer1");
Connection connection = MQConnectionUtils.getConnection();
// 创建通道
Channel channel = connection.createChannel();
// 3.创建队列声明
channel.queueDeclare(QUEUE_NAME, false, false, false, null);
DefaultConsumer consumer = new DefaultConsumer(channel) {
@Override
public void handleDelivery(String consumerTag, Envelope envelope, BasicProperties properties, byte[] body)
throws IOException {
String msgString = new String(body, "UTF-8");
System.out.println("消费者获取消息:" + msgString);
}
};
// 3.监听队列
channel.basicConsume(QUEUE_NAME, true, consumer); //true 代表采用自动签收的应答模式
}
}
consumer2:
public class Consumer2 {
private static final String QUEUE_NAME = "rabbitmq_simple_queue_one";
public static void main(String[] args) throws IOException, TimeoutException {
System.out.println("consumer2");
Connection connection = MQConnectionUtils.getConnection();
// 创建通道
Channel channel = connection.createChannel();
// 3.创建队列声明
channel.queueDeclare(QUEUE_NAME, false, false, false, null);
DefaultConsumer consumer = new DefaultConsumer(channel) {
@Override
public void handleDelivery(String consumerTag, Envelope envelope, BasicProperties properties, byte[] body)
throws IOException {
String msgString = new String(body, "UTF-8");
System.out.println("消费者获取消息:" + msgString);
try {
Thread.sleep(3000);
} catch (InterruptedException e) {
e.printStackTrace();
}
}
};
// 3.监听队列
channel.basicConsume(QUEUE_NAME, true, consumer); //true 代表采用自动签收的应答模式
}
}
2,工作队列模式,也可以叫做公平队列模式
点对点简单队列弊端:消费者集群的话,消息会被均摊处理,但是不同的消费者处理消息的能力是不同的,consumer1 每秒处理1个消息,consumer2 美妙处理3个消息,如果消息均摊,consumer1的效率则被浪费。
公平消费模式:谁处理的快,并且采用手动签收,告知RabbitMQ之后,RabbitMQ 再给分发消息。这样,谁处理的快,谁就会处理的多。
producer:
public class Producer {
// 公平队列名称
private static final String QUEUE_NAME = "rabbitmq_fair_queue_one";
public static void main(String[] args) throws IOException, TimeoutException {
Connection connection = MQConnectionUtils.getConnection();
// 创建通道
Channel channel = connection.createChannel();
// 创建队列声明
channel.queueDeclare(QUEUE_NAME, false, false, false, null);
// 保证消费者只能取一个/每次
channel.basicQos(1); //每次只给消费者1条消息,等消费完成,手动ack 应答之后,再给下一条
for (int i = 0; i < 50; i++) {
String msg = "Hello, World: " + i;
System.out.println(msg);
channel.basicPublish("", QUEUE_NAME, null, msg.getBytes());
}
channel.close();
connection.close();
}
}
consumer1:
public class Consumer {
private static final String QUEUE_NAME = "rabbitmq_fair_queue_one";
public static void main(String[] args) throws IOException, TimeoutException {
System.out.println("consumer01");
Connection connection = MQConnectionUtils.getConnection();
// 创建通道
final Channel channel = connection.createChannel();
// 3.创建队列声明
channel.queueDeclare(QUEUE_NAME, false, false, false, null);
channel.basicQos(1);
DefaultConsumer consumer = new DefaultConsumer(channel) {
@Override
public void handleDelivery(String consumerTag, Envelope envelope, BasicProperties properties, byte[] body)
throws IOException {
String msgString = new String(body, "UTF-8");
System.out.println("消费者获取消息:" + msgString);
try {
Thread.sleep(200);
} catch (Exception e) {
} finally {
channel.basicAck(envelope.getDeliveryTag(), false);
}
}
};
// 3.监听队列
channel.basicConsume(QUEUE_NAME, false, consumer); //false 代表使用手动消息应答,需要使用channel.basicAck(envelope.getDeliveryTag(),false) 告知消息中间件
}
}
consumer2:
public class Consumer2 {
private static final String QUEUE_NAME = "rabbitmq_fair_queue_one";
public static void main(String[] args) throws IOException, TimeoutException {
System.out.println("consumer02");
Connection connection = MQConnectionUtils.getConnection();
// 创建通道
final Channel channel = connection.createChannel();
// 3.创建队列声明
channel.queueDeclare(QUEUE_NAME, false, false, false, null);
channel.basicQos(1);
DefaultConsumer consumer = new DefaultConsumer(channel) {
@Override
public void handleDelivery(String consumerTag, Envelope envelope, BasicProperties properties, byte[] body)
throws IOException {
String msgString = new String(body, "UTF-8");
System.out.println("消费者获取消息:" + msgString);
try {
Thread.sleep(); //让这个消费者处理消息的能力更差一点
} catch (Exception e) {
} finally {
channel.basicAck(envelope.getDeliveryTag(), false);
}
}
};
// 3.监听队列
channel.basicConsume(QUEUE_NAME, false, consumer);
}
}
3,发布订阅模式,采用fanout 扇形交换机,
高级队列模式中,有交换机,生产者将消息发给交换机,在根据交换机的类型,发给定的的队列,然后发给指定的消费者消费
producer:
public class Producer {
// 定义交换机名称
private static final String EXCHANGE_NAME = "rabbitmq_pubsub_exchanger_one";
// 定义交换机类型
private static final String EXCHANGE_TYPE = "fanout";
public static void main(String[] args) throws IOException, TimeoutException {
// 和rabbitmq 建立连接
Connection connection = MQConnectionUtils.getConnection();
// 创建channel
Channel channel = connection.createChannel();
// 创建交换机
channel.exchangeDeclare(EXCHANGE_NAME, EXCHANGE_TYPE);
String message = "pub/sub";
channel.basicPublish(EXCHANGE_NAME, "", null, message.getBytes());
channel.close();
connection.close();
}
}
邮件消费者:
ublic class EmailConsumer {
private static final String QUEUE_NAME = "rabbitmq_pubsub_email_queue_one";
private static final String EXCHANGE_NAME = "rabbitmq_pubsub_exchanger_one";
public static void main(String[] args) throws IOException, TimeoutException {
System.out.println("邮件消费者。。。");
Connection connection = MQConnectionUtils.getConnection();
Channel channel = connection.createChannel();
// 定义队列
channel.queueDeclare(QUEUE_NAME, false, false, false, null);
// 将队列和交换机进行绑定
channel.queueBind(QUEUE_NAME, EXCHANGE_NAME, "");
DefaultConsumer consumer = new DefaultConsumer(channel) {
@Override
public void handleDelivery(String consumerTag, Envelope envelope, BasicProperties properties, byte[] body)
throws IOException {
String msg = new String(body, "UTF-8");
System.out.println("消费者获取生产者消息 :" + msg);
}
};
// 消费者监听队列消息 true 代表自动签收
channel.basicConsume(QUEUE_NAME, true, consumer);
}
}
短信消费者:
// 信息消费者
public class TextConsumer {
private static final String QUEUE_NAME = "rabbitmq_pubsub_text_queue_one";
private static final String EXCHANGE_NAME = "rabbitmq_pubsub_exchanger_one"; public static void main(String[] args) throws IOException, TimeoutException { System.out.println("短信消费者。。。");
Connection connection = MQConnectionUtils.getConnection(); Channel channel = connection.createChannel();
// 定义队列
channel.queueDeclare(QUEUE_NAME, false, false, false, null);
// 将队列和交换机进行绑定
channel.queueBind(QUEUE_NAME, EXCHANGE_NAME, ""); DefaultConsumer consumer = new DefaultConsumer(channel) {
@Override
public void handleDelivery(String consumerTag, Envelope envelope, BasicProperties properties, byte[] body)
throws IOException {
String msg = new String(body, "UTF-8");
System.out.println("消费者获取生产者消息 :" + msg);
}
};
// 消费者监听队列消息 true 代表自动签收
channel.basicConsume(QUEUE_NAME, true, consumer);
} }
4,路由模式:采用direct 交换机
producer:
public class Producer {
// 定义交换机名称
private static final String EXCHANGE_NAME = "rabbitmq_direct_exchanger_one";
// 定义交换机类型
private static final String EXCHANGE_TYPE = "direct";
// 定义路由
private static final String ROUTINGKEY = "info";
public static void main(String[] args) throws IOException, TimeoutException {
// 和rabbitmq 建立连接
Connection connection = MQConnectionUtils.getConnection();
// 创建channel
Channel channel = connection.createChannel();
// 创建交换机
channel.exchangeDeclare(EXCHANGE_NAME, EXCHANGE_TYPE);
String message = "pub/sub";
channel.basicPublish(EXCHANGE_NAME, ROUTINGKEY, null, message.getBytes());
channel.close();
connection.close();
}
}
邮件消费者:
public class EmailConsumer {
private static final String QUEUE_NAME = "rabbitmq_direct_email_queue_one";
private static final String EXCHANGE_NAME = "rabbitmq_direct_exchanger_one";
private static final String ROUTINGKEY_INFO = "info";
public static void main(String[] args) throws IOException, TimeoutException {
System.out.println("邮件消费者。。。");
Connection connection = MQConnectionUtils.getConnection();
Channel channel = connection.createChannel();
// 定义队列
channel.queueDeclare(QUEUE_NAME, false, false, false, null);
// 将队列和交换机进行绑定
channel.queueBind(QUEUE_NAME, EXCHANGE_NAME, ROUTINGKEY_INFO);
DefaultConsumer consumer = new DefaultConsumer(channel) {
@Override
public void handleDelivery(String consumerTag, Envelope envelope, BasicProperties properties, byte[] body)
throws IOException {
String msg = new String(body, "UTF-8");
System.out.println("消费者获取生产者消息 :" + msg);
}
};
// 消费者监听队列消息 true 代表自动签收
channel.basicConsume(QUEUE_NAME, true, consumer);
}
}
短信消费者:
public class TextConsumer {
private static final String QUEUE_NAME = "rabbitmq_direct_text_queue_one";
private static final String EXCHANGE_NAME = "rabbitmq_direct_exchanger_one";
// 设定路由
private static final String ROUTINGKEY_INFO = "info";
private static final String ROUTINGKEY_WARN = "warn";
public static void main(String[] args) throws IOException, TimeoutException {
System.out.println("短信消费者。。。");
Connection connection = MQConnectionUtils.getConnection();
Channel channel = connection.createChannel();
// 定义队列
channel.queueDeclare(QUEUE_NAME, false, false, false, null);
// 将队列和交换机进行绑定 绑定路由
//info 和 warn 路由的都能接收到
channel.queueBind(QUEUE_NAME, EXCHANGE_NAME, ROUTINGKEY_INFO);
channel.queueBind(QUEUE_NAME, EXCHANGE_NAME, ROUTINGKEY_WARN);
DefaultConsumer consumer = new DefaultConsumer(channel) {
@Override
public void handleDelivery(String consumerTag, Envelope envelope, BasicProperties properties, byte[] body)
throws IOException {
String msg = new String(body, "UTF-8");
System.out.println("消费者获取生产者消息 :" + msg);
}
};
// 消费者监听队列消息 true 代表自动签收
channel.basicConsume(QUEUE_NAME, true, consumer);
}
}
5,通配符模式,采用topic 交换机 # 代表任意 * 代表一个
producer:
public class Producer {
// 定义交换机名称
private static final String EXCHANGE_NAME = "rabbitmq_topic_exchanger_one";
// 定义交换机类型
private static final String EXCHANGE_TYPE = "topic";
// 定义路由
private static final String ROUTINGKEY = "routingkey.info.error.warn";
public static void main(String[] args) throws IOException, TimeoutException {
// 和rabbitmq 建立连接
Connection connection = MQConnectionUtils.getConnection();
// 创建channel
Channel channel = connection.createChannel();
// 创建交换机
channel.exchangeDeclare(EXCHANGE_NAME, EXCHANGE_TYPE);
String message = "pub/sub";
channel.basicPublish(EXCHANGE_NAME, ROUTINGKEY, null, message.getBytes());
channel.close();
connection.close();
}
}
邮件消费者:
public class EmailConsumer {
private static final String QUEUE_NAME = "rabbitmq_topic_email_queue_one";
private static final String EXCHANGE_NAME = "rabbitmq_topic_exchanger_one";
private static final String ROUTINGKEY = "routingkey.#";
public static void main(String[] args) throws IOException, TimeoutException {
System.out.println("邮件消费者。。。");
Connection connection = MQConnectionUtils.getConnection();
Channel channel = connection.createChannel();
// 定义队列
channel.queueDeclare(QUEUE_NAME, false, false, false, null);
// 将队列和交换机进行绑定
channel.queueBind(QUEUE_NAME, EXCHANGE_NAME, ROUTINGKEY);
DefaultConsumer consumer = new DefaultConsumer(channel) {
@Override
public void handleDelivery(String consumerTag, Envelope envelope, BasicProperties properties, byte[] body)
throws IOException {
String msg = new String(body, "UTF-8");
System.out.println("消费者获取生产者消息 :" + msg);
}
};
// 消费者监听队列消息 true 代表自动签收
channel.basicConsume(QUEUE_NAME, true, consumer);
}
}
短信消费者:
public class TextConsumer {
private static final String QUEUE_NAME = "rabbitmq_topic_text_queue_one";
private static final String EXCHANGE_NAME = "rabbitmq_topic_exchanger_one";
private static final String ROUTINGKEY = "routingkey.info.*";
// 设定路由
public static void main(String[] args) throws IOException, TimeoutException {
System.out.println("短信消费者。。。");
Connection connection = MQConnectionUtils.getConnection();
Channel channel = connection.createChannel();
// 定义队列
channel.queueDeclare(QUEUE_NAME, false, false, false, null);
// 将队列和交换机进行绑定 绑定路由
channel.queueBind(QUEUE_NAME, EXCHANGE_NAME, ROUTINGKEY);
DefaultConsumer consumer = new DefaultConsumer(channel) {
@Override
public void handleDelivery(String consumerTag, Envelope envelope, BasicProperties properties, byte[] body)
throws IOException {
String msg = new String(body, "UTF-8");
System.out.println("消费者获取生产者消息 :" + msg);
}
};
// 消费者监听队列消息 true 代表自动签收
channel.basicConsume(QUEUE_NAME, true, consumer);
}
}
高性能RabbitMQ的更多相关文章
- 缓存、队列(Memcached、redis、RabbitMQ)
本章内容: Memcached 简介.安装.使用 Python 操作 Memcached 天生支持集群 redis 简介.安装.使用.实例 Python 操作 Redis String.Hash.Li ...
- .Net使用RabbitMQ详解
序言 这里原来有一句话,触犯啦天条,被阉割!!!! 首先不去讨论我的日志组件怎么样.因为有些日志需要走网络,有的又不需要走网路,也是有性能与业务场景的多般变化在其中,就把他抛开,我们只谈消息Rabbi ...
- springboot(八):RabbitMQ详解
RabbitMQ 即一个消息队列,主要是用来实现应用程序的异步和解耦,同时也能起到消息缓冲,消息分发的作用. 消息中间件在互联网公司的使用中越来越多,刚才还看到新闻阿里将RocketMQ捐献给了apa ...
- RabbitMQ 高可用集群搭建及电商平台使用经验总结
面向EDA(事件驱动架构)的方式来设计你的消息 AMQP routing key的设计 RabbitMQ cluster搭建 Mirror queue policy设置 两个不错的RabbitMQ p ...
- Python 【第六章】:Python操作 RabbitMQ、Redis、Memcache、SQLAlchemy
Memcached Memcached 是一个高性能的分布式内存对象缓存系统,用于动态Web应用以减轻数据库负载.它通过在内存中缓存数据和对象来减少读取数据库的次数,从而提高动态.数据库驱动网站的速度 ...
- 基于Netty与RabbitMQ的消息服务
Netty作为一个高性能的异步网络开发框架,可以作为各种服务的开发框架. 前段时间的一个项目涉及到硬件设备实时数据的采集,采用Netty作为采集服务的实现框架,同时使用RabbitMQ作为采集服务和各 ...
- 缓存、队列(Memcached,Redis,rabbitMQ)
一.Memcached Memcached 是一个高性能的分布式内存对象缓存系统,用于动态Web应用以减轻数据库负载.它通过在内存中缓存数据和对象来减少读取数据库的次数,从而提高动态.数据库驱动网站的 ...
- 网易蜂巢微服务架构:用RabbitMQ实现轻量级通信
本次分享内容由三个部分组成: 微服务架构与MQ RabbitMQ场景分析与优化 RabbitMQ在网易蜂巢中的应用和案例分享 1微服务架构与MQ 微服务架构是一种架构模式,它将单体应用划分成一组微小的 ...
- 消息中间件:RabbitMQ基本探索
RabbitMQ是一个基于AMQP协议(Advanced Message Queuing Protocol,一个提供统一消息服务的应用层标准高级消息队列协议,是应用层协议的一个开放标准,为面向消息的中 ...
随机推荐
- 一步一步理解AdaBoosting(Adaptive Boosting)算法
最近学习<西瓜书>的集成学习之Boosting算法,看了一个很好的例子(https://zhuanlan.zhihu.com/p/27126737),为了方便以后理解,现在更详细描述一下步 ...
- LeetCode 题解 | 面试题 10.01. 合并排序的数组
给定两个排序后的数组 A 和 B,其中 A 的末端有足够的缓冲空间容纳 B. 编写一个方法,将 B 合并入 A 并排序. 初始化 A 和 B 的元素数量分别为 m 和 n. 示例: 输入: A = [ ...
- hue初识
Hue Web应用的架构 Hue 是一个Web应用,用来简化用户和Hadoop集群的交互.Hue技术架构,如下图所示,从总体上来讲,Hue应用采用的是B/S架构,该web应用的后台采用python编程 ...
- HBuilder-X 关闭eslint-vue 插件语法检查
HBuilder-X 在写vue项目的时候发现,代码在保存的时候回自动检查eslint语法,会报一大堆的红色警告! 这时候就很烦人,看着不爽,看了下eslint 配置里面介绍了关闭语法检查的配置-- ...
- 编程史话第四期-饱受争议的前端之王JavaScript的血泪成长史
写在前面 这篇博文主要介绍javaScript的发展史,根据作者在B站发布的同名视频的文案整理修改而成,对视频感兴趣的博友可访问https://www.bilibili.com/video/av945 ...
- 关于使用fastjson出现的问题:com.alibaba.fastjson.JSONException: syntax error, expect {, actual string, pos 1, fastjson-version 1.2.44
先说下需求:是从redis中根据keys批量获取数据集合,再通过fastjson转为对象集合 代码如下: 在postman测试后,出现错误如下: 刚开始以为是使用fstjson方法不对,后面先通过打断 ...
- 基于springcloud搭建项目-公共篇(二)
上一篇已经写过如何搭建注册中心eureka,这一篇主要是搭建一些公共的api接口服务,并把实体类单独拿出来放到一个服务上引用,比较简单的 1.首先.创建一个实体类服务,这样就不用在每个服务里创建实体了 ...
- js中排序方法
有些代码一两个月都会忘了,有空多做下总结,记录下来,等需要用到的时候可以来翻翻总结的博客.写技术博客,对自己是一种总结,对别人,是一种参考. 1.sort()方法 var ar1=[2,4,6,8,1 ...
- ajax js分页算法分析
显示效果:[页面总数小于等于10,全部显示,当前页特殊显示]上一页 1 2 3 4 5 6 7 8 9 10 下一页 [页面总数大于10,部分显示,当前页特殊 ...
- seldom之数据驱动
seldom之数据驱动 如果自动化某个功能,测试数据不一样而操作步骤是一样的,那么就可以使用参数化来节省测试代码. seldom是我在维护一个Web UI自动化测试框,这里跟大家分享seldom参数化 ...