Rabbitmq之高级特性——实现消费端限流&NACK重回队列
如果是高并发下,rabbitmq服务器上收到成千上万条消息,那么当打开消费端时,这些消息必定喷涌而来,导致消费端消费不过来甚至挂掉都有可能。
在非自动确认的模式下,可以采用限流模式,rabbitmq 提供了服务质量保障qos机制来控制一次消费消息数量。
下面直接上代码:
生产端:
package com.zxy.demo.rabbitmq; import java.io.IOException;
import java.util.concurrent.TimeoutException; import com.rabbitmq.client.AMQP;
import com.rabbitmq.client.Channel;
import com.rabbitmq.client.ConfirmListener;
import com.rabbitmq.client.Connection;
import com.rabbitmq.client.ConnectionFactory;
import com.rabbitmq.client.ReturnListener;
import com.rabbitmq.client.AMQP.BasicProperties; public class Producter { public static void main(String[] args) throws IOException, TimeoutException {
// TODO Auto-generated method stub
ConnectionFactory factory = new ConnectionFactory();
factory.setHost("192.168.10.110");
factory.setPort(5672);
factory.setUsername("guest");
factory.setPassword("guest");
factory.setVirtualHost("/");
Connection conn = factory.newConnection();
Channel channel = conn.createChannel();
String exchange001 = "exchange_001";
String queue001 = "queue_001";
String routingkey = "mq.topic";
String body = "hello rabbitmq!===============限流策略";
// 开启确认模式
channel.confirmSelect();
// 循环发送多条消息
for(int i = 0 ;i<10;i++){
channel.basicPublish(exchange001, routingkey, null, body.getBytes());
} // 添加一个返回监听========消息返回模式重要添加
channel.addConfirmListener(new ConfirmListener() { @Override
public void handleNack(long deliveryTag, boolean multiple) throws IOException {
System.out.println("===========NACK============"); } @Override
public void handleAck(long deliveryTag, boolean multiple) throws IOException {
System.out.println("===========ACK============"); }
});
} }
消费端:
package com.zxy.demo.rabbitmq; import java.io.IOException;
import java.util.concurrent.TimeoutException; import com.rabbitmq.client.Channel;
import com.rabbitmq.client.Connection;
import com.rabbitmq.client.ConnectionFactory; public class Receiver { public static void main(String[] args) throws IOException, TimeoutException, InterruptedException {
// TODO Auto-generated method stub
ConnectionFactory factory = new ConnectionFactory();
factory.setHost("192.168.10.110");
factory.setPort(5672);
factory.setUsername("guest");
factory.setPassword("guest");
factory.setVirtualHost("/");
Connection conn = factory.newConnection();
Channel channel = conn.createChannel();
String exchange001 = "exchange_001";
String queue001 = "queue_001";
String routingkey = "mq.*";
channel.exchangeDeclare(exchange001, "topic", true, false, null);
channel.queueDeclare(queue001, true, false, false, null);
channel.queueBind(queue001, exchange001, routingkey);
// 设置限流策略
// channel.basicQos(获取消息最大数[0-无限制], 依次获取数量, 作用域[true作用于整个channel,false作用于具体消费者]);
channel.basicQos(0, 2, false);
// 自定义消费者
MyConsumer myConsumer = new MyConsumer(channel);
// 进行消费,签收模式一定要为手动签收
Thread.sleep(3000);
channel.basicConsume(queue001, false, myConsumer);
} }
自定义消费者:
package com.zxy.demo.rabbitmq; import java.io.IOException; import com.rabbitmq.client.AMQP.BasicProperties;
import com.rabbitmq.client.Channel;
import com.rabbitmq.client.DefaultConsumer;
import com.rabbitmq.client.Envelope; /**
* 可以继承,可以实现,实现的话要覆写的方法比较多,所以这里用了继承
*
*/
public class MyConsumer extends DefaultConsumer{
private Channel channel;
public MyConsumer(Channel channel) {
super(channel);
// TODO Auto-generated constructor stub
this.channel=channel;
} @Override
public void handleDelivery(String consumerTag, Envelope envelope, BasicProperties properties, byte[] body)
throws IOException {
System.out.println("消费标签:"+consumerTag);
System.out.println("envelope.getDeliveryTag():==="+envelope.getDeliveryTag());
System.out.println("envelope.getExchange():==="+envelope.getExchange());
System.out.println("envelope.getRoutingKey():==="+envelope.getRoutingKey());
System.out.println("body:==="+new String(body));
// 手动签收,一定要有消费者签收,如果没有如下代码,则限流模式下,仅能打印出来channel.basicQos(0, 2, false);第二参数的2条信息
channel.basicAck(envelope.getDeliveryTag(), false);
} }
重回队列模式,是当投递消息失败时,让该消息重新回到队列的模式,该模式需要手动签收,并需要在消费者中进行判断,调用重回队列的确认模式
代码如下
生产端:
package com.zxy.demo.rabbitmq; import java.io.IOException;
import java.util.HashMap;
import java.util.Map;
import java.util.concurrent.TimeoutException; import org.springframework.amqp.core.Message; import com.rabbitmq.client.AMQP.BasicProperties;
import com.rabbitmq.client.Channel;
import com.rabbitmq.client.ConfirmListener;
import com.rabbitmq.client.Connection;
import com.rabbitmq.client.ConnectionFactory;
import com.rabbitmq.client.ReturnListener; public class Producter { public static void main(String[] args) throws IOException, TimeoutException {
// TODO Auto-generated method stub
ConnectionFactory factory = new ConnectionFactory();
factory.setHost("192.168.10.110");
factory.setPort(5672);
factory.setUsername("guest");
factory.setPassword("guest");
factory.setVirtualHost("/");
Connection conn = factory.newConnection();
Channel channel = conn.createChannel();
String exchange001 = "exchange_001";
String queue001 = "queue_001";
String routingkey = "mq.topic"; // 循环发送多条消息
for(int i = 0 ;i<5;i++){
String body = "hello rabbitmq!===============ACK&重回队列,第"+i+"条";
Map<String,Object> head = new HashMap<>();
head.put("n", i);
BasicProperties properties = new BasicProperties(null, "utf-8", head, 2, 1, null, null, null, null, null, null, null, null, null); channel.basicPublish(exchange001, routingkey, properties, body.getBytes());
} } }
消费端:
package com.zxy.demo.rabbitmq; import java.io.IOException;
import java.util.concurrent.TimeoutException; import com.rabbitmq.client.Channel;
import com.rabbitmq.client.Connection;
import com.rabbitmq.client.ConnectionFactory; public class Receiver { public static void main(String[] args) throws IOException, TimeoutException, InterruptedException {
// TODO Auto-generated method stub
ConnectionFactory factory = new ConnectionFactory();
factory.setHost("192.168.10.110");
factory.setPort(5672);
factory.setUsername("guest");
factory.setPassword("guest");
factory.setVirtualHost("/");
Connection conn = factory.newConnection();
Channel channel = conn.createChannel();
String exchange001 = "exchange_001";
String queue001 = "queue_001";
String routingkey = "mq.*";
channel.exchangeDeclare(exchange001, "topic", true, false, null);
channel.queueDeclare(queue001, true, false, false, null);
channel.queueBind(queue001, exchange001, routingkey);
// 自定义消费者
MyConsumer myConsumer = new MyConsumer(channel);
// 进行消费,签收模式一定要为手动签收
channel.basicConsume(queue001, false, myConsumer);
} }
自定义消费者:
package com.zxy.demo.rabbitmq; import java.io.IOException; import com.rabbitmq.client.AMQP.BasicProperties;
import com.rabbitmq.client.Channel;
import com.rabbitmq.client.DefaultConsumer;
import com.rabbitmq.client.Envelope; /**
* 可以继承,可以实现,实现的话要覆写的方法比较多,所以这里用了继承
*
*/
public class MyConsumer extends DefaultConsumer{
private Channel channel;
public MyConsumer(Channel channel) {
super(channel);
// TODO Auto-generated constructor stub
this.channel=channel;
} @Override
public void handleDelivery(String consumerTag, Envelope envelope, BasicProperties properties, byte[] body)
throws IOException {
System.out.println("消费标签:"+consumerTag);
System.out.println("envelope.getDeliveryTag():==="+envelope.getDeliveryTag());
System.out.println("envelope.getExchange():==="+envelope.getExchange());
System.out.println("envelope.getRoutingKey():==="+envelope.getRoutingKey());
System.out.println("body:==="+new String(body));
System.out.println("===================休眠以便查看===============");
try {
Thread.sleep(2000);
} catch (InterruptedException e) {
// TODO Auto-generated catch block
e.printStackTrace();
}
// 手动签收
Integer i = (Integer) properties.getHeaders().get("n");
System.out.println("iiiiiiiiiiiiiiiii======================================================"+i);
if(i==1) {
channel.basicNack(envelope.getDeliveryTag(),false, true);//第三个参数为是否重返队列
}else {
channel.basicAck(envelope.getDeliveryTag(), false);
}
} }
下面是重回队列执行结果,可以看到当消费完后第一条不断的被扔回队列然后消费再扔回。
消费标签:amq.ctag-eeeaa9jgrJ3tDhtQR2XReg
envelope.getDeliveryTag():===1
envelope.getExchange():===exchange_001
envelope.getRoutingKey():===mq.topic
body:===hello rabbitmq!===============ACK&重回队列,第0条
===================休眠以便查看===============
iiiiiiiiiiiiiiiii======================================================0
消费标签:amq.ctag-eeeaa9jgrJ3tDhtQR2XReg
envelope.getDeliveryTag():===2
envelope.getExchange():===exchange_001
envelope.getRoutingKey():===mq.topic
body:===hello rabbitmq!===============ACK&重回队列,第1条
===================休眠以便查看===============
iiiiiiiiiiiiiiiii======================================================1
消费标签:amq.ctag-eeeaa9jgrJ3tDhtQR2XReg
envelope.getDeliveryTag():===3
envelope.getExchange():===exchange_001
envelope.getRoutingKey():===mq.topic
body:===hello rabbitmq!===============ACK&重回队列,第2条
===================休眠以便查看===============
iiiiiiiiiiiiiiiii======================================================2
消费标签:amq.ctag-eeeaa9jgrJ3tDhtQR2XReg
envelope.getDeliveryTag():===4
envelope.getExchange():===exchange_001
envelope.getRoutingKey():===mq.topic
body:===hello rabbitmq!===============ACK&重回队列,第3条
===================休眠以便查看===============
iiiiiiiiiiiiiiiii======================================================3
消费标签:amq.ctag-eeeaa9jgrJ3tDhtQR2XReg
envelope.getDeliveryTag():===5
envelope.getExchange():===exchange_001
envelope.getRoutingKey():===mq.topic
body:===hello rabbitmq!===============ACK&重回队列,第4条
===================休眠以便查看===============
iiiiiiiiiiiiiiiii======================================================4
消费标签:amq.ctag-eeeaa9jgrJ3tDhtQR2XReg
envelope.getDeliveryTag():===6
envelope.getExchange():===exchange_001
envelope.getRoutingKey():===mq.topic
body:===hello rabbitmq!===============ACK&重回队列,第1条
===================休眠以便查看===============
iiiiiiiiiiiiiiiii======================================================1
消费标签:amq.ctag-eeeaa9jgrJ3tDhtQR2XReg
envelope.getDeliveryTag():===7
envelope.getExchange():===exchange_001
envelope.getRoutingKey():===mq.topic
body:===hello rabbitmq!===============ACK&重回队列,第1条
===================休眠以便查看===============
iiiiiiiiiiiiiiiii======================================================1
消费标签:amq.ctag-eeeaa9jgrJ3tDhtQR2XReg
envelope.getDeliveryTag():===8
envelope.getExchange():===exchange_001
envelope.getRoutingKey():===mq.topic
body:===hello rabbitmq!===============ACK&重回队列,第1条
===================休眠以便查看===============
iiiiiiiiiiiiiiiii======================================================1
消费标签:amq.ctag-eeeaa9jgrJ3tDhtQR2XReg
envelope.getDeliveryTag():===9
envelope.getExchange():===exchange_001
envelope.getRoutingKey():===mq.topic
body:===hello rabbitmq!===============ACK&重回队列,第1条
===================休眠以便查看===============
Rabbitmq之高级特性——实现消费端限流&NACK重回队列的更多相关文章
- Rabbitmq——实现消费端限流 --NACK重回队列
如果是高并发下,rabbitmq服务器上收到成千上万条消息,那么当打开消费端时,这些消息必定喷涌而来,导致消费端消费不过来甚至挂掉都有可能. 在非自动确认的模式下,可以采用限流模式,rabbitmq ...
- 面试官:RabbitMQ怎么实现消费端限流
哈喽!大家好,我是小奇,一位不靠谱的程序员 小奇打算以轻松幽默的对话方式来分享一些技术,如果你觉得通过小奇的文章学到了东西,那就给小奇一个赞吧 文章持续更新 一.前言 RabbitMQ有很多高级特性, ...
- SpringBoot 整合 RabbitMQ(包含三种消息确认机制以及消费端限流)
目录 说明 生产端 消费端 说明 本文 SpringBoot 与 RabbitMQ 进行整合的时候,包含了三种消息的确认模式,如果查询详细的确认模式设置,请阅读:RabbitMQ的三种消息确认模式 同 ...
- RabbitMQ 消费端限流、TTL、死信队列
目录 消费端限流 1. 为什么要对消费端限流 2.限流的 api 讲解 3.如何对消费端进行限流 TTL 1.消息的 TTL 2.队列的 TTL 死信队列 实现死信队列步骤 总结 消费端限流 1. 为 ...
- RabbitMQ消费端限流策略(十)
消费端限流: 什么是消费端限流? 场景: 我们RabbitMQ服务器有上万条未处理的消息,我们随便打开一个消费者客户端,会出现下面情况: 巨量的消息瞬间全部推送过来,但是我们单个客户端无法同时处理这么 ...
- RabbitMQ的高级特性概念理解
1.RabbitMQ中的消息如何保障百分之百的投递成功? 答:百分之百的投递成功,方案可以参考下面的2.3. 2.什么是生产者端的可靠性投递? 答:第一步,生产者保障消息的成功发出.第二步,保障Rab ...
- Rabbitmq之高级特性——百分百投递消息&消息确认模式&消息返回模式实现
rabbitmq的高级特性: 如何保障消息的百分之百成功? 要满足4个条件:生产方发送出去,消费方接受到消息,发送方接收到消费者的确认信息,完善的消费补偿机制 解决方案,1)消息落库,进行消息状态打标 ...
- RabbitMQ高级之消息限流与延时队列
人生终将是场单人旅途,孤独之前是迷茫,孤独过后是成长. 楔子 本篇是消息队列RabbitMQ的第五弹. 上篇本来打算讲述RabbitMQ的一些高级用法: 如何保证消息的可靠性? 消息队列如何进行限流? ...
- Rabbitmq的高级特性
消息如何保证100%投递成功? 什么是生产端的可靠性投递? 1.保障消息的成功发出 2.保障MQ节点的成功接收 3.发送端收到MQ节点(Broker)确认应答 4.完善的消息补偿机制 BAT互联网大厂 ...
随机推荐
- 通过Java创建XML(中文乱码已解决)
package com.zyb.xml; import java.io.FileOutputStream; import java.io.OutputStream; import java.io.Ou ...
- 若块级元素被设置为 display: table-cell 便无法设置宽度
工作中,遇到表格的单元格中的 div 设置宽度无效,后来是发现 div 被设置为 display: table-cell ,后将其修改为 display: block 则设置的宽度生效.
- unique 验证 criteria 使用
model array('code', 'unique', 'criteria' =>array('condition' =>'schoolid=:schoolid','params' = ...
- 138、Java内部类之访问内部类的私有属性
01.代码如下: package TIANPAN; class Outer { // 外部类 private String msg = "Hello World !"; class ...
- 131、Java面向对象之static关键字三(使用static定义方法)
01.代码如下: package TIANPAN; class Book { // 描述的是同一个出版社的信息 private String title; private double price; ...
- 108、Java中String类之字符串文本替换
01.代码如下: package TIANPAN; /** * 此处为文档注释 * * @author 田攀 微信382477247 */ public class TestDemo { public ...
- ssh_crm项目
1.代码 https://pan.baidu.com/s/1hudAhA8 密码:c7xu 2.总结 https://pan.baidu.com/s/1o9ArFf0 密码:hteu 3.资料 ht ...
- 洛谷 P2891 [USACO07OPEN]吃饭Dining
裸的最大流. #include <cstdio> #include <cstring> #include <queue> const int MAXN = 4e3 ...
- SpringMVC架构&组件&执行流程
SpringMVC架构: 组件: DIspatcherServlet:前端控制器.相当于mvc模式的c,是整个流程控制的中心,负责调用其他组件处理用户的请求,降低了组件之间的耦合性. HandlerM ...
- Ubuntu 16.04 编译安装&&用dpkg安装--zabbix3.4
编译安装zabbix3.4,官方有教程,但是遇到一些报错: 总结下来,需要安装这些环境: 更新系统: apt update apt upgrade 先装这些: apt-get install libm ...