使用metrics统计接口tps
metrics的简单介绍
metrics是一种性能指标工具,有很多开源工具使用之来来作为其性能监控,如Hadoop,Kafka,Spark,JStorm等。
metrics使用最主要有三个东西:
- Metric Registries
- Metrics 度量指标的类型
- Metrics Report 数据展示方案
metricsRegistry
MetricRegistry类是Metrics的核心,它是存放应用中所有metrics的容器。也是我们使用 Metrics 库的起点。
每一个 metric 都有它独一无二的名字,Metrics 中使用句点名字,如 com.example.Queue.size。当你在 com.example.Queue 下有两个 metric 实例,可以指定地更具体:com.example.Queue.requests.size 和 com.example.Queue.response.size 。使用MetricRegistry类,可以非常方便地生成名字。
五种Metrics类型
guages
最简单的度量指标,只有一个简单的返回值,或者叫瞬时状态,例如,我们想衡量一个待处理队列中任务的个数。
Counters
Counter 就是计数器,Counter 只是用 Gauge 封装了 AtomicLong 。
Meters
Meter度量一系列事件发生的速率(rate),例如TPS。Meters会统计最近1分钟,5分钟,15分钟,还有全部时间的速率。
Histograms
Histogram统计数据的分布情况。比如最小值,最大值,中间值,还有中位数,75百分位, 90百分位, 95百分位, 98百分位, 99百分位, 和 99.9百分位的值(percentiles)。
Timers
Timer其实是 Histogram 和 Meter 的结合, histogram 某部分代码/调用的耗时, meter统计TPS。
怎么使用暂时不给出代码了,先来看看如何统计接口的tps
Metrics Report
metrics提供了丰富的Report,如JMX、Console、CSV、SLF4J以及图形、HTTP等等
统计接口tps
我采取的办法是使用spring的interceptor与Meters ,Report使用的是ConsoleReport,代码如下
package lew.bing.exp.spr;
import com.codahale.metrics.ConsoleReporter;
import com.codahale.metrics.Meter;
import com.codahale.metrics.Metric;
import com.codahale.metrics.MetricRegistry;
import org.springframework.web.servlet.HandlerInterceptor;
import org.springframework.web.servlet.ModelAndView;
import javax.servlet.http.HttpServletRequest;
import javax.servlet.http.HttpServletResponse;
import java.util.HashMap;
import java.util.Map;
import java.util.concurrent.TimeUnit;
/**
* Created by 刘国兵 on 2018/7/14.
*/
public class MetricsInterceptor implements HandlerInterceptor {
private Map<String,Meter> metricMap = new HashMap<>();
private MetricRegistry metrics = new MetricRegistry();
public MetricsInterceptor() {
metricMap.put("/",metrics.meter("/"));
ConsoleReporter reporter = ConsoleReporter.forRegistry(metrics)
.convertRatesTo(TimeUnit.SECONDS)
.convertDurationsTo(TimeUnit.MILLISECONDS)
.build();
reporter.start(1, TimeUnit.SECONDS);// 1s报道一次
}
@Override
public boolean preHandle(HttpServletRequest request, HttpServletResponse response, Object handler) throws Exception {
String servletPath = request.getServletPath();
if (metricMap.containsKey(servletPath)) {
metricMap.get(servletPath).mark();// 统计tps
}
return true;
}
@Override
public void postHandle(HttpServletRequest request, HttpServletResponse response, Object handler, ModelAndView modelAndView) throws Exception {
}
@Override
public void afterCompletion(HttpServletRequest request, HttpServletResponse response, Object handler, Exception ex) throws Exception {
// 可以统计失败以及成功次数
}
}
连续点击浏览器请求接口,控制台打印如下:
18-7-14 18:36:08 ===============================================================
-- Meters ----------------------------------------------------------------------
/
count = 3
mean rate = 0.60 events/second
1-minute rate = 0.60 events/second
5-minute rate = 0.60 events/second
15-minute rate = 0.60 events/second
18-7-14 18:36:09 ===============================================================
-- Meters ----------------------------------------------------------------------
/
count = 10
mean rate = 1.67 events/second
1-minute rate = 0.60 events/second
5-minute rate = 0.60 events/second
15-minute rate = 0.60 events/second
18-7-14 18:36:10 ===============================================================
-- Meters ----------------------------------------------------------------------
/
count = 15
mean rate = 2.14 events/second
1-minute rate = 0.60 events/second
5-minute rate = 0.60 events/second
15-minute rate = 0.60 events/second
18-7-14 18:36:11 ===============================================================
-- Meters ----------------------------------------------------------------------
/
count = 21
mean rate = 2.62 events/second
1-minute rate = 0.60 events/second
5-minute rate = 0.60 events/second
15-minute rate = 0.60 events/second
18-7-14 18:36:12 ===============================================================
-- Meters ----------------------------------------------------------------------
/
count = 27
mean rate = 3.00 events/second
1-minute rate = 0.60 events/second
5-minute rate = 0.60 events/second
15-minute rate = 0.60 events/second
18-7-14 18:36:13 ===============================================================
-- Meters ----------------------------------------------------------------------
/
count = 33
mean rate = 3.30 events/second
1-minute rate = 1.03 events/second
5-minute rate = 0.69 events/second
15-minute rate = 0.63 events/second
18-7-14 18:36:14 ===============================================================
-- Meters ----------------------------------------------------------------------
/
count = 38
mean rate = 3.45 events/second
1-minute rate = 1.03 events/second
5-minute rate = 0.69 events/second
15-minute rate = 0.63 events/second
18-7-14 18:36:15 ===============================================================
-- Meters ----------------------------------------------------------------------
/
count = 44
mean rate = 3.66 events/second
1-minute rate = 1.03 events/second
5-minute rate = 0.69 events/second
15-minute rate = 0.63 events/second
18-7-14 18:36:16 ===============================================================
-- Meters ----------------------------------------------------------------------
/
count = 50
mean rate = 3.84 events/second
1-minute rate = 1.03 events/second
5-minute rate = 0.69 events/second
15-minute rate = 0.63 events/second
18-7-14 18:36:17 ===============================================================
-- Meters ----------------------------------------------------------------------
/
count = 55
mean rate = 3.93 events/second
1-minute rate = 1.03 events/second
5-minute rate = 0.69 events/second
15-minute rate = 0.63 events/second
18-7-14 18:36:18 ===============================================================
-- Meters ----------------------------------------------------------------------
/
count = 61
mean rate = 4.06 events/second
1-minute rate = 1.40 events/second
5-minute rate = 0.77 events/second
15-minute rate = 0.66 events/second
18-7-14 18:36:19 ===============================================================
-- Meters ----------------------------------------------------------------------
/
count = 67
mean rate = 4.19 events/second
1-minute rate = 1.40 events/second
5-minute rate = 0.77 events/second
15-minute rate = 0.66 events/second
18-7-14 18:36:20 ===============================================================
-- Meters ----------------------------------------------------------------------
/
count = 72
mean rate = 4.23 events/second
1-minute rate = 1.40 events/second
5-minute rate = 0.77 events/second
15-minute rate = 0.66 events/second
18-7-14 18:36:21 ===============================================================
-- Meters ----------------------------------------------------------------------
/
count = 78
mean rate = 4.33 events/second
1-minute rate = 1.40 events/second
5-minute rate = 0.77 events/second
15-minute rate = 0.66 events/second
18-7-14 18:36:22 ===============================================================
-- Meters ----------------------------------------------------------------------
/
count = 83
mean rate = 4.37 events/second
1-minute rate = 1.40 events/second
5-minute rate = 0.77 events/second
15-minute rate = 0.66 events/second
18-7-14 18:36:23 ===============================================================
-- Meters ----------------------------------------------------------------------
/
count = 89
mean rate = 4.45 events/second
1-minute rate = 1.73 events/second
5-minute rate = 0.85 events/second
15-minute rate = 0.68 events/second
18-7-14 18:36:24 ===============================================================
-- Meters ----------------------------------------------------------------------
/
count = 92
mean rate = 4.38 events/second
1-minute rate = 1.73 events/second
5-minute rate = 0.85 events/second
15-minute rate = 0.68 events/second
18-7-14 18:36:25 ===============================================================
-- Meters ----------------------------------------------------------------------
/
count = 92
mean rate = 4.18 events/second
1-minute rate = 1.73 events/second
5-minute rate = 0.85 events/second
15-minute rate = 0.68 events/second
18-7-14 18:36:26 ===============================================================
-- Meters ----------------------------------------------------------------------
/
count = 92
mean rate = 4.00 events/second
1-minute rate = 1.73 events/second
5-minute rate = 0.85 events/second
15-minute rate = 0.68 events/second
18-7-14 18:36:27 ===============================================================
-- Meters ----------------------------------------------------------------------
/
count = 92
mean rate = 3.83 events/second
1-minute rate = 1.73 events/second
5-minute rate = 0.85 events/second
15-minute rate = 0.68 events/second
18-7-14 18:36:28 ===============================================================
-- Meters ----------------------------------------------------------------------
/
count = 92
mean rate = 3.68 events/second
1-minute rate = 1.64 events/second
5-minute rate = 0.85 events/second
15-minute rate = 0.68 events/second
18-7-14 18:36:29 ===============================================================
-- Meters ----------------------------------------------------------------------
/
count = 92
mean rate = 3.54 events/second
1-minute rate = 1.64 events/second
5-minute rate = 0.85 events/second
15-minute rate = 0.68 events/second
18-7-14 18:36:30 ===============================================================
-- Meters ----------------------------------------------------------------------
/
count = 92
mean rate = 3.41 events/second
1-minute rate = 1.64 events/second
5-minute rate = 0.85 events/second
15-minute rate = 0.68 events/second
18-7-14 18:36:31 ===============================================================
-- Meters ----------------------------------------------------------------------
/
count = 92
mean rate = 3.29 events/second
1-minute rate = 1.64 events/second
5-minute rate = 0.85 events/second
15-minute rate = 0.68 events/second
18-7-14 18:36:32 ===============================================================
-- Meters ----------------------------------------------------------------------
/
count = 92
mean rate = 3.17 events/second
1-minute rate = 1.64 events/second
5-minute rate = 0.85 events/second
15-minute rate = 0.68 events/second
18-7-14 18:36:33 ===============================================================
-- Meters ----------------------------------------------------------------------
/
count = 92
mean rate = 3.07 events/second
1-minute rate = 1.51 events/second
5-minute rate = 0.83 events/second
15-minute rate = 0.68 events/second
18-7-14 18:36:34 ===============================================================
-- Meters ----------------------------------------------------------------------
/
count = 92
mean rate = 2.97 events/second
1-minute rate = 1.51 events/second
5-minute rate = 0.83 events/second
15-minute rate = 0.68 events/second
18-7-14 18:36:35 ===============================================================
-- Meters ----------------------------------------------------------------------
/
count = 92
mean rate = 2.87 events/second
1-minute rate = 1.51 events/second
5-minute rate = 0.83 events/second
15-minute rate = 0.68 events/second
18-7-14 18:36:36 ===============================================================
-- Meters ----------------------------------------------------------------------
/
count = 92
mean rate = 2.79 events/second
1-minute rate = 1.51 events/second
5-minute rate = 0.83 events/second
15-minute rate = 0.68 events/second
18-7-14 18:36:37 ===============================================================
-- Meters ----------------------------------------------------------------------
/
count = 92
mean rate = 2.71 events/second
1-minute rate = 1.51 events/second
5-minute rate = 0.83 events/second
15-minute rate = 0.68 events/second
18-7-14 18:36:38 ===============================================================
-- Meters ----------------------------------------------------------------------
/
count = 92
mean rate = 2.63 events/second
1-minute rate = 1.39 events/second
5-minute rate = 0.82 events/second
15-minute rate = 0.68 events/second
简单的使用metrics统计tps就介绍到这,metrics还有健康检查,可以用来检测连接数据库是否可用等,感兴趣的同学可以多了解了解。
作者:247609107a39
链接:https://www.jianshu.com/p/f9b911a651ff
来源:简书
简书著作权归作者所有,任何形式的转载都请联系作者获得授权并注明出处。
使用metrics统计接口tps的更多相关文章
- 使用awk根据多维度统计系统tps
业务简单日志格式: [2017-08-28 01:00:00.523]transfer_search,7001045,1708271100083774377,20170827,,,,,,,,,,001 ...
- 齐博x1万能数据统计接口
为何叫万能数据统计接口呢?因为可以调用全站任何数据表的数据总条数,并且可以设置查询条件http://qb.net/index.php/index/wxapp.count.html?table=memb ...
- 通信统计接口字段填充内容shell脚本
现在通信行业上班,最麻烦的就是计算各个协议接口字段填充的内容是否正确.经历了小白似的一个个字段统计在到单个接口所有字段统计,然后到现在的多个接口一次统计.在大大节省了时间的同时,让自己有更充足的时间来 ...
- nginx 日志统计接口每个小时访问量
指定时间段增量统计nginx日志不同接口的访问量: #!/bin/bash#此脚本用于统计nginx日志当前时间15分钟之内不同接口(URL)的访问量统计LOG=/usr/local/nginx/lo ...
- awk 按小时 统计接口调用次数
#统计所有接口总量awk -F ' ' '{a[$7]++} END{for(i in a){print i,a[i] | "sort -r -k 7"}}' accesslog/ ...
- 从线上日志统计接口访问量QPS
这一阵子在面试,连续遇到好几家(大小厂都有)问我的项目线上qps的情况了,说实话,我作为一个大头兵,本来没关注过这个数据,只能含混地给个"大概.也许"的回答. 回来之后,我决定对业 ...
- 百度统计接口demo中错误
百度统计接口中的demo(PHP版本)下载下来配置后运行出错,应该是编写demo时用的php版本比较低吧,作如下几处修改就好了 一:把CURLOPT_SSL_VERIFYHOST的值改为2,因为1版本 ...
- springMVC Aspect AOP 接口耗时统计
在接口开发中,我们通常需要统计接口耗时,为后续接口性能做统计.在springMVC中可以用它的aop来记录日志. 1.在spring配置文件中开启AOP <!--*************** ...
- 在网页中运用统计Web Service接口
(2017-02-10 银河统计) 在"统计随机数及临界值Web Service接口"一文中介绍了常用统计分布四类Web Service接口(随机数.分位数.密度函数和累积分布函数 ...
随机推荐
- 20175320 2018-2019-2 《Java程序设计》第3周学习总结
20175320 2018-2019-2 <Java程序设计>第3周学习总结 教材学习内容总结 本周学习了教材的第四章的内容.在这章中介绍了面向对象编程的概念以及Java编程中的类与对象, ...
- dataTransfer对象
HTML5拖拽的数据传输 虽然通过dragstart.drag和dragend事件实现了原生拖拽.但是这仅仅是拖拽,在IE6和IE7中还是有些拖拽问题,并且也没有实现数据的交换.为了实现数据的交换,I ...
- 前端 html 篇
1 link和@import的区别是? 区别1:link是XHTML标签,除了加载CSS外,还可以定义RSS等其他事务:@import属于CSS范畴,只能加载CSS. 区别2:link引用CS ...
- MySql查看与修改auto_increment方法(转)
add by zhj: 在创建表时,如果没有显式的指定AUTO_INCREMENT的值,那它默认是1 原文:https://blog.csdn.net/fdipzone/article/detail ...
- js事件冒泡和事件捕捉
结论:他们是描述事件触发时序问题的术语.事件捕获指的是从document到触发事件的那个节点,即自上而下的去触发事件.相反的,事件冒泡是自下而上的去触发事件.绑定事件方法的第三个参数,就是控制事件触发 ...
- 蓝桥杯近三年初赛题之一(15年b组)
临近比赛,自己定时做了近三年的初赛题,不是很理想,10道题平均做对5+道.为了这次比赛,总共做了200题左右吧,估计去北京参加决赛有点难,不过不管怎样,对得起自己万余行代码就好. 一.15年初赛题(第 ...
- 基于Jenkins实现持续集成【持续更新中】
持续集成 1.什么是持续集成:Continuous integration (CI)持续集成是一种软件开发实践,即团队开发成员经常集成他们的工作,通常每个成员每天至少集成一次,也就意味着每天可能会发生 ...
- C# 调用C++的dll 那些事
之前从来没搞过C++,最近被安排的任务需要调用C++的接口,对于一个没用过 Dependency 的小白来说,原本以为像平时的Http接口那样,协议,端口一定义,方法参数一写就没事,结果踩了无数的坑. ...
- Lua 求当前月份的最大天数
[1]实现代码 -- 第一种方式:简写 , day = })) print('The first way result : dayAmount = ' .. dayAmount) -- 第二种方式:分 ...
- python核心技术
基本语法 Python的设计目标之一是让代码具备高度的可阅读性.它设计时尽量使用其它语言经常使用的标点符号和英文单字,让代码看起来整洁美观.它不像其他的静态语言如C.Pascal那样需要重复书写声明语 ...