logstash 解析mysql slow log
# User@Host: zjzc_app[zjzc_app] @ [10.252.148.16xx] Id: 6043127
# Query_time: 2.581184 Lock_time: 0.000336 Rows_sent: 6 Rows_examined: 6331310
SET timestamp=1472536079;
select temp.* from ( SELECT
*
FROM
(SELECT
c.sn,
c.userNick,
c.mobilePhone,
date_format(c.registerTime,'%Y/%m/%d') registerTime,
cp.personName,
cp.personCardNo,
cp.gender,
cp.personAuthStatus,
asm.clientManagerSn,
(select personName from ClientPersonalInfo where clientSn = asm.clientManagerSn) as clientManagerName,
IF(1600=asm.clientManagerSn or 1600 IS null, 1, 0) as isMyself,
IFNULL(cei.policyAreaSn,IF( LENGTH(SUBSTRING_INDEX(cm.`governAreas`,';',2))=LENGTH(cm.`governAreas`),SUBSTRING_INDEX(cm.`governAreas`,';',1),NULL )) policyAreaSn,
area.areaName as policyAreaName,
(SELECT IFNULL(SUM(capitalBalance), 0) + IFNULL(SUM(yieldBalance), 0)
FROM view_client_invest_summary
WHERE status =2 AND clientSn=c.`sn` AND DATEDIFF(settlementDate,CURDATE()) <=7
AND DATEDIFF(settlementDate,CURDATE()) >=0 ) investBalance,
(SELECT IFNULL(SUM(capitalBalance), 0) + IFNULL(SUM(yieldBalance), 0)
FROM view_client_invest_summary pr
WHERE pr.clientSn = c.sn AND pr.status = 2 ) unclearedBalance,
(SELECT IFNULL(SUM(capitalBalance), 0) + cai.availableBalance + cai.frozenWithDraw +tra.availableBalance
FROM view_client_invest_summary
WHERE clientSn = c.sn AND status in(1,2)) totalBalance,
(cai.frozenWithDraw + cai.frozenPay) frozenBalance,(cai.availableBalance+tra.availableBalance) availableBalance
FROM
Client c
LEFT JOIN ClientExtraInfo cei on c.sn=cei.clientSn
LEFT JOIN Area area on cei.policyAreaSn=area.sn
LEFT JOIN AssignClientManager asm ON asm.clientSn=c.sn
LEFT JOIN ClientManager cm on cm.sn = asm.clientManagerSn
LEFT JOIN TransferClientAssetInfo tra on c.sn=tra.clientSn,
ClientPersonalInfo cp, ClientAssetInfo cai
WHERE
c.sn = cp.clientSn AND asm.status='1'
AND c.sn = cai.clientSn AND exists (select * from ClientInvestOrder where clientSn = c.sn and status =3) AND c.sn IN (SELECT
asm.clientSn
FROM
AssignClientManager asm
WHERE
asm.clientManagerSn IN
(
1600
) AND asm.status='1')
) t ORDER BY t.clientManagerSn desc,t.sn desc ) temp limit 10,10;
# Time: 160830 14:22:27 (?m)\s*# User@Host:\s+\S+\[%{USER:user}\]\s+@\s+\[%{IP:clientip}\]\s+(?<id>(\S+\s+)*\S+)\s*#\s+Query_time:\s+%{NUMBER:Query_time}\s+Lock_time: %{NUMBER:lock_time}\s+Rows_sent: %{NUMBER:rows_sent}\s+Rows_examined: %{NUMBER:rows_examined}\s*
SET\s+timestamp=%{NUMBER:timestamp};\s*(?<query>(\S+\s+).*)\s*#\s+Time:\s+.* {
"user": [
[
"zjzc_app"
]
],
"clientip": [
[
"10.252.148.164"
]
],
"id": [
[
"Id: 6043127"
]
],
"Query_time": [
[
"2.581184"
]
],
"lock_time": [
[
"0.000336"
]
],
"rows_sent": [
[
"6"
]
],
"rows_examined": [
[
"6331310"
]
],
"timestamp": [
[
"1472536079"
]
],
"query": [
[
"select temp.* from ( SELECT \n\t\t *\n\t\tFROM\n\t\t (SELECT \n\t\t c.sn,\n\t c.userNick,\n\t c.mobilePhone,\n\t date_format(c.registerTime,'%Y/%m/%d') registerTime,\n\t cp.personName,\n\t cp.personCardNo,\n\t cp.gender,\n\t cp.personAuthStatus,\n\t asm.clientManagerSn,\n\t (select personName from ClientPersonalInfo where clientSn = asm.clientManagerSn) as clientManagerName,\n\t IF(1600=asm.clientManagerSn or 1600 IS null, 1, 0) as isMyself,\n\t IFNULL(cei.policyAreaSn,IF( LENGTH(SUBSTRING_INDEX(cm.`governAreas`,';',2))=LENGTH(cm.`governAreas`),SUBSTRING_INDEX(cm.`governAreas`,';',1),NULL )) policyAreaSn,\n\t area.areaName as policyAreaName,\n\t\t\t (SELECT IFNULL(SUM(capitalBalance), 0) + IFNULL(SUM(yieldBalance), 0)\n\t\t\t\tFROM view_client_invest_summary \n\t\t\t\tWHERE status =2 AND clientSn=c.`sn` AND DATEDIFF(settlementDate,CURDATE()) <=7 \n\t\t\t\tAND DATEDIFF(settlementDate,CURDATE()) >=0 ) investBalance,\n\t\t\t (SELECT IFNULL(SUM(capitalBalance), 0) + IFNULL(SUM(yieldBalance), 0)\n\t\t\t\tFROM view_client_invest_summary pr\n\t\t\t\tWHERE pr.clientSn = c.sn AND pr.status = 2 ) unclearedBalance,\n\t\t\t (SELECT IFNULL(SUM(capitalBalance), 0) + cai.availableBalance + cai.frozenWithDraw +tra.availableBalance\n\t\t\t\tFROM view_client_invest_summary\n\t\t\t\tWHERE clientSn = c.sn AND status in(1,2)) totalBalance,\n\t\t\t (cai.frozenWithDraw + cai.frozenPay) frozenBalance,(cai.availableBalance+tra.availableBalance) availableBalance\n\t\t FROM\n\t\t Client c \n\t\t LEFT JOIN ClientExtraInfo cei on c.sn=cei.clientSn \n\t\t LEFT JOIN Area area on cei.policyAreaSn=area.sn\n\t\t LEFT JOIN AssignClientManager asm ON asm.clientSn=c.sn\n\t\t LEFT JOIN ClientManager cm on cm.sn = asm.clientManagerSn\n\t\t LEFT JOIN TransferClientAssetInfo tra on c.sn=tra.clientSn, \n\t\t ClientPersonalInfo cp, ClientAssetInfo cai\n\t\t WHERE\n\t\t c.sn = cp.clientSn AND asm.status='1'\n\t\t AND c.sn = cai.clientSn\n\t\t \n\t\t \t\t \n\t\t \t\t\tAND exists (select * from ClientInvestOrder where clientSn = c.sn and status =3)\n\t\t \t\t \n\t\t \t\t \n\t\t AND c.sn IN (SELECT \n\t\t asm.clientSn\n\t\t FROM\n\t\t AssignClientManager asm\n\t\t WHERE\n\t\t asm.clientManagerSn IN \n\t\t ( \n \t\t 1600\n \t\t ) \n \t\t \n \t\tAND asm.status='1')\t\t\n\t\t ) t\n\t\t \n\t\tORDER BY\n\t\t \n\t\tt.clientManagerSn desc,t.sn desc ) temp limit 10,10;\n"
]
]
}
logstash 解析mysql slow log的更多相关文章
- MySQL Slow Log慢日志分析【转】
如果你的MySQL出现了性能问题,第一个需要“诊断”的就是slow log(慢日志)了. slow log文件很小,使用more less等命令就足够了.如果slow log很大怎么办?这里介绍MyS ...
- mysql slow log分析工具的比较
mysql 中的 slow log 是用来记录执行时间较长(超过 long_query_time 秒)的 sql 的一种日志工具. 启用 slow log 在 my.cnf 中设置 [mysqld] ...
- ELK logstash 处理MySQL慢查询日志
在生产环境下,logstash 经常会遇到处理多种格式的日志,不同的日志格式,解析方法不同.下面来说说logstash处理多行日志的例子,对MySQL慢查询日志进行分析,这个经常遇到过,网络上疑问也很 ...
- jdbc autoReconnect=true 参数设置导致 slow log 爆表。
1.过程 同事按照文档上配置了下面的jdbc url: jdbc:mysql://ip:port/db?autoReconnect=true&useUnicode=true&chara ...
- mysql slow 分析工具
慢查询有什么用? 它能记录下所有执行超过long_query_time时间的SQL语句,帮你找到执行慢的SQL,方便我们对这些SQL进行优化. 测试用 MySQL 版本. Serv ...
- Mysql slow query log
一.概念部分: 顾名思义,慢查询日志中记录的是执行时间较长的query,也就是我们常说的slow query,通过设--log-slow-queries[=file_name]来打开该功能并设置记录 ...
- mysql之 slow log 慢查询日志
一. 相关参数: • slow_query_log ◦ 是否开启慢查询日志 • slow_query_log_file ◦ 慢查询日志文件名, 在 my.cnf 我们已经定义为slow.log,默认是 ...
- MySQL慢查询日志(SLOW LOG)
慢查询日志可以帮助DBA或开发人员定位可能存在问题的SQL语句,从而进行优化. 如何开启 默认情况下,MySQL是不开启慢查询日志的.可以通过以下命令查看是否开启: mysql> SHOW VA ...
- 解析mysql慢日志
mysql慢日志太多,需要分析下具体有哪些慢日志 mysql可以直接记录所有慢日志,现在的问题是将日志文件sql进行去重 想了老半天该怎样将sql的查询字段去掉进行排序,没有get到重点.后来发现my ...
随机推荐
- EBS查找运行请求时间,参数等
--查找运行请求时间,参数等(可以是某用户的,某个报表) select c.user_name, papf.full_name, b.user_concurrent_program_name, a.r ...
- HDU 5424 Rikka with Graph II
题目大意: 在 N 个点 N 条边组成的图中判断是否存在汉密尔顿路径. 思路:忽略重边与自回路,先判断是否连通,否则输出"NO",DFS搜索是否存在汉密尔顿路径. #include ...
- Shell下通过echo+telnet在远端执行命令
创建脚本cmd.sh,用于输入telnet的用户与密码,以及生成远端需要执行的命令 执行命令 MY_SIGN=/tmp/sign; (sh cmd.sh ) | (telnet localhost ...
- Redis + Jedis + Spring 实例(对象的操作)
目录(?)[+] 不得不说,用哈希操作来存对象,有点自讨苦吃! 不过,既然吃了苦,也做个记录,也许以后API升级后,能好用些呢?! 或许,是我的理解不对,没有真正的理解哈希表. 一.预期 接上 ...
- Android资源--颜色RGB值以及名称及样图
颜 色 RGB值 英文名 中文名 #FFB6C1 LightPink 浅粉红 #FFC0CB Pink 粉红 #DC143C Crimson 深红/猩红 #FFF0F5 L ...
- [core java学习笔记][第四章对象与类]
4.3 用户自定义类 4.3.1 类数组的声明 需要两次new Employee[]=staff=new Employedd[3]; staff[0]=new Employedd(参数列表); sta ...
- C#/.Net Post获取数据流的一种简单写法
最近在弄一些第三方的平台,经常调用第三方的接口实现某些特定的功能 在实现的同时基本上都需要本地的数据经过服务器在Request到第三方的服务器中处理,再返回相应的数据结构体:json/xml 以下是我 ...
- SOLR使用手册之操作collection
一.Collections API 参考:https://cwiki.apache.org/confluence/display/solr/Collections+API 因为API比较多,我就不一 ...
- c3p0连接数据库
<?xml version="1.0" encoding="UTF-8"?> <c3p0-config> <default-con ...
- 触控(Touch)
1 使用触控实现一个简易的画板 1.1 问题 触控(Touch)是一个UITouch类型的对象,当用户触摸了屏幕上的视图时自动被创建,通常使用触控实现绘图.涂鸦.手写等功能.本案例使用触控实现一个简易 ...