在我的线上环境中，由于应用上对redis数据没有做冷热处理，所以经常会出现redis内存使用率居高不下的情况，一直以来都想知道都是什么样的数据比较消耗redis内存，就好比写一个sql语句放在数据库中运行，看各表占空间的大小情况然后排序下，这看上去蛮简单的一个功能，貌似在redis上还不容易实现，redis-audit工具基本上可以满足类似的需求。下面是简单的安装和使用介绍！

1:安装ruby

1
2
3
4
5
6
7
8
9
10
[root@db1 ~]# wget ftp://ftp.ruby-lang.org/pub/ruby/1.9/ruby-1.9.2-p0.tar.gz
[root@db1 ~]# tar -zxvpf ruby-1.9.2-p0.tar.gz
[root@db1 ~]# cd ruby-1.9.2-p0
[root@db1 ruby-1.9.2-p0]# ./configure  --prefix=/usr/local/ruby
[root@db1 ruby-1.9.2-p0]# make && make install
[root@db1 ruby-1.9.2-p0]# cd
[root@redis2 ~]# grep PATH /root/.bash_profile
PATH=$PATH:$HOME/bin:/usr/local/ruby/bin:$PATH
export PATH
[root@redis2 ~]# source /root/.bash_profile

2:安装rubygems

1
2
3
4
[root@db1 ~]# wget http://production.cf.rubygems.org/rubygems/rubygems-2.0.7.tgz
[root@db1 ~]# tar zxvf rubygems-2.0.7.tgz
[root@db1 ~]# cd rubygems-2.0.7
[root@db1 rubygems-2.0.7]# ruby setup.rb

3:使用gem安装bundler

1
2
3
4
5
6
7
[root@db1 rubygems-2.0.7]# cd
[root@db1 ~]#  wget http://tokyo-m.rubygems.org/gems/bundler-1.3.5.gem
[root@db1 ~]# gem install bundler -l
Successfully installed bundler-1.3.5
1 gem installed
Installing ri documentation for bundler-1.3.5...
Installing RDoc documentation for bundler-1.3.5...

4:安装git

1
2
3
4
5
6
7
[root@db1 ~]# cat /etc/yum.repos.d/git.repo
[puias-computational]
name=PUIAS Computational
baseurl=http://puias.math.ias.edu/data/puias/computational/5/x86_64/
enabled=1
gpgcheck=0
[root@db1 ~]# yum -y install git

5:使用git迁出redis-audit源代码，查看redis数据情况

1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
[root@db1 ~]#  git clone https://github.com/snmaynard/redis-audit.git
Cloning into redis-audit...
remote: Counting objects: 117, done.
remote: Compressing objects: 100% (79/79), done.
remote: Total 117 (delta 39), reused 113 (delta 36)
Receiving objects: 100% (117/117), 17.63 KiB, done.
Resolving deltas: 100% (39/39), done.
[root@db1 ~]# cd redis-audit/
[root@db1 redis-audit]# bundle install
Fetching source index from http://rubygems.org/
Installing redis (3.0.2)
Using bundler (1.3.5)
Your bundle is complete!
Use `bundle show [gemname]` to see where a bundled gem is installed.
[root@db1 redis-audit]# bundle exec ruby redis-audit.rb 192.168.1.13 65430 0 1000
Auditing 192.168.1.13:65430 db:0 sampling 1000 keys
Getting a list of all 358 keys...
Auditing 358 keys...
35 keys sampled - 10% complete - 2013-08-23 14:46:15 +0800
70 keys sampled - 20% complete - 2013-08-23 14:46:15 +0800
105 keys sampled - 29% complete - 2013-08-23 14:46:15 +0800
140 keys sampled - 39% complete - 2013-08-23 14:46:15 +0800
175 keys sampled - 49% complete - 2013-08-23 14:46:16 +0800
210 keys sampled - 59% complete - 2013-08-23 14:46:16 +0800
245 keys sampled - 68% complete - 2013-08-23 14:46:16 +0800
280 keys sampled - 78% complete - 2013-08-23 14:46:16 +0800
315 keys sampled - 88% complete - 2013-08-23 14:46:17 +0800
350 keys sampled - 98% complete - 2013-08-23 14:46:17 +0800
DB has 358 keys
Sampled 464.34 MB of Redis memory
Found 12 key groups
==============================================================================
Found 23 keys containing strings, like:
ShoppingCart_6d7cfd49f68043669f30133dc5d983a9, ShoppingCart_177600d6b78d46b9990ab5f6dc5711a6, ShoppingCart_a58d6bd82e8b4e7eb55d874c831b66de,
ShoppingCart_6405daf3e0b042f580417e3100887871, ShoppingCart_8d6ff3326eaf46bc8b2e24fb9fad6f87, ShoppingCart_0179c7f4f7c84ab5bd387b068dd1632f,
ShoppingCart_93637af307fa47038db62e146351f373, ShoppingCart_0c2f7ed9663e432f8d9cdba89a186650, ShoppingCart_c08edc03c3db43c580d66593211da03f,
ShoppingCart_76069203a18c4ecba40f713b85ac24d9
These keys use 0.0% of the total sampled memory (4.33 kB)
None of these keys expire
Average last accessed time: 47 minutes, 40 seconds - (Max: 47 minutes, 40 seconds Min:47 minutes, 40 seconds)
==============================================================================
Found 83 keys containing strings, like:
Class:TrainingOnline;UsrId:c99b93261e5642e4995e313174bc1c46;trnId:9f0ee4743e7f40c085247c14eb5eeae9;,
Class:TrainingOnline;UsrId:d6a7adaea2ea4b30907de24de0047ea6;trnId:4fb1eedb88b14d45aba927492d1c8713;,
Class:TrainingOnline;UsrId:32cdc62b1cdb4307888c6ad2fd53b996;trnId:9f0ee4743e7f40c085247c14eb5eeae9;,
Class:TrainingOnline;UsrId:7d4d033f68374ee49f12c60620ffe651;trnId:1b0ae6754ccf4733add782f9a11bd0ef;,
Class:TrainingOnline;UsrId:ecfe8652fc9d4177bf782701d764f19d;trnId:26b9d13727694fc69d3fb31a6a8d3e0b;,
Class:TrainingOnline;UsrId:7f36ff25369b4e6ba088c235f05b557c;trnId:8b3d8c8c2ab448d585ed7c4909292948;,
Class:TrainingOnline;UsrId:9d2e29e4a765495f99f27f8c703f298b;trnId:4fb1eedb88b14d45aba927492d1c8713;,
Class:TrainingOnline;UsrId:9b8a5fede6b049a0921ba093ba8009a6;trnId:5a7bcfa6c4c24e42b0e43b5c58f70fc1;,
Class:TrainingOnline;UsrId:76069203a18c4ecba40f713b85ac24d9;trnId:cda6b6e1c3fc417bb7e2e27c998a5862;,
Class:TrainingOnline;UsrId:785340fe2d1b4136ad6eb2cb4c85d601;trnId:ec44de45aae64487a93da3b522760d4c;
These keys use 0.0% of the total sampled memory (7.21 kB)
None of these keys expire
Average last accessed time: 47 minutes, 40 seconds - (Max: 47 minutes, 40 seconds Min:47 minutes, 40 seconds)
==============================================================================
Found 1 keys containing hashs, like:
yd.mvc.Public.SsoModels.SsoTemp
These keys use 0.01% of the total sampled memory (28.46 kB)
None of these keys expire
Average last accessed time: 47 minutes, 40 seconds - (Max: 47 minutes, 40 seconds Min:47 minutes, 40 seconds)
==============================================================================
Found 2 keys containing hashs, like:
yd.Model.Public.OnlineCustomer, yd.Model.Public.UserHasAction
These keys use 0.02% of the total sampled memory (74.29 kB)
None of these keys expire
Average last accessed time: 24 minutes, 10 seconds - (Max: 47 minutes, 40 seconds Min:40 seconds)
==============================================================================
Found 1 keys containing hashs, like:
yd.Common.Monitoring.MvcRun
These keys use 0.13% of the total sampled memory (597.7 kB)
None of these keys expire
Average last accessed time: 10 seconds - (Max: 10 seconds Min:10 seconds)
==============================================================================
Found 2 keys containing hashs, like:
yd.Util.MethodRun, yd.Util.WcfKeep
These keys use 0.26% of the total sampled memory (1.21 MB)
None of these keys expire
Average last accessed time: 15 seconds - (Max: 20 seconds Min:10 seconds)
==============================================================================
Found 13 keys containing hashs, like:
yd.Model.Stu.StudyCourseHistory, yd.Model.Sso.Userlink, yd.Model.Sys.GlobalConfig, yd.Model.Sys.ConfigService, yd.Model.Sys.ServiceType, yd.Model.Sso.Domain,
yd.Model.Stu.TestTotal, yd.Model.Stu.TestRecord, yd.Model.Stu.StudyNote, yd.Model.Sta.StarStudent
These keys use 3.54% of the total sampled memory (16.42 MB)
None of these keys expire
Average last accessed time: 47 minutes, 40 seconds - (Max: 47 minutes, 40 seconds Min:47 minutes, 40 seconds)
==============================================================================
Found 7 keys containing hashs, like:
yd.Model.Wot.WorkStandardConfig, yd.Model.Wot.TeacherAttention, yd.Model.Wot.TrainingWork, yd.Model.Wot.WorkStandard, yd.Model.Wot.WorkStudent,
yd.Model.Wot.WorkType, yd.Model.Wot.StudentWork
These keys use 4.51% of the total sampled memory (20.92 MB)
None of these keys expire
Average last accessed time: 47 minutes, 40 seconds - (Max: 47 minutes, 40 seconds Min:47 minutes, 40 seconds)
==============================================================================
Found 19 keys containing hashs, like:
yd.Model.Cla.AssessTemplateConfig, yd.Model.Cla.WorkStandard, yd.Model.Cla.NewpaperTemplate, yd.Model.Cla.TeacherWorkDetail, yd.Model.Cla.AssessConfig,
yd.Model.Cla.OnlineDiscuss, yd.Model.Cla.StudentAssess, yd.Model.Cla.GrowArchive, yd.Model.Cla.LearningResource, yd.Model.Cla.StudentFileConfig
These keys use 11.94% of the total sampled memory (55.43 MB)
None of these keys expire
Average last accessed time: 47 minutes, 40 seconds - (Max: 47 minutes, 40 seconds Min:47 minutes, 40 seconds)
==============================================================================
Found 28 keys containing hashs, like:
yd.Model.Asm.SysinfoConfigType, yd.Model.Asm.User, yd.Model.Ame.CardUseApply, yd.Model.Asm.BranchExpand, yd.Model.Ame.CardOperate, yd.Model.Ame.CardMoney,
yd.Model.Ame.CardSellerDetail, yd.Model.Asm.FavoritesType, yd.Model.Ame.Card, yd.Model.Ame.CardSeller
These keys use 12.77% of the total sampled memory (59.32 MB)
None of these keys expire
Average last accessed time: 46 minutes, 5 seconds - (Max: 47 minutes, 40 seconds Min:3 minutes, 30 seconds)
==============================================================================
Found 22 keys containing hashs, like:
yd.Model.Tra.InvoicePrintDetail, yd.Model.Tra.TrainingYear, yd.Model.Tra.InvoicePrint, yd.Model.Tra.TrainingConfigType, yd.Model.Tra.StudentStudy,
yd.Model.Tra.CourseAndTeacher, yd.Model.Tra.SendProcess, yd.Model.Tra.StudentDredge, yd.Model.Tra.StudentDredgeHistory, yd.Model.Tra.TrainingMenu
These keys use 15.74% of the total sampled memory (73.09 MB)
None of these keys expire
Average last accessed time: 41 minutes, 36 seconds - (Max: 47 minutes, 40 seconds Min:5 minutes, 10 seconds)
==============================================================================
Found 157 keys containing hashs, like:
yd.Model.Crm.LibraryType, yd.Model.Wot.StandardConfig, yd.Model.Tra.TrainingTemplate, yd.Model.Ctl.CodingSysinfo, yd.Model.Bbs.UserDynamicReply,
yd.Model.Asm.Contact, yd.Model.Buy.OfflineRecord, yd.Model.Cts.TimingTaskLog, yd.Model.Cla.Assess, yd.Model.Sys.ArgeService
These keys use 51.09% of the total sampled memory (237.25 MB)
None of these keys expire
Average last accessed time: 43 minutes, 18 seconds - (Max: 47 minutes, 50 seconds Min:10 seconds)
==============================================================================
Summary
---------------------------------------------------+--------------+-------------------+---------------------------------------------------
Key                                                | Memory Usage | Expiry Proportion | Last Access Time                              
---------------------------------------------------+--------------+-------------------+---------------------------------------------------
yd.Model.Crm.LibraryType                           | 51.09%       | 0.0%              | 10 seconds                                    
yd.Model.Tra.InvoicePrintDetail                    | 15.74%       | 0.0%              | 5 minutes, 10 seconds                         
yd.Model.Asm.SysinfoConfigType                     | 12.77%       | 0.0%              | 3 minutes, 30 seconds                         
yd.Model.Cla.AssessTemplateConfig                  | 11.94%       | 0.0%              | 47 minutes, 40 seconds                        
yd.Model.Wot.WorkStandardConfig                    | 4.51%        | 0.0%              | 47 minutes, 40 seconds                        
yd.Model.Stu.StudyCourseHistory                    | 3.54%        | 0.0%              | 47 minutes, 40 seconds                        
yd.Util.MethodRun                                  | 0.26%        | 0.0%              | 10 seconds                                    
yd.Common.Monitoring.MvcRun                        | 0.13%        | 0.0%              | 10 seconds                                    
yd.Model.Public.OnlineCustomer                     | 0.02%        | 0.0%              | 40 seconds                                    
yd.mvc.Public.SsoModels.SsoTemp                    | 0.01%        | 0.0%              | 47 minutes, 40 seconds                        
Class:TrainingOnline;UsrId:c99b93261e5642e4995e313 | 0.0%         | 0.0%              | 47 minutes, 40 seconds                        
ShoppingCart_6d7cfd49f68043669f30133dc5d983a9      | 0.0%         | 0.0%              | 47 minutes, 40 seconds                        
---------------------------------------------------+--------------+-------------------+---------------------------------------------------

从实际使用的情况上看，当要分析采样的数据较多时，会出现timeout报错信息，目前尚不清楚如何处理！

Redis-audit工具使用(转)的更多相关文章

  1. redis 可视化工具

    Redis Desktop Manager 下载 phpRedisAdmin 是一个用php管理redis的工具 下载

  2. Java 使用Redis缓存工具的图文详细方法

    开始在 Java 中使用 Redis 前, 我们需要确保已经安装了 redis 服务及 Java redis 驱动,且你的机器上能正常使用 Java. (1)Java的安装配置可以参考我们的 Java ...

  3. Redis可视化工具Redis Desktop Manager使用

    Redis可视化工具,RedisDesktopManager 没错,它开源的,托管在github上:https://github.com/uglide/RedisDesktopManager 还不错, ...

  4. Redis可视化工具 Redis Desktop Manager

    1.前言 从接触Redis也有两年,平时就使用它来做缓存层,它给我的印象就是很强大,内置的数据结构很齐全,加上Redis5.0的到来,新增了很多特色功能.而Redis5.0最大的新特性就是多出了一个数 ...

  5. Redis 可视化工具：Web Redis Manager

    以前用的:RedisDesktopManager (0.9.3以后需要订阅) https://github.com/uglide/RedisDesktopManager/releases 现在需要订阅 ...

  6. linux audit工具

    一个不错的博客,可以吸收营养,等读完后再决定写什么? https://www.cnblogs.com/bldly1989/p/7204358.html changelog -------------- ...

  7. 跨平台Redis可视化工具Web Redis Manager

    一.简介 最近因为工作需要,使用了一些单机版Redis的界面化管理工具,使用过程中那惨痛的体验真的只有用过的人才能体会:为此本人和小伙伴准备动手一个Redis可视化工具,但是因为小伙伴最近工作比较忙, ...

  8. spring boot 结合Redis 实现工具类

    自己整理了 spring boot 结合 Redis 的工具类引入依赖 <dependency> <groupId>org.springframework.boot</g ...

  9. 自定义redis序列化工具

    redis一个优点就是可以将数据写入到磁盘中. 我们知道写入磁盘的数据实际上都是以字节(0101这样的二进制数据)的形式写入的. 这意味着如果我们要将一个对象写入磁盘,就必须将这个对象序列化. jav ...

  10. 可视化的Redis数据库管理工具redis-desktop-manager的初步使用（图文详解）

    不多说,直接上干货! 无论是Linux 还是 Windows里安装Redis, Windows里如何正确安装Redis以服务运行(博主推荐)(图文详解) Windows下如何正确下载并安装可视化的Re ...

随机推荐

  1. 分布式文件系统 之 数据块（Block）

    众所周知,HDFS中以数据块(block)为单位进行存储管理.本文简单介绍一下HDFS中数据块(block)的概念,以及众多分布式存储系统(不止是HDFS)使用block作为存储管理基本单位的意义. ...

  2. Oracle PLSql配置

    1.安装Oracle客户端或者服务端 2.配置环境变量 <1>.一般如果安装了Oracle客户端或者服务端的话,在环境变种的Path中有Oracle的安装路径(计算机-属性-高级系统设置- ...

  3. c# 获取百度最后的url

    using System;using System.Collections.Generic;using System.Linq;using System.Net.Http;using System.T ...

  4. Coursera台大机器学习技法课程笔记11-Gradient Boosted Decision Tree

    将Adaboost和decision tree相结合,需要注意的地主是,训练时adaboost需要改变资料的权重,如何将有权重的资 料和decision tree相结合呢?方法很类似于前面讲过的bag ...

  5. SpringMVC高级参数绑定（数组和List）

    本节内容: 参数绑定之数组 将表单的数据绑定到List 复制下上篇博客中的工程,作为今天开发的工程. 一.参数绑定之数组 1. 需求 在商品列表页面选中多个商品,然后删除. 2. 需求分析 功能要求商 ...

  6. HTML布局思路

    1.DIV+CSS布局 (1)按照由上到下,由里到外的方式 (2)样式由CSS去改变 代码: <style type="text/css"> * { margin:0p ...

  7. 网站目录下多出的 core 文件

    1.core 文件简介 在一个程序崩溃时,一般会在指定目录下生成一个core文件.core文件仅仅是一个内存映象(同时加上调试信息),主要是用来调试的.也就是说这种文件是程序意外中断时候生成的 deb ...

  8. 使用GIT管理UE4代码

    在OSCHINA的GIT上创建远程项目 cd existing_git_repo git init git add Onepass/ Source/ notes.txt git commit -m & ...

  9. 【LOJ】#2268. 「SDOI2017」苹果树

    题解 显然权值都是正的,我们最深的那个点一定延伸到了某个叶子 我们抛去这条链之外再选K个点即可 如果直接对一棵树选K个点,满足这样的依赖关系,可以通过一个后序遍历的顺序做出来 转移方法是 \(dp[i ...

  10. 远程执行shell

    目前我的需求是在我的hadoop集群搭建起来前,能定时做一下简易指标的监控,目前我的方案就是在我的server机上,定时执行远程脚本出指标数据,然后通过python脚本发送邮件. 远程执行脚本如下: ...