Redis-audit工具使用(转)
在我的线上环境中,由于应用上对redis数据没有做冷热处理,所以经常会出现redis内存使用率居高不下的情况,一直以来都想知道都是什么样的数据比较消耗redis内存,就好比写一个sql语句放在数据库中运行,看各表占空间的大小情况然后排序下,这看上去蛮简单的一个功能,貌似在redis上还不容易实现,redis-audit工具基本上可以满足类似的需求。下面是简单的安装和使用介绍!
1:安装ruby
1
2
3
4
5
6
7
8
9
10
|
[root@db1 ~]# wget ftp: //ftp.ruby-lang.org/pub/ruby/1.9/ruby-1.9.2-p0.tar.gz [root@db1 ~]# tar -zxvpf ruby- 1.9 . 2 -p0.tar.gz [root@db1 ~]# cd ruby- 1.9 . 2 -p0 [root@db1 ruby- 1.9 . 2 -p0]# ./configure --prefix=/usr/local/ruby [root@db1 ruby- 1.9 . 2 -p0]# make && make install [root@db1 ruby- 1.9 . 2 -p0]# cd [root@redis2 ~]# grep PATH /root/.bash_profile PATH=$PATH:$HOME/bin:/usr/local/ruby/bin:$PATH export PATH [root@redis2 ~]# source /root/.bash_profile |
2:安装rubygems
1
2
3
4
|
[root@db1 ~]# wget http: //production.cf.rubygems.org/rubygems/rubygems-2.0.7.tgz [root@db1 ~]# tar zxvf rubygems- 2.0 . 7 .tgz [root@db1 ~]# cd rubygems- 2.0 . 7 [root@db1 rubygems- 2.0 . 7 ]# ruby setup.rb |
3:使用gem安装bundler
1
2
3
4
5
6
7
|
[root@db1 rubygems- 2.0 . 7 ]# cd [root@db1 ~]# wget http: //tokyo-m.rubygems.org/gems/bundler-1.3.5.gem [root@db1 ~]# gem install bundler -l Successfully installed bundler- 1.3 . 5 1 gem installed Installing ri documentation for bundler- 1.3 . 5 ... Installing RDoc documentation for bundler- 1.3 . 5 ... |
4:安装git
1
2
3
4
5
6
7
|
[root@db1 ~]# cat /etc/yum.repos.d/git.repo [puias-computational] name=PUIAS Computational baseurl=http: //puias.math.ias.edu/data/puias/computational/5/x86_64/ enabled= 1 gpgcheck= 0 [root@db1 ~]# yum -y install git |
5:使用git迁出redis-audit源代码,查看redis数据情况
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
|
[root@db1 ~]# git clone https: //github.com/snmaynard/redis-audit.git Cloning into redis-audit... remote: Counting objects: 117 , done. remote: Compressing objects: 100 % ( 79 / 79 ), done. remote: Total 117 (delta 39 ), reused 113 (delta 36 ) Receiving objects: 100 % ( 117 / 117 ), 17.63 KiB, done. Resolving deltas: 100 % ( 39 / 39 ), done. [root@db1 ~]# cd redis-audit/ [root@db1 redis-audit]# bundle install Fetching source index from http: //rubygems.org/ Installing redis ( 3.0 . 2 ) Using bundler ( 1.3 . 5 ) Your bundle is complete! Use `bundle show [gemname]` to see where a bundled gem is installed. [root@db1 redis-audit]# bundle exec ruby redis-audit.rb 192.168 . 1.13 65430 0 1000 Auditing 192.168 . 1.13 : 65430 db: 0 sampling 1000 keys Getting a list of all 358 keys... Auditing 358 keys... 35 keys sampled - 10 % complete - 2013 - 08 - 23 14 : 46 : 15 + 0800 70 keys sampled - 20 % complete - 2013 - 08 - 23 14 : 46 : 15 + 0800 105 keys sampled - 29 % complete - 2013 - 08 - 23 14 : 46 : 15 + 0800 140 keys sampled - 39 % complete - 2013 - 08 - 23 14 : 46 : 15 + 0800 175 keys sampled - 49 % complete - 2013 - 08 - 23 14 : 46 : 16 + 0800 210 keys sampled - 59 % complete - 2013 - 08 - 23 14 : 46 : 16 + 0800 245 keys sampled - 68 % complete - 2013 - 08 - 23 14 : 46 : 16 + 0800 280 keys sampled - 78 % complete - 2013 - 08 - 23 14 : 46 : 16 + 0800 315 keys sampled - 88 % complete - 2013 - 08 - 23 14 : 46 : 17 + 0800 350 keys sampled - 98 % complete - 2013 - 08 - 23 14 : 46 : 17 + 0800 DB has 358 keys Sampled 464.34 MB of Redis memory Found 12 key groups ============================================================================== Found 23 keys containing strings, like: ShoppingCart_6d7cfd49f68043669f30133dc5d983a9, ShoppingCart_177600d6b78d46b9990ab5f6dc5711a6, ShoppingCart_a58d6bd82e8b4e7eb55d874c831b66de, ShoppingCart_6405daf3e0b042f580417e3100887871, ShoppingCart_8d6ff3326eaf46bc8b2e24fb9fad6f87, ShoppingCart_0179c7f4f7c84ab5bd387b068dd1632f, ShoppingCart_93637af307fa47038db62e146351f373, ShoppingCart_0c2f7ed9663e432f8d9cdba89a186650, ShoppingCart_c08edc03c3db43c580d66593211da03f, ShoppingCart_76069203a18c4ecba40f713b85ac24d9 These keys use 0.0 % of the total sampled memory ( 4.33 kB) None of these keys expire Average last accessed time: 47 minutes, 40 seconds - (Max: 47 minutes, 40 seconds Min: 47 minutes, 40 seconds) ============================================================================== Found 83 keys containing strings, like: Class:TrainingOnline;UsrId:c99b93261e5642e4995e313174bc1c46;trnId:9f0ee4743e7f40c085247c14eb5eeae9;, Class:TrainingOnline;UsrId:d6a7adaea2ea4b30907de24de0047ea6;trnId:4fb1eedb88b14d45aba927492d1c8713;, Class:TrainingOnline;UsrId:32cdc62b1cdb4307888c6ad2fd53b996;trnId:9f0ee4743e7f40c085247c14eb5eeae9;, Class:TrainingOnline;UsrId:7d4d033f68374ee49f12c60620ffe651;trnId:1b0ae6754ccf4733add782f9a11bd0ef;, Class:TrainingOnline;UsrId:ecfe8652fc9d4177bf782701d764f19d;trnId:26b9d13727694fc69d3fb31a6a8d3e0b;, Class:TrainingOnline;UsrId:7f36ff25369b4e6ba088c235f05b557c;trnId:8b3d8c8c2ab448d585ed7c4909292948;, Class:TrainingOnline;UsrId:9d2e29e4a765495f99f27f8c703f298b;trnId:4fb1eedb88b14d45aba927492d1c8713;, Class:TrainingOnline;UsrId:9b8a5fede6b049a0921ba093ba8009a6;trnId:5a7bcfa6c4c24e42b0e43b5c58f70fc1;, Class:TrainingOnline;UsrId:76069203a18c4ecba40f713b85ac24d9;trnId:cda6b6e1c3fc417bb7e2e27c998a5862;, Class:TrainingOnline;UsrId:785340fe2d1b4136ad6eb2cb4c85d601;trnId:ec44de45aae64487a93da3b522760d4c; These keys use 0.0 % of the total sampled memory ( 7.21 kB) None of these keys expire Average last accessed time: 47 minutes, 40 seconds - (Max: 47 minutes, 40 seconds Min: 47 minutes, 40 seconds) ============================================================================== Found 1 keys containing hashs, like: yd.mvc.Public.SsoModels.SsoTemp These keys use 0.01 % of the total sampled memory ( 28.46 kB) None of these keys expire Average last accessed time: 47 minutes, 40 seconds - (Max: 47 minutes, 40 seconds Min: 47 minutes, 40 seconds) ============================================================================== Found 2 keys containing hashs, like: yd.Model.Public.OnlineCustomer, yd.Model.Public.UserHasAction These keys use 0.02 % of the total sampled memory ( 74.29 kB) None of these keys expire Average last accessed time: 24 minutes, 10 seconds - (Max: 47 minutes, 40 seconds Min: 40 seconds) ============================================================================== Found 1 keys containing hashs, like: yd.Common.Monitoring.MvcRun These keys use 0.13 % of the total sampled memory ( 597.7 kB) None of these keys expire Average last accessed time: 10 seconds - (Max: 10 seconds Min: 10 seconds) ============================================================================== Found 2 keys containing hashs, like: yd.Util.MethodRun, yd.Util.WcfKeep These keys use 0.26 % of the total sampled memory ( 1.21 MB) None of these keys expire Average last accessed time: 15 seconds - (Max: 20 seconds Min: 10 seconds) ============================================================================== Found 13 keys containing hashs, like: yd.Model.Stu.StudyCourseHistory, yd.Model.Sso.Userlink, yd.Model.Sys.GlobalConfig, yd.Model.Sys.ConfigService, yd.Model.Sys.ServiceType, yd.Model.Sso.Domain, yd.Model.Stu.TestTotal, yd.Model.Stu.TestRecord, yd.Model.Stu.StudyNote, yd.Model.Sta.StarStudent These keys use 3.54 % of the total sampled memory ( 16.42 MB) None of these keys expire Average last accessed time: 47 minutes, 40 seconds - (Max: 47 minutes, 40 seconds Min: 47 minutes, 40 seconds) ============================================================================== Found 7 keys containing hashs, like: yd.Model.Wot.WorkStandardConfig, yd.Model.Wot.TeacherAttention, yd.Model.Wot.TrainingWork, yd.Model.Wot.WorkStandard, yd.Model.Wot.WorkStudent, yd.Model.Wot.WorkType, yd.Model.Wot.StudentWork These keys use 4.51 % of the total sampled memory ( 20.92 MB) None of these keys expire Average last accessed time: 47 minutes, 40 seconds - (Max: 47 minutes, 40 seconds Min: 47 minutes, 40 seconds) ============================================================================== Found 19 keys containing hashs, like: yd.Model.Cla.AssessTemplateConfig, yd.Model.Cla.WorkStandard, yd.Model.Cla.NewpaperTemplate, yd.Model.Cla.TeacherWorkDetail, yd.Model.Cla.AssessConfig, yd.Model.Cla.OnlineDiscuss, yd.Model.Cla.StudentAssess, yd.Model.Cla.GrowArchive, yd.Model.Cla.LearningResource, yd.Model.Cla.StudentFileConfig These keys use 11.94 % of the total sampled memory ( 55.43 MB) None of these keys expire Average last accessed time: 47 minutes, 40 seconds - (Max: 47 minutes, 40 seconds Min: 47 minutes, 40 seconds) ============================================================================== Found 28 keys containing hashs, like: yd.Model.Asm.SysinfoConfigType, yd.Model.Asm.User, yd.Model.Ame.CardUseApply, yd.Model.Asm.BranchExpand, yd.Model.Ame.CardOperate, yd.Model.Ame.CardMoney, yd.Model.Ame.CardSellerDetail, yd.Model.Asm.FavoritesType, yd.Model.Ame.Card, yd.Model.Ame.CardSeller These keys use 12.77 % of the total sampled memory ( 59.32 MB) None of these keys expire Average last accessed time: 46 minutes, 5 seconds - (Max: 47 minutes, 40 seconds Min: 3 minutes, 30 seconds) ============================================================================== Found 22 keys containing hashs, like: yd.Model.Tra.InvoicePrintDetail, yd.Model.Tra.TrainingYear, yd.Model.Tra.InvoicePrint, yd.Model.Tra.TrainingConfigType, yd.Model.Tra.StudentStudy, yd.Model.Tra.CourseAndTeacher, yd.Model.Tra.SendProcess, yd.Model.Tra.StudentDredge, yd.Model.Tra.StudentDredgeHistory, yd.Model.Tra.TrainingMenu These keys use 15.74 % of the total sampled memory ( 73.09 MB) None of these keys expire Average last accessed time: 41 minutes, 36 seconds - (Max: 47 minutes, 40 seconds Min: 5 minutes, 10 seconds) ============================================================================== Found 157 keys containing hashs, like: yd.Model.Crm.LibraryType, yd.Model.Wot.StandardConfig, yd.Model.Tra.TrainingTemplate, yd.Model.Ctl.CodingSysinfo, yd.Model.Bbs.UserDynamicReply, yd.Model.Asm.Contact, yd.Model.Buy.OfflineRecord, yd.Model.Cts.TimingTaskLog, yd.Model.Cla.Assess, yd.Model.Sys.ArgeService These keys use 51.09 % of the total sampled memory ( 237.25 MB) None of these keys expire Average last accessed time: 43 minutes, 18 seconds - (Max: 47 minutes, 50 seconds Min: 10 seconds) ============================================================================== Summary ---------------------------------------------------+--------------+-------------------+--------------------------------------------------- Key | Memory Usage | Expiry Proportion | Last Access Time ---------------------------------------------------+--------------+-------------------+--------------------------------------------------- yd.Model.Crm.LibraryType | 51.09 % | 0.0 % | 10 seconds yd.Model.Tra.InvoicePrintDetail | 15.74 % | 0.0 % | 5 minutes, 10 seconds yd.Model.Asm.SysinfoConfigType | 12.77 % | 0.0 % | 3 minutes, 30 seconds yd.Model.Cla.AssessTemplateConfig | 11.94 % | 0.0 % | 47 minutes, 40 seconds yd.Model.Wot.WorkStandardConfig | 4.51 % | 0.0 % | 47 minutes, 40 seconds yd.Model.Stu.StudyCourseHistory | 3.54 % | 0.0 % | 47 minutes, 40 seconds yd.Util.MethodRun | 0.26 % | 0.0 % | 10 seconds yd.Common.Monitoring.MvcRun | 0.13 % | 0.0 % | 10 seconds yd.Model.Public.OnlineCustomer | 0.02 % | 0.0 % | 40 seconds yd.mvc.Public.SsoModels.SsoTemp | 0.01 % | 0.0 % | 47 minutes, 40 seconds Class:TrainingOnline;UsrId:c99b93261e5642e4995e313 | 0.0 % | 0.0 % | 47 minutes, 40 seconds ShoppingCart_6d7cfd49f68043669f30133dc5d983a9 | 0.0 % | 0.0 % | 47 minutes, 40 seconds ---------------------------------------------------+--------------+-------------------+--------------------------------------------------- |
从实际使用的情况上看,当要分析采样的数据较多时,会出现timeout报错信息,目前尚不清楚如何处理!
Redis-audit工具使用(转)的更多相关文章
- redis 可视化工具
Redis Desktop Manager 下载 phpRedisAdmin 是一个用php管理redis的工具 下载
- Java 使用Redis缓存工具的图文详细方法
开始在 Java 中使用 Redis 前, 我们需要确保已经安装了 redis 服务及 Java redis 驱动,且你的机器上能正常使用 Java. (1)Java的安装配置可以参考我们的 Java ...
- Redis可视化工具Redis Desktop Manager使用
Redis可视化工具,RedisDesktopManager 没错,它开源的,托管在github上:https://github.com/uglide/RedisDesktopManager 还不错, ...
- Redis可视化工具 Redis Desktop Manager
1.前言 从接触Redis也有两年,平时就使用它来做缓存层,它给我的印象就是很强大,内置的数据结构很齐全,加上Redis5.0的到来,新增了很多特色功能.而Redis5.0最大的新特性就是多出了一个数 ...
- Redis 可视化工具:Web Redis Manager
以前用的:RedisDesktopManager (0.9.3以后需要订阅) https://github.com/uglide/RedisDesktopManager/releases 现在需要订阅 ...
- linux audit工具
一个不错的博客,可以吸收营养,等读完后再决定写什么? https://www.cnblogs.com/bldly1989/p/7204358.html changelog -------------- ...
- 跨平台Redis可视化工具Web Redis Manager
一.简介 最近因为工作需要,使用了一些单机版Redis的界面化管理工具,使用过程中那惨痛的体验真的只有用过的人才能体会:为此本人和小伙伴准备动手一个Redis可视化工具,但是因为小伙伴最近工作比较忙, ...
- spring boot 结合Redis 实现工具类
自己整理了 spring boot 结合 Redis 的工具类引入依赖 <dependency> <groupId>org.springframework.boot</g ...
- 自定义redis序列化工具
redis一个优点就是可以将数据写入到磁盘中. 我们知道写入磁盘的数据实际上都是以字节(0101这样的二进制数据)的形式写入的. 这意味着如果我们要将一个对象写入磁盘,就必须将这个对象序列化. jav ...
- 可视化的Redis数据库管理工具redis-desktop-manager的初步使用(图文详解)
不多说,直接上干货! 无论是Linux 还是 Windows里安装Redis, Windows里如何正确安装Redis以服务运行(博主推荐)(图文详解) Windows下如何正确下载并安装可视化的Re ...
随机推荐
- 收集SpringBoot的一些学习资料
1:wuyouzhuguli的博客 (24篇) https://github.com/wuyouzhuguli/Spring-Boot-Demos 2:方志鹏的博客 (27篇) https://b ...
- 通俗易懂之Tensorflow summary类 & 初识tensorboard
前面学习的cifar10项目虽小,但却五脏俱全.全面理解该项目非常有利于进一步的学习和提高,也是走向更大型项目的必由之路.因此,summary依然要从cifar10项目说起,通俗易懂的理解并运用sum ...
- Oracle 基本操作符
1.一般操作符 (1)!= 不等于 select empno,ename,job from scott.emp where job!='manager' (2)^= 不等于 select empno, ...
- contos 7创建阿里云镜像源
今天在ESC上安装mariaDB,发现centOS 7默认的yum源上的mariaDB版本过低,然后又镜像到网易上,发现网易源上没有mariaDB,几经折腾才发现阿里镜像上mariaDB版本较新.更改 ...
- APP的CPU,内存,耗电,流量测试工具
APP的CPU,内存,耗电,流量测试工具下载地址,后续文章会介绍如何使用Emmagee.itest.gt APP应用的CPU,内存,耗电,流量调查 可和同类产品比较,使用GT等工具:CPU靠syste ...
- 009_【OS X和iOS系统学习笔记】 OS X架构
1.OS X是整个操作系统的集体名称,而Darwin是其中的一个组件. 2.Darwin是操作系统的类UNIX核心,本身由内核.XNU和运行时组成. 3.uname指令:可以得到有关架构的详细信息以及 ...
- 如何将同一个APP中的不同activity在Recent(最近任务)中显示?
需求描述 在应用Application1中存在A.B两个activity,当在应用启动了A.B activity,点击Recent键,如何让A.B两个activity都显示在Recent界面(最近任务 ...
- java Comparator和Comparable(比较器)
Comparable: 一个类实现了Camparable接口则表明这个类的对象之间是可以相互比较的,这个类对象组成的集合就可以直接使用sort方法排序,sort方法调用compareTo()方法里定义 ...
- MySQL Replication Report
很多人都会MySQL主从框架的搭建,但很多人没有真正理解同步基本用途.同步的基本原理,还有当Master和Slave同步断开后的处理以及导致Master和slave不同步的原因等等,当你对这些都了如指 ...
- java基础学习总结——GUI编程(二)
一.事件监听