dmesg命令应用
昨晚上线服务的时候，看log偶然发现服务在启动半小时左右就会被supervise重新拉起，也没有core。通过重新启动的服务发现内存飙涨，且持续增加，怀疑是内存打满，进程被kill了。
其实怀疑是正确的，如何验证呢？其实通过dmesg就可以分分钟验证。
详细信息如下：
[ 0.000000] Out of memory: Kill process 8668 (dsnav) score 947 or sacrifice child
[ 0.000000] Killed process 8668, UID 501, (dsnav) total-vm:127974752kB, anon-rss:124608960kB, file-rss:8kB
[ 0.000000] argus-agent invoked oom-killer: gfp_mask=0x201da, order=0, oom_adj=0, oom_score_adj=0
[ 0.000000] argus-agent cpuset=/ mems_allowed=0
[ 0.000000] Pid: 6385, comm: argus-agent Tainted: G --------------- H 2.6.32_431-3 #2
[ 0.000000] Call Trace:
[ 0.000000] [<ffffffff810c8bc1>] ? cpuset_print_task_mems_allowed+0x91/0xb0
[ 0.000000] [<ffffffff8111a210>] ? dump_header+0x90/0x1b0
[ 0.000000] [<ffffffff8111a652>] ? oom_kill_process+0x82/0x2a0
[ 0.000000] [<ffffffff8111aaa0>] ? select_bad_process.clone.1+0xe0/0x120
[ 0.000000] [<ffffffff8111ac76>] ? out_of_memory+0xe6/0x210
[ 0.000000] [<ffffffff81126c01>] ? __alloc_pages_nodemask+0x8e1/0x900
[ 0.000000] [<ffffffff81119082>] ? filemap_fault+0x1b2/0x520
[ 0.000000] [<ffffffff81140364>] ? __do_fault+0x54/0x530
[ 0.000000] [<ffffffff81140937>] ? handle_pte_fault+0xf7/0xa40
[ 0.000000] [<ffffffff8150e5f0>] ? thread_return+0x4e/0x77e
[ 0.000000] [<ffffffff81099342>] ? enqueue_hrtimer+0x82/0xd0
[ 0.000000] [<ffffffff81099701>] ? lock_hrtimer_base+0x31/0x60
[ 0.000000] [<ffffffff8109a27f>] ? hrtimer_try_to_cancel+0x3f/0xd0
[ 0.000000] [<ffffffff81510dd6>] ? rwsem_down_read_failed+0x26/0x30
[ 0.000000] [<ffffffff811414aa>] ? handle_mm_fault+0x22a/0x300
[ 0.000000] [<ffffffff810466f8>] ? __do_page_fault+0x138/0x480
[ 0.000000] [<ffffffff811bd906>] ? ep_poll+0x306/0x330
[ 0.000000] [<ffffffff810603a0>] ? default_wake_function+0x0/0x20
[ 0.000000] [<ffffffff8151410e>] ? do_page_fault+0x3e/0xa0
[ 0.000000] [<ffffffff815114d5>] ? page_fault+0x25/0x30
[ 0.000000] Mem-Info:
[ 0.000000] DMA per-cpu:
[ 0.000000] CPU 0: hi: 0, btch: 1 usd: 0
[ 0.000000] CPU 1: hi: 0, btch: 1 usd: 0
[ 0.000000] CPU 2: hi: 0, btch: 1 usd: 0
[ 0.000000] CPU 3: hi: 0, btch: 1 usd: 0
[ 0.000000] CPU 4: hi: 0, btch: 1 usd: 0
[ 0.000000] CPU 5: hi: 0, btch: 1 usd: 0
[ 0.000000] CPU 6: hi: 0, btch: 1 usd: 0
[ 0.000000] CPU 7: hi: 0, btch: 1 usd: 0
[ 0.000000] CPU 8: hi: 0, btch: 1 usd: 0
[ 0.000000] CPU 9: hi: 0, btch: 1 usd: 0
[ 0.000000] CPU 10: hi: 0, btch: 1 usd: 0
[ 0.000000] CPU 11: hi: 0, btch: 1 usd: 0
[ 0.000000] CPU 12: hi: 0, btch: 1 usd: 0
[ 0.000000] CPU 13: hi: 0, btch: 1 usd: 0
[ 0.000000] CPU 14: hi: 0, btch: 1 usd: 0
[ 0.000000] CPU 15: hi: 0, btch: 1 usd: 0
[ 0.000000] CPU 16: hi: 0, btch: 1 usd: 0
[ 0.000000] CPU 17: hi: 0, btch: 1 usd: 0
[ 0.000000] CPU 18: hi: 0, btch: 1 usd: 0
[ 0.000000] CPU 19: hi: 0, btch: 1 usd: 0
[ 0.000000] CPU 20: hi: 0, btch: 1 usd: 0
[ 0.000000] CPU 21: hi: 0, btch: 1 usd: 0
[ 0.000000] CPU 22: hi: 0, btch: 1 usd: 0
[ 0.000000] CPU 23: hi: 0, btch: 1 usd: 0
[ 0.000000] CPU 24: hi: 0, btch: 1 usd: 0
[ 0.000000] CPU 25: hi: 0, btch: 1 usd: 0
[ 0.000000] CPU 26: hi: 0, btch: 1 usd: 0
[ 0.000000] CPU 27: hi: 0, btch: 1 usd: 0
[ 0.000000] CPU 28: hi: 0, btch: 1 usd: 0
[ 0.000000] CPU 29: hi: 0, btch: 1 usd: 0
[ 0.000000] CPU 30: hi: 0, btch: 1 usd: 0
[ 0.000000] CPU 31: hi: 0, btch: 1 usd: 0
[ 0.000000] DMA32 per-cpu:
[ 0.000000] CPU 0: hi: 186, btch: 31 usd: 0
[ 0.000000] CPU 1: hi: 186, btch: 31 usd: 0
[ 0.000000] CPU 2: hi: 186, btch: 31 usd: 0
[ 0.000000] CPU 3: hi: 186, btch: 31 usd: 0
[ 0.000000] CPU 4: hi: 186, btch: 31 usd: 0
[ 0.000000] CPU 5: hi: 186, btch: 31 usd: 0
[ 0.000000] CPU 6: hi: 186, btch: 31 usd: 0
[ 0.000000] CPU 7: hi: 186, btch: 31 usd: 0
[ 0.000000] CPU 8: hi: 186, btch: 31 usd: 0
[ 0.000000] CPU 9: hi: 186, btch: 31 usd: 0
[ 0.000000] CPU 10: hi: 186, btch: 31 usd: 0
[ 0.000000] CPU 11: hi: 186, btch: 31 usd: 0
[ 0.000000] CPU 12: hi: 186, btch: 31 usd: 0
[ 0.000000] CPU 13: hi: 186, btch: 31 usd: 0
[ 0.000000] CPU 14: hi: 186, btch: 31 usd: 0
[ 0.000000] CPU 15: hi: 186, btch: 31 usd: 0
[ 0.000000] CPU 16: hi: 186, btch: 31 usd: 0
[ 0.000000] CPU 17: hi: 186, btch: 31 usd: 0
[ 0.000000] CPU 18: hi: 186, btch: 31 usd: 0
[ 0.000000] CPU 19: hi: 186, btch: 31 usd: 0
[ 0.000000] CPU 20: hi: 186, btch: 31 usd: 0
[ 0.000000] CPU 21: hi: 186, btch: 31 usd: 0
[ 0.000000] CPU 22: hi: 186, btch: 31 usd: 0
[ 0.000000] CPU 23: hi: 186, btch: 31 usd: 0
[ 0.000000] CPU 24: hi: 186, btch: 31 usd: 0
[ 0.000000] CPU 25: hi: 186, btch: 31 usd: 0
[ 0.000000] CPU 26: hi: 186, btch: 31 usd: 0
[ 0.000000] CPU 27: hi: 186, btch: 31 usd: 0
[ 0.000000] CPU 28: hi: 186, btch: 31 usd: 0
[ 0.000000] CPU 29: hi: 186, btch: 31 usd: 0
[ 0.000000] CPU 30: hi: 186, btch: 31 usd: 0
[ 0.000000] CPU 31: hi: 186, btch: 31 usd: 0
[ 0.000000] Normal per-cpu:
[ 0.000000] CPU 0: hi: 186, btch: 31 usd: 0
[ 0.000000] CPU 1: hi: 186, btch: 31 usd: 0
[ 0.000000] CPU 2: hi: 186, btch: 31 usd: 0
[ 0.000000] CPU 3: hi: 186, btch: 31 usd: 0
[ 0.000000] CPU 4: hi: 186, btch: 31 usd: 0
[ 0.000000] CPU 5: hi: 186, btch: 31 usd: 0
[ 0.000000] CPU 6: hi: 186, btch: 31 usd: 0
[ 0.000000] CPU 7: hi: 186, btch: 31 usd: 16
[ 0.000000] CPU 8: hi: 186, btch: 31 usd: 1
[ 0.000000] CPU 9: hi: 186, btch: 31 usd: 0
[ 0.000000] CPU 10: hi: 186, btch: 31 usd: 0
[ 0.000000] CPU 11: hi: 186, btch: 31 usd: 0
[ 0.000000] CPU 12: hi: 186, btch: 31 usd: 0
[ 0.000000] CPU 13: hi: 186, btch: 31 usd: 0
[ 0.000000] CPU 14: hi: 186, btch: 31 usd: 20
[ 0.000000] CPU 15: hi: 186, btch: 31 usd: 0
[ 0.000000] CPU 16: hi: 186, btch: 31 usd: 0
[ 0.000000] CPU 17: hi: 186, btch: 31 usd: 16
[ 0.000000] CPU 18: hi: 186, btch: 31 usd: 1
[ 0.000000] CPU 19: hi: 186, btch: 31 usd: 1
[ 0.000000] CPU 20: hi: 186, btch: 31 usd: 0
[ 0.000000] CPU 21: hi: 186, btch: 31 usd: 0
[ 0.000000] CPU 22: hi: 186, btch: 31 usd: 15
[ 0.000000] CPU 23: hi: 186, btch: 31 usd: 0
[ 0.000000] CPU 24: hi: 186, btch: 31 usd: 0
[ 0.000000] CPU 25: hi: 186, btch: 31 usd: 0
[ 0.000000] CPU 26: hi: 186, btch: 31 usd: 0
[ 0.000000] CPU 27: hi: 186, btch: 31 usd: 0
[ 0.000000] CPU 28: hi: 186, btch: 31 usd: 1
[ 0.000000] CPU 29: hi: 186, btch: 31 usd: 0
[ 0.000000] CPU 30: hi: 186, btch: 31 usd: 0
[ 0.000000] CPU 31: hi: 186, btch: 31 usd: 0
[ 0.000000] active_anon:32558911 inactive_anon:44 isolated_anon:0
[ 0.000000] active_file:168 inactive_file:0 isolated_file:0
[ 0.000000] unevictable:0 dirty:37 writeback:0 unstable:0
[ 0.000000] free:131744 slab_reclaimable:7708 slab_unreclaimable:17716
[ 0.000000] mapped:249 shmem:48 pagetables:67098 bounce:0
[ 0.000000] DMA free:15888kB min:4kB low:4kB high:4kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:15260kB mlocked:0kB dirty:0kB writeback:0kB mapped:0kB shmem:0kB slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:0kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? yes
[ 0.000000] lowmem_reserve[]: 0 1856 129116 129116
[ 0.000000] DMA32 free:444884kB min:968kB low:1208kB high:1452kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:1900568kB mlocked:0kB dirty:0kB writeback:0kB mapped:0kB shmem:0kB slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:0kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? yes
[ 0.000000] lowmem_reserve[]: 0 0 127260 127260
[ 0.000000] Normal free:66204kB min:66604kB low:83252kB high:99904kB active_anon:130235644kB inactive_anon:176kB active_file:672kB inactive_file:0kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:130314240kB mlocked:0kB dirty:148kB writeback:0kB mapped:996kB shmem:192kB slab_reclaimable:30832kB slab_unreclaimable:70864kB kernel_stack:10960kB pagetables:268392kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:1681 all_unreclaimable? yes
[ 0.000000] lowmem_reserve[]: 0 0 0 0
[ 0.000000] DMA: 0*4kB 2*8kB 0*16kB 2*32kB 1*64kB 1*128kB 1*256kB 0*512kB 1*1024kB 1*2048kB 3*4096kB = 15888kB
[ 0.000000] DMA32: 7*4kB 7*8kB 6*16kB 7*32kB 5*64kB 4*128kB 5*256kB 10*512kB 9*1024kB 5*2048kB 102*4096kB = 444884kB
[ 0.000000] Normal: 2444*4kB 832*8kB 612*16kB 367*32kB 175*64kB 117*128kB 1*256kB 1*512kB 1*1024kB 1*2048kB 0*4096kB = 67984kB
[ 0.000000] 0 total pagecache pages
[ 0.000000] 0 pages in swap cache
[ 0.000000] Swap cache stats: add 0, delete 0, find 0/0
[ 0.000000] Free swap = 0kB
[ 0.000000] Total swap = 0kB
[ 0.000000] 33554416 pages RAM
[ 0.000000] 594768 pages reserved
[ 0.000000] 2419 pages shared
[ 0.000000] 32818620 pages non-shared
dmesg命令应用的更多相关文章
- [转]Linux系统中‘dmesg’命令处理故障和收集系统信息的7种用法
'dmesg'命令显示linux内核的环形缓冲区信息,我们可以从中获得诸如系统架构.cpu.挂载的硬件,RAM等多个运行级别的大量的系统信息.当计算机启动时,系统内核(操作系统的核心部分)将会被加载到 ...
- linux dmesg命令参数及用法详解(linux显示开机信息命令)
linux dmesg命令参数及用法详解(linux显示开机信息命令) http://blog.csdn.net/zhongyhc/article/details/8909905 功能说明:显示开机信 ...
- linux dmesg命令
linux dmesg命令详解 功能说明:显示开机信息. 语 法:dmesg [-cn][-s ] 补充说明:kernel会将开机信息存储在ring buffer,若是开机时来不及查看信息,可利用 ...
- (转)Linux 系统设置 : dmesg 命令详解
原文:https://blog.csdn.net/yexiangCSDN/article/details/80683246 https://www.cnblogs.com/duanxz/p/34770 ...
- Linux下dmesg命令处理故障和收集系统信息的7种用法
目录: <syslog之一:Linux syslog日志系统详解> <syslog之二:syslog协议及rsyslog服务全解析> <syslog之三:建立Window ...
- linux 的dmesg命令
dmesg命令参考博客 http://www.linuxso.com/command/dmesg.html dmesg用来显示内核环缓冲区(kernel-ring buffer)内容,内核将各种消息存 ...
- dmesg命令详解
基础命令学习目录 http://linux.cn/article-3587-1.html dmesg 命令的使用范例 下面我们展示一些最负盛名的‘dmesg’命令工具以及其实际使用举例.‘dmesg’ ...
- dmesg命令的使用
dmesg命令用于打印Linux系统开机启动信息,kernel会将开机信息存储在ring buffer中.您若是开机时来不及查看信息,可利用dmesg来查看(print or control the ...
- Linux系统中‘dmesg’命令处理故障和收集系统信息的7种用法
转自:https://linux.cn/article-3587-1.html 'dmesg'命令显示linux内核的环形缓冲区信息,我们可以从中获得诸如系统架构.cpu.挂载的硬件,RAM等多个运行 ...
- Linux性能测试 dmesg命令
dmesg 命令主要用来显示内核信息.使用 dmesg 可以有效诊断机器硬件故障或者添加硬件出现的问题. 另外,使用 dmesg 可以确定您的服务器安装了那些硬件.每次系统重启,系统都会检查所有硬件 ...
随机推荐
- Java构造和解析Json数据的两种方法详解一——json-lib
转自:http://www.cnblogs.com/lanxuezaipiao/archive/2013/05/23/3096001.html 在www.json.org上公布了很多JAVA下的jso ...
- Android内存优化6 了解Android是如何管理App内存
1, Dalvik & ART Android在4.4之前一直使用的Dalvik虚拟机作为App的运行VM的, 4.4中引入了ART作为开发者备选, 5.0起正式将ART作为默认VM了. 我们 ...
- dl,dt,dd标记在网页中要充分利用
dl,dt,dd标记在网页中要充分利用 来源:网络整理 时间:08-05-27 点击: 点击这里收藏本文 我们在制作网页过程中用到列表时一般会使用<ul>或者<ol>标签,很少 ...
- Vue打包项目图片等静态资源的处理
项目打包,默认是打包在根目录下面的.当然我们可以通过设置,打包到任意子目录中去. 但是,当项目中引入资源的,比如:引入图片资源.js资源.或者字体图标之类的.那么可能在这个中间又会踩坑. 1.在vue ...
- 解决Oracle在Linux下Listener起不来，error 111错误
近来发生一个问题有点头疼,在linux上的Oracle数据库突然无法访问 主要报错如下: 基于本人的走歪路经验,分享一下我的解决思路: 首先,最直观的一点,监听器起不来,是不是数据库本身就没起来 se ...
- phpstorm快速跳转到错误行
phpstorm的快捷键,在网上可以搜索出很多,唯有“快速跳到错误行”的快捷键几乎搜索不出来. 看着错误提示,要一行一行的用眼睛去看,心累. 贴在这里,随时取用,再也不怕忘记了. Shift + F2 ...
- Junit测试Spring应用Dubbo测试框架之－Excel 工具类
package com.tree.autotest.demo; import com.alibaba.fastjson.JSON;import org.apache.poi.hssf.usermode ...
- 怎样在model里面使用number_to_currency
ActiveSupport::NumberHelper.number_to_currency(amount, precision: 0)
- 解决安装完Ubuntu系统后启动项中没有Ubuntu的问题
问题出现的原因是你没有把grub安装到硬盘的起始扇区里,按理说Ubuntu在安装的时候应该能很好的处理这个问题,但有个别电脑还是会出问题.不过我们可以通用命令解决 问题. 使用U盘进入Ubuntu系统 ...
- 【MVC5】使用权限+角色
1.在Ticket中设置用户角色 在权限的Ticket中设置用户的角色(这里是逗号分割). List<string> roles = new List<string>(); i ...