在检查一Linux服务器时，发现日志里面有大量“lvm[12446]: Another thread is handling an event. Waiting...”

Jul  4 00:01:42 localhost lvm[12446]: Another thread is handling an event. Waiting...

Jul  4 00:09:36 localhost lvm[12446]: Another thread is handling an event. Waiting...

Jul  4 00:13:42 localhost lvm[12446]: Another thread is handling an event. Waiting...

Jul  4 00:13:43 localhost lvm[12446]: Extension of snapshot VolGroup05/LogVol00-PS-user-snapshot finished successfully.

Jul  4 00:13:43 localhost lvm[12446]: dm_task_run failed, errno = 9, Bad file descriptor

Jul  4 00:14:42 localhost lvm[12446]: Extension of snapshot VolGroup05/LogVol00-PS-user-snapshot finished successfully.

Jul  4 00:15:52 localhost lvm[12446]: Extension of snapshot VolGroup05/LogVol00-PS-user-snapshot finished successfully.

Jul  4 00:17:02 localhost lvm[12446]: Another thread is handling an event. Waiting...

Jul  4 00:17:02 localhost lvm[12446]: Extension of snapshot VolGroup05/LogVol00-PS-user-snapshot finished successfully.

Jul  4 00:17:46 localhost lvm[12446]: Another thread is handling an event. Waiting...

Jul  4 00:18:52 localhost lvm[12446]: Extension of snapshot VolGroup05/LogVol00-PS-user-snapshot finished successfully.

Jul  4 00:19:42 localhost lvm[12446]: Extension of snapshot VolGroup05/LogVol00-PS-user-snapshot finished successfully.

Jul  4 00:20:32 localhost lvm[12446]: Snapshot VolGroup05-LogVol00--PS--user--snapshot is now 80% full. 

Jul  4 00:20:32 localhost lvm[12446]: Extension of snapshot VolGroup05/LogVol00-PS-user-snapshot finished successfully.

Jul  4 00:23:12 localhost lvm[12446]: Snapshot VolGroup05-LogVol00--PS--user--snapshot is now 85% full. 

Jul  4 00:23:12 localhost lvm[12446]: Another thread is handling an event. Waiting...

Jul  4 00:23:12 localhost lvm[12446]: Extension of snapshot VolGroup05/LogVol00-PS-user-snapshot finished successfully.

Jul  4 00:23:12 localhost lvm[12446]: dm_task_run failed, errno = 9, Bad file descriptor

Jul  4 00:26:09 localhost lvm[12446]: Another thread is handling an event. Waiting...

Jul  4 00:26:52 localhost last message repeated 2 times

Jul  4 00:26:52 localhost lvm[12446]: Snapshot VolGroup05-LogVol00--PS--user--snapshot is now 90% full. 

Jul  4 00:26:52 localhost lvm[12446]: Extension of snapshot VolGroup05/LogVol00-PS-user-snapshot finished successfully.

Jul  4 00:28:52 localhost lvm[12446]: Another thread is handling an event. Waiting...

Jul  4 00:28:52 localhost lvm[12446]: Snapshot VolGroup05-LogVol00--PS--user--snapshot is now 95% full. 

Jul  4 00:28:52 localhost lvm[12446]: Extension of snapshot VolGroup05/LogVol00-PS-user-snapshot finished successfully.

Jul  4 00:28:52 localhost lvm[12446]: dm_task_run failed, errno = 9, Bad file descriptor

Jul  4 00:31:07 localhost kernel: device-mapper: snapshots: Invalidating snapshot: Unable to allocate exception.

Jul  4 00:34:59 localhost lvm[12446]: Another thread is handling an event. Waiting...

Jul  4 00:35:42 localhost lvm[12446]: Another thread is handling an event. Waiting...

Jul  4 00:42:29 localhost lvm[12446]: Another thread is handling an event. Waiting...

Jul  4 00:44:16 localhost lvm[12446]: Another thread is handling an event. Waiting...

Jul  4 00:45:49 localhost lvm[12446]: Another thread is handling an event. Waiting...

Jul  4 00:46:59 localhost last message repeated 3 times

Jul  4 00:48:49 localhost last message repeated 2 times

在Redhat官网有看到相关资料介绍”"What does "lvm: Another thread is handling an event. Waiting..." log messages mean on Red Hat Enterprise Linux 6?" 如下所示:

问题

  • lvm event log messages
  • Continuous messages filling /var/log/messages
    lvm: Another thread is handling an event, Waiting...
    lvm: Another thread is handling an event, Waiting...

决议

  • These messages can safely be ignored at this stage.  They are verbose messages that do not indicate any error has occurred.
  • Red Hat are planning to remove these messages from the lvm2 package in a future release of Red Hat Enterprise Linux 6.

根源

  • dmeventd daemon montors for events that need to occur on device-mapper devices.

    • There are segments of code that can only be entered by one thread at a time.
    • If a second thread tries to enter the code section, it will be forced to wait until the first thread has exited. This message is printed when a process is forced to wait.
  • There is currently no evidence that there is any problem with locking access to critical code in dmeventd.

诊断步骤

If the following symptoms are present on your system, then this article may apply to your issue:

  • Your lvm2 package is 2.02.87-6.el6 or earlier.
  • You have more than 1 LVM snapshots on the system.

  • Periodically, the following messages appear in /var/log/messages:

        lvm: Another thread is handling an event. Waiting...
    
    lvm: Another thread is handling an event. Waiting...

根据官方文档资料，这个消息可以忽略，这中现象出现在你的系统中，当你系统满足下面条件：

当你的lvm2包版本是2.02.87-6.el6 或之前的版本。

当你的系统有超过一个LVM快照

对比、参考本机操作系统版本，发现lvm2的版本确实比2.02.87-6.el6 低。另外，这个系统也确实有多个LVM快照。唯一有点差别的是Linux版本Red Hat Enterprise Linux Server release 5.7 ，并不是Red Hat Enterprise Linux (RHEL) 6

[root@localhost ~]# rpm -qa | grep lvm

lvm2-2.02.84-6.0.1.el5

system-config-lvm-1.1.5-9.el5

[root@localhost ~]# cat /etc/redhat-release 

Red Hat Enterprise Linux Server release 5.7 (Tikanga)

另外，查看进程12446，也确实是/sbin/dmeventd

[root@localhost ~]# ps -ef | grep  12446 

root     12446     1  0 Jul02 ?        00:07:51 /sbin/dmeventd

root     26043 23106  0 11:06 pts/6    00:00:00 grep 12446

这个错误信息一直不停的出现在系统日志当中，很奇怪的时候，我同样环境的其它服务器又没有出现这个问题。应该是某些问题引起的。在做VG扫描时，发现有这样/dev/VolGroup03/LogVol00-PS-user-snapshot: read failed after 0 of 4096 at 0: Input/output error一些错误信息，怀疑这个导致引起的，但是生产环境还不能乱动，需要在测试环境测试、验证后，方能在生产环境处理。目前没有权限和资源处理，需要系统管理员帮忙解决。

lvm[12446]: Another thread is handling an event. Waiting的更多相关文章

  1. 【MySQL】MySQL同步报错-> received end packet from server, apparent master shutdown: Slave I/O thread: Failed reading log event, reconnecting to retry报错解决和分析

    [root@db-ft-db-48 ~]# tail -f /mysqlLog/beside_index_err.log 140102 20:42:26 [Note] Slave: received ...

  2. ORA-00471: DBWR process terminated with error案例

    每年年底,系统管理员都要组织一次容灾方案的测试.演练.会在一个与生产环境网络隔离的DR环境中,启动各个"生产环境服务器",然后让各路人员参与其中测试.演练容灾方案是否可靠.这次演练 ...

  3. Event Handling Guide for iOS--(一)--About Events in iOS

    About Events in iOS Users manipulate their iOS devices in a number of ways, such as touching the scr ...

  4. 线程 Thread类 GIL锁 信号量 Event事件

    线程的开启方法 进程是操作系统调度的最小单位,一个进程最少有一个主线程,而一个进程中可以开启多个线程 from threading import Thread def task(): print('A ...

  5. How a C++ compiler implements exception handling

    Introduction One of the revolutionary features of C++ over traditional languages is its support for ...

  6. How does a single thread handle asynchronous code in JavaScript?

    原文:https://www.quora.com/How-does-a-single-thread-handle-asynchronous-code-in-JavaScript ----------- ...

  7. Mysql源码学习——Thread Manager

    一.前言 上篇的Connection Manager中,曾提及对于一个新到来的Connection,服务器会创建一个新的线程来处理这个连接. 其实没那么简单,为了提高系统效率,减少频繁创建线程和中止线 ...

  8. Main event loop

    https://developer.apple.com/library/archive/documentation/General/Conceptual/Devpedia-CocoaApp/MainE ...

  9. Why should I avoid blocking the Event Loop and the Worker Pool?

    Don't Block the Event Loop (or the Worker Pool) | Node.js https://nodejs.org/en/docs/guides/dont-blo ...

随机推荐

  1. SQLServer中游标是如何处理数据的？

    游标(Cursor)是处理数据的一种方法,为了查看或者处理结果集中的数据,游标提供了在结果集中一次以行或者多行前进或向后浏览数据的能力.我们可以把游标当作一个指针,它可以指定结果中的任何位置,然后允许 ...

  2. servlet基本原理(手动创建动态资源+工具开发动态资源)

    一.手动开发动态资源 1 静态资源和动态资源的区别 静态资源: 当用户多次访问这个资源,资源的源代码永远不会改变的资源. 动态资源:当用户多次访问这个资源,资源的源代码可能会发送改变. <scr ...

  3. struts2输入验证

    1.方法     ① 基于Annotations的验证       ②基于XML配置的验证 http://blog.csdn.net/furongkang/article/details/692204 ...

  4. java基础盲点梳理

    类的基本成员才有默认值 finalize()并非析构,Java中没有析构,使用finalize()通常在于跨语言调用情景:比如使用C进行malloc内存分配以后,要在finalize()方法中进行fr ...

  5. Java IO 装饰者模式

    装饰模式(Decorator) 装饰模式又名包装(Wrapper)模式. 装饰模式以对客户端透明的方式扩展对象的功能,是继承关系的一个替代方案. 装饰模式通过创建一个包装对象,也就是装饰,来包裹真实的 ...

  6. jQuery8种不同的瀑布流懒加载loading效果

    优化图片加载插件jQuery8种不同的瀑布流懒加载loading效果  在线预览 下载地址 实例代码 <ul class="grid effect-1" id="g ...

  7. jQuery Pjax – 页面无刷新加载，优化用户体验

    pjax 是 HTML5 pushState 以及 Ajax 两项技术的简称,综合这两个技术可以实现在不刷新页面的情况下载入 HTML 到当前网页,带给你超快速的浏览器体验,而且有固定链接.标题以及后 ...

  8. angularjs封装bootstrap官网的时间插件datetimepicker

    背景:angular与jquery类库的协作 第三方类库中,不得不提的是大名鼎鼎的jquery,现在基本上已经是国内web开发的必修工具了.它灵活的dom操作,让很多web开发人员欲罢不能.再加上已经 ...

  9. java文件读写操作大全

    转自:http://hi.baidu.com/0_net/blog/item/8566fc2bb730c293033bf63e.html一.获得控制台用户输入的信息 public String get ...

  10. Failed to connect to database. Maximum number of conections to instance exceeded

    我们大体都知道ArcSDE的连接数有 48 的限制,很多人也知道这个参数可以修改,并且每种操作系统能支持的最大连接数是不同的. 如果应用报错:超出系统最大连接数 该如何处理? 两种解决办法: 第一,首 ...