RAC with asm on AIX, ORA-01114 error，with "gipcretAuthFail (22) " in ocssd.log
I/O Errors in Alert log with ORA-29701, with "gipcWait failed with 16" in trace (文档 ID 1496329.1)
1. Database alert log
Fri May :: Errors in file /oracle/app/oracle/diag/rdbms/orcl/rocl1/trace/rocl1_ora_65536796.trc: ORA-: 将块写入文件 时出现 IO 错误 (块 # ) Fri May ::
2. trace file
Oracle Database 11g Enterprise Edition Release - 64bit Production With the Partitioning, Real Application Clusters, Automatic Storage Management, OLAP, Data Mining and Real Application Testing options ORACLE_HOME = /oracle/app/oracle/product//db_1 System name: AIX Node name: rac1 Release: Version: Machine: 00F6E7C84C00 Instance name: rocl1 Redo thread mounted by this instance: Oracle process number: Unix process pid: , image: oracle@rac1 *** -- ::58.840 *** SESSION ID:(-- ::58.840 *** CLIENT ID:() -- ::58.840 *** SERVICE NAME:(orcl) -- ::58.840 *** MODULE NAME:(JDBC Thin Client) -- ::58.840 *** ACTION NAME:() -- ::58.840 -- :: () -- :: kgxgncin: CLSS init failed with status kgxgncin: return status ( SKGXN not av) from CLSS kjfmsgr: unable to connect to NM for reg in shared group ORA-: 将块写入文件 时出现 IO 错误 (块 # ) Dump of memory from 0x070001209CBA0328 to 0x070001209CBA0D3B 70001209CBA0320 20544F44 [WITH TOD]
3. ocssd.log
-- 检查/oracle/app//grid/log/rac1/cssd/ocssd.log 文件
-- ::]clssgmQueueShare: (11ba99f10) target global grock DBORCL member type queued from client (1176496b0), global grock DBORCL, refcount
-- ::]clssgmRegisterShared: global grock DBORCL member share type , refcount
-- ::] gipcmodMuxTransferAccept: internal accept request failed endp 1112a2970, child 11ba653d0, ret gipcretAuthFail (22)
-- ::] gipcmodMuxTransferAccept: EXCEPTION[ ret gipcretAuthFail () ] error during accept on endp 1112a2970
-- ::] gipcmodClscCallback: async request failed req 1172b0bf0 [00000000e3b63bc0] { gipcSendRequest : addr , olen , parentEndp 11abbcef
, ret gipcretConnectionLost (), objFlags )
-- ::] gipcmodMuxTransferAccept: internal accept request failed endp 1112a2970, child 11abbcef0, ret gipcretConnectionInvalid ()
-- ::] gipcmodMuxTransferAccept: EXCEPTION[ ret gipcretConnectionInvalid () ] error during accept on endp 1112a2970
-- ::]clssscSelect: cookie accept request 11ad57f10
-- ::]clssscevtypSHRCON: getting client with cmproc 11ad57f10
-- ::]clssgmRegisterClient: proc(/11ad57f10), client(/1174aaa90)
-- ::]clssscSelect: cookie accept request 11ba74630
-- ::]clssscevtypSHRCON: getting client with cmproc 11ba74630
-- ::]clssgmRegisterClient: proc(/11ba74630), client(/)
-- ::]clssgmRegisterShared: grp DG_LOCAL_DATA, mbr , type
-- ::]clssgmQueueShare: (11a93a690) target local grock DG_LOCAL_DATA member type queued from client (1174aaa90), local grock DG_LOCAL_DATA, refcount
-- ::]clssgmRegisterShared: local grock DG_LOCAL_DATA member share type , refcount
-- ::]clssgmRegisterShared: grp DBORCL, mbr , type
-- ::]clssgmQueueShare: (11a93ab70) target global grock DBORCL member type queued from client (), global grock DBORCL, refcount
-- ::]clssgmRegisterShared: global grock DBORCL member share type , refcount
-- ::] gipcmodClscCallback: async request failed req 11730eff0 [00000000e3b63c64] { gipcSendRequest : addr , olen , parentEndp 11abbcef
, ret gipcretConnectionLost (), objFlags )
-- ::] gipcmodMuxTransferAccept: internal accept request failed endp 1112a2970, child 11abbcef0, ret gipcretConnectionInvalid ()
-- ::] gipcmodMuxTransferAccept: EXCEPTION[ ret gipcretConnectionInvalid () ] error during accept on endp 1112a2970
-- ::]clssscSelect: cookie accept request 11ba4a590
-- ::]clssscevtypSHRCON: getting client with cmproc 11ba4a590
-- ::]clssgmRegisterClient: proc(/11ba4a590), client(/11764d8f0)
-- ::]clssscSelect: cookie accept request 1109c2e00
-- ::]clssgmAllocProc: (11bac8dd0) allocated
4. 检查CRS_home空间及文件
目录空间足够。 ls -ld /var/tmp/.oracle drwxrwxrwt root oinstall Nov /var/tmp/.oracle ls -ld /tmp/.oracle drwxrwxrwt root oinstall Jan : /tmp/.oracle
5. 数据库此刻出现活动回话剧增，459f3z9u4fb3u语句查询字典视图出现（cursor: pin S wait on X）等待事件，且sga频繁收缩和扩展
SHRINK |IMMEDIATE |db_cache_size | | | |COMPLETE |/ : | SHRINK |IMMEDIATE |db_cache_size | | | |COMPLETE |/ : | SHRINK |IMMEDIATE |db_cache_size | | | |COMPLETE |/ : | GROW |IMMEDIATE |shared_pool_size | | | |COMPLETE |/ : | GROW |IMMEDIATE |shared_pool_size | | | |COMPLETE |/ : | GROW |IMMEDIATE |shared_pool_size | | | |COMPLETE |/ : | SHRINK |IMMEDIATE |db_cache_size | | | |COMPLETE |/ : | SHRINK |IMMEDIATE |db_cache_size | | | |COMPLETE |/ : | SHRINK |IMMEDIATE |db_cache_size | | | |COMPLETE |/ : | SHRINK |IMMEDIATE |db_cache_size | | | |COMPLETE |/ : | GROW |IMMEDIATE |shared_pool_size | | | |COMPLETE |/ : | GROW |DEFERRED |db_cache_size | | | |COMPLETE |/ : | SHRINK |DEFERRED |shared_pool_size | | | |COMPLETE |/ : | SHRINK |DEFERRED |shared_pool_size | | | |COMPLETE |/ : | GROW |DEFERRED |db_cache_size | | | |COMPLETE |/ : | GROW |DEFERRED |db_cache_size | | | |COMPLETE |/ : | SHRINK |DEFERRED |shared_pool_size | | | |COMPLETE |/ : | GROW |DEFERRED |db_cache_size | | | |COMPLETE |/ : | SHRINK |DEFERRED |shared_pool_size | | | |COMPLETE |/ : | SHRINK |IMMEDIATE |db_cache_size | | | |COMPLETE |/ : | GROW |IMMEDIATE |shared_pool_size | | | |COMPLETE |/ : | GROW |IMMEDIATE |shared_pool_size | | | |COMPLETE |/ : | SHRINK |IMMEDIATE |db_cache_size | | | |COMPLETE |/ : | GROW |IMMEDIATE |shared_pool_size | | | |COMPLETE |/ : | SHRINK |IMMEDIATE |db_cache_size | | | |COMPLETE |/ : | GROW |IMMEDIATE |shared_pool_size | | | |COMPLETE |/ : | SHRINK |IMMEDIATE |db_cache_size | | | |COMPLETE |/ : | SHRINK |IMMEDIATE |db_cache_size | | | |COMPLETE |/ : | SHRINK |IMMEDIATE |db_cache_size | | | |COMPLETE |/ : | GROW |IMMEDIATE |shared_pool_size | | | |COMPLETE |/ : | GROW |IMMEDIATE |shared_pool_size | | | |COMPLETE |/ : | SHRINK |DEFERRED |shared_pool_size | | | |COMPLETE |/ : | GROW |DEFERRED |db_cache_size | | | |COMPLETE |/ : |
Cause 3. ocssd log has "gipcretAuthFail (22)" (文档 ID 1496329.1)
Example: -- ::] gipcmodMuxTransferAccept: EXCEPTION[ ret gipcretAuthFail () ] error during accept on endp 111249b70 gipcretAuthFail () indicates "general security authorization failure". This could occur for multiple reasons: * if filesystem is full and there is no space to create file under auth directory. Please check if there is sufficient space in CRS_HOME. * Also this issue could occur if /var/tmp/.oracle socket is deleted (/tmp/.oracle on some platforms) . Please check on this too.
核查结果与【Cause 3. ocssd log has "gipcretAuthFail (22)" (文档 ID 1496329.1)】情况一致，但我们数据库软件目录空间足够且.oracle文件存在。
问题分析总结：ORA-01114告警是由于数据库SGA出现抖动引起数据库出现性能问题导致。
处理建议：增加SGA大小132G扩大到180G（v$sga_target_advice建议值)
RAC with asm on AIX, ORA-01114 error，with "gipcretAuthFail (22) " in ocssd.log的更多相关文章
- rac下asm管理的表空间-数据文件的重命名
asm下表空间的重命名与普通文件系统下的表空间重命名原理是一样的,只不过asm管理的数据文件有一些需要注意的地方,另外在asm下操作数据文件需要格外小心,稍有不慎将会造成数据文件丢失,如可以做备份最好 ...
- 删RAC中间ASM和LISTENER
资源的正确方法
在我们的安装RAC什么时候.有时因各种错误加载错误ASM实例或LISTENER显示器,或增加CLUSTERWARE资源,但并没有真正的工作,例如: 如图所看到的,这里在2个节点分别创建过ASM1和AS ...
- Oracle 11G RAC For ASM 利用RMAN COPY进行存储迁移
转载请注明出处 一.需求背景 客户数据库存储空间接近存满,需购置一台新的存储,进行数据迁移,客户允许少量停机时间. 二.实施方法讨论 利用ASM rebalance 进行迁移 可以实现0宕机进行迁移, ...
- ORACLE RAC 监听配置 (listener.ora tnsnames.ora)
Oracle RAC 监听器的配置与单实例稍有不同,但原理和实现方法基本上是相同的.在Oracle中 tns进程用于为指定网络地址上的一个或多个Oracle 实例提供服务注册,并响应来自客户端对该服务 ...
- 使用git error: RPC failed; result=22, HTTP code = 411
使用git提交比较大的文件的时候可能会出现这个错误 error: RPC failed; result=22, HTTP code = 411 fatal: The remote end hung u ...
- git clone error: RPC failed; result=22, HTTP code = 502
http://www.jianshu.com/p/645d3fe4e028 git克隆的工程太大用https的方式会有如下问题 hbl:tmp hubert$ git clone https://gi ...
- winedt打开.tex文件时会出现reading error，看不到任何文字
winedt打开.tex文件时会出现reading error,然后看不到任何文字. 解决办法:先打开空白的winedt,然后点击open,找到该.tex文件,将文件名右侧的 default 改为 ...
- 在SharePoint2010中用out-of-box的方式自定制Application Pages（AccessDenied，Confirmation，Error，Login，RequestAccess，Signout，WebDeleted）
在实际项目中需要对SharePoint2010中的AccessDenied页面进行自定制,于是乎上网搜索相关内容,经实际操作此方法可行,便以此文记录. 在SharePoint2010中,由于secur ...
- Jquery Ajax的时候 老是返回到 error，是因为json格式不正规的原因
Jquery Ajax的时候 老是返回到 error,是因为json格式不正规的原因: 怪不得不执行,原来我返回的是{success:true,id:1} 这种不规则的字符串,不是严格的json格式, ...
随机推荐
- Json.Net组件指定/忽略序列化字段属性技巧知识点
我们在用Json.Net序列化组件序列化类的时候,经常有这样的一个需求:指定被序列化类中的某些字段属性是要忽略的,或者是指定字段属性序列化 比如下面这个类: public class Bar { pu ...
- java 对CSV 文件的读取与生成
CSV文件是以逗号分隔值的文件格式,一般用WORDPAD或记事本(NOTE),EXCEL打开.CSV(逗号分隔值)是一种用来存储数据的纯文本文件,通常都是用于存放电子表格或数据的一种文件格式,对于CS ...
- finally 的作用是什么？
在java中finally首先必须使用在所有catch的最后位置, 无论是否抛出异常,finally代码块总是会被执行.就算是没有catch语句同时又抛出异常的情况下,finally代码块任然会被执行 ...
- jQuery实现的上下滚动公告栏详细讲解
之前做项目的时候,一直都想着做一个上下滚动的公告栏,作为展示网站的最新公告信息,因为刚开始自己的思路并不是太清晰,在网上找了很多的源码,但是却发现都不能让自己满意,有的还会出现一些小问题,比如,有时候 ...
- opencv3.2.0图像离散傅里叶变换
源码: ##名称:离散傅里叶变换 ##平台:QT5.7.1+opencv3.2.0 ##日期:2017年12月13. /**** 新建QT控制台程序****/ #include <QCoreAp ...
- Java项目经验——程序员成长的钥匙
本文转载至:http://geek.csdn.net/news/detail/109880,像我这样的菜鸟应该多看几遍这样的文章,学起来才更加有动力和方向. Java就是用来做项目的!Java的主要应 ...
- sql 去重关键字 distinct
单列去重: mysql: drop table test;create table test(id int(4));insert into test values(1),(2),(3),(4),(1) ...
- vmware虚拟机挂载Windows磁盘的两种方法
第一种 vmware虚拟机通过ntfs-3g挂接windows盘 1.共享windows盘虚拟机设置——>添加硬盘——>选择IDE——>使用物理磁盘——>选择本地盘(单分区)— ...
- npm与gulp的使用
这边将工作中使用的npm以及gulp的一些方法做了整理,方便以后查阅,至少不用去麻烦度娘了~ A.npm的使用: 1.在你所需要的文件夹里面初始化npm--> npm init -y - ...
- c# 线程池：开启10个线程运行Fibonacci,并在所有线程运行完后，得出结果。
namespace CAThreadPool { class ThreadpoolDemo6 { static void Main(string[] args) { ; // One event is ...