ORA-01092 ORA-12432: LBAC error: zllegnp:OCIStmtExecute 故障一例

最近由于数据库hang住，无奈之下直接干掉了pmon进程，再次启动的时候收到了ORA-01092: ORACLE instance terminated. Disconnection forced以及ORA-12432: LBAC error: zllegnp:OCIStmtExecute。这下好了，有的整了，是个从来没有遇见的错误。下面是对这个错误的描述与解决。

1、故障描述
idle> startup
ORACLE instance started.

Total System Global Area  238530560 bytes
Fixed Size                  1335724 bytes
Variable Size             167775828 bytes
Database Buffers           62914560 bytes
Redo Buffers                6504448 bytes
Database mounted.
ORA-01092: ORACLE instance terminated. Disconnection forced
ORA-12432: LBAC error: zllegnp:OCIStmtExecute
Process ID: 10704
Session ID: 125 Serial number: 5

2、故障分析
--首先看看提示的几个ORA说什么
[oracle@linux1 ~]$ oerr ora 1092
01092, 00000, "ORACLE instance terminated. Disconnection forced"
// *Cause:  The instance this process was connected to was terminated
//          abnormally, probably via a shutdown abort. This process
//          was forced to disconnect from the instance.
// *Action: Examine the alert log for more details. When the instance has been
//          restarted, retry action.
--上面的 ora 1092通常由于shutdown abort导致，需要查看alert日志

[oracle@linux1 ~]$ oerr ora 12432
12432, 00000, "LBAC error: %s"
// *Cause:  LBAC enforcement resulted in an error.
// *Action: Correct the problem identified in the error message.
--上面ora 12432是关于LBAC的错误

--下面查看alert日志及其产生的trace文件
$ tail -fn 50 /u02/database/usbo/diag/rdbms/usbo/usbo/trace/alert_usbo.log
Tue Sep 03 14:58:39 2013
ARC3 started with pid=29, OS id=10716
SMON: enabling cache recovery
Archived Log entry 53 added for thread 1 sequence 57 ID 0xcde7041e dest 1:
Successfully onlined Undo Tablespace 2.
Verifying file header compatibility for 11g tablespace encryption..
Verifying 11g file header compatibility for tablespace encryption completed
SMON: enabling tx recovery
Database Characterset is AL32UTF8
No Resource Manager plan active
Errors in file /u02/database/usbo/diag/rdbms/usbo/usbo/trace/usbo_ora_10704.trc:
ORA-12432: LBAC error: zllegnp:OCIStmtExecute
Errors in file /u02/database/usbo/diag/rdbms/usbo/usbo/trace/usbo_ora_10704.trc:
ORA-12432: LBAC error: zllegnp:OCIStmtExecute
Error 12432 happened during db open, shutting down database
USER (ospid: 10704): terminating the instance due to error 12432
Instance terminated by USER, pid = 10704
ORA-1092 signalled during: ALTER DATABASE OPEN...
opiodr aborting process unknown ospid (10704) as a result of ORA-1092
Tue Sep 03 14:58:40 2013
ORA-1092 : opitsk aborting process

$ tail -10 /u02/database/usbo/diag/rdbms/usbo/usbo/trace/usbo_ora_10704.trc
Avg compares per lookup = 173/173 = 1.0
----------------------------------------------
Recovery sets nab of thread 1 seq 57 to 72 with 8 zeroblks

*** 2013-09-03 14:58:39.830
ORA-12432: LBAC error: zllegnp:OCIStmtExecute
ORA-12432: LBAC error: zllegnp:OCIStmtExecute

*** 2013-09-03 14:58:39.830
USER (ospid: 10704): terminating the instance due to error 12432
--上面的这些信息比较笼统，有些不好确认，查询metalink，找到了解决方案
--ORA-01092 ORA-12432 LBAC ERROR ZLLEGNP While Starting Up An Instance (Doc ID 735801.1)
--尽管其版本范围是Oracle Database - Enterprise Edition - Version 11.1.0.6 to 11.1.0.6 [Release 11.1]，我的11.2版本依旧适用
--Oracle给出的无法启动的原因
The issue happens because the OLS metadata is incomplete as a result of a shutdown abort executed while the script catnools.sql (or catols.sql)  was running.

3、故障解决
--Oracle给出的解决方案
--To solve this situation the LBAC option has to be disabled:
Step 1
  cd $ORACLE_HOME/rdbms/lib
  make -f ins_rdbms.mk lbac_off ioracle

-- Author   : Robinson Cheng
-- Blog     : http://blog.csdn.net/robinson_0612
-- DB Forum : http://bbs.dbsupport.cn

Step 2
$ sqlplus "/ as sysdba"
SQL> startup migrate
SQL> @?/rdbms/admin/catnools.sql
SQL> shutdown immediate
SQL> startup
SQL> select * from v$version where rownum<2;

BANNER
--------------------------------------------------------------------------------
Oracle Database 11g Enterprise Edition Release 11.2.0.1.0 - Production

     专业数据库论坛：http://bbs.dbsupport.cn

更多参考

有关Oracle RAC请参考
     使用crs_setperm修改RAC资源的所有者及权限     使用crs_profile管理RAC资源配置文件     RAC 数据库的启动与关闭     再说 Oracle RAC services     Services in Oracle Database 10g     Migrate datbase from single instance to Oracle RAC     Oracle RAC 连接到指定实例     Oracle RAC 负载均衡测试(结合服务器端与客户端)     Oracle RAC 服务器端连接负载均衡(Load Balance)     Oracle RAC 客户端连接负载均衡(Load Balance)     ORACLE RAC 下非缺省端口监听配置(listener.ora tnsnames.ora)
     ORACLE RAC 监听配置 (listener.ora tnsnames.ora)     配置 RAC 负载均衡与故障转移     CRS-1006 , CRS-0215 故障一例 
     基于Linux (RHEL 5.5) 安装Oracle 10g RAC
     使用 runcluvfy 校验Oracle RAC安装环境

有关Oracle 网络配置相关基础以及概念性的问题请参考：
     配置非默认端口的动态服务注册
     配置sqlnet.ora限制IP访问Oracle     Oracle 监听器日志配置与管理
     设置 Oracle 监听器密码(LISTENER)     配置ORACLE 客户端连接到数据库

有关基于用户管理的备份和备份恢复的概念请参考
     Oracle 冷备份     Oracle 热备份     Oracle 备份恢复概念     Oracle 实例恢复     Oracle 基于用户管理恢复的处理     SYSTEM 表空间管理及备份恢复     SYSAUX表空间管理及恢复     Oracle 基于备份控制文件的恢复(unsing backup controlfile)

有关RMAN的备份恢复与管理请参考
     RMAN 概述及其体系结构     RMAN 配置、监控与管理     RMAN 备份详解     RMAN 还原与恢复     RMAN catalog 的创建和使用     基于catalog 创建RMAN存储脚本     基于catalog 的RMAN 备份与恢复     RMAN 备份路径困惑     使用RMAN实现异机备份恢复(WIN平台)     使用RMAN迁移文件系统数据库到ASM     linux 下RMAN备份shell脚本     使用RMAN迁移数据库到异机

有关ORACLE体系结构请参考
     Oracle 表空间与数据文件     Oracle 密码文件     Oracle 参数文件     Oracle 联机重做日志文件(ONLINE LOG FILE)     Oracle 控制文件(CONTROLFILE)     Oracle 归档日志     Oracle 回滚(ROLLBACK)和撤销(UNDO)     Oracle 数据库实例启动关闭过程     Oracle 10g SGA 的自动化管理     Oracle 实例和Oracle数据库(Oracle体系结构)