模拟一则ORA-600 [4194][][]故障并处理
环境：OEL 5.7 + Oracle 11.2.0.3
1.模拟ORA-600 [4194][][]故障
本次实验环境模拟的是相关的undo/rollback block在system rollback segment上的场景：
SQL> alter database open;
alter database open
*
ERROR at line 1:
ORA-01092: ORACLE instance terminated. Disconnection forced
ORA-00600: internal error code, arguments: [4194], [], [], [], [], [], [], [],
[], [], [], []
Process ID: 6670
Session ID: 26 Serial number: 37
注意：
- 1.这种场景无法通过使用隐藏参数（_offline_rollback_segments和_corrupted_rollback_segments）来绕过问题;
- 2.我这里实验验证是通过bbed修改system文件128号块的ktuxc.ktuxcfbp[0].ktufbuba.kubarec来模拟4194故障;
- 3.数据库版本不一样，所在块号可能不同，比如9i/10g就都是9号块;
- 4.这个实验我在11.2.0.3这个版本的测试，4194后面参数是没有任何值的，而在10.2.0.4测试模拟同样故障后面是有参数值的;
- 5.请一定不要在任何生产环境尝试做此类操作。
查询system的回滚段头所在块：
select HEADER_FILE, HEADER_BLOCK, BLOCKS, EXTENTS from dba_segments where segment_name = 'SYSTEM' and SEGMENT_TYPE = 'ROLLBACK';
查看数据库的alert日志：
Fri May 17 04:59:13 2019
SMON: enabling cache recovery
Errors in file /opt/app/oracle/diag/rdbms/test/test/trace/test_ora_6670.trc (incident=4969):
ORA-00600: internal error code, arguments: [4194], [], [], [], [], [], [], [], [], [], [], []
Incident details in: /opt/app/oracle/diag/rdbms/test/test/incident/incdir_4969/test_ora_6670_i4969.trc
Use ADRCI or Support Workbench to package the incident.
See Note 411.1 at My Oracle Support for error and packaging details.
Fri May 17 04:59:17 2019
Dumping diagnostic data in directory=[cdmp_20190517045917], requested by (instance=1, osid=6670), summary=[incident=4969].
Block recovery from logseq 2, block 66292 to scn 1006025
Recovery of Online Redo Log: Thread 1 Group 2 Seq 2 Reading mem 0
Mem# 0: +DATADG/test/onlinelog/group_2.341.1008434769
Block recovery stopped at EOT rba 2.66294.16
Block recovery completed at rba 2.66294.16, scn 0.1006022
Block recovery from logseq 2, block 66292 to scn 1006021
Recovery of Online Redo Log: Thread 1 Group 2 Seq 2 Reading mem 0
Mem# 0: +DATADG/test/onlinelog/group_2.341.1008434769
Block recovery completed at rba 2.66294.16, scn 0.1006022
Undo initialization errored: err:600 serial:0 start:1356834 end:1362534 diff:5700 (57 seconds)
Errors in file /opt/app/oracle/diag/rdbms/test/test/trace/test_ora_6670.trc:
ORA-00600: internal error code, arguments: [4194], [], [], [], [], [], [], [], [], [], [], []
Errors in file /opt/app/oracle/diag/rdbms/test/test/trace/test_ora_6670.trc:
ORA-00600: internal error code, arguments: [4194], [], [], [], [], [], [], [], [], [], [], []
Error 600 happened during db open, shutting down database
USER (ospid: 6670): terminating the instance due to error 600
Instance terminated by USER, pid = 6670
ORA-1092 signalled during: alter database open...
opiodr aborting process unknown ospid (6670) as a result of ORA-1092
Fri May 17 04:59:20 2019
ORA-1092 : opitsk aborting process
2.使用bbed处理
需要处理：
ktuxc.ktuxcnfb
ktuxc.ktuxcfbp[0].ktufbuba.kubadba
kcbh.flg_kcbh
kcbh.chkval_kcbh
核心命令：
set offset ktuxc.ktuxcnfb
modify 0x0000
set offset ktuxc.ktuxcfbp[0].ktufbuba
modify 0x00000000
set offset kcbh.flg_kcbh
modify 0x00
set offset kcbh.chkval_kcbh
modify 0x0000
实际处理过程如下：
[oracle@OEL-ASM tmp]$ bbed parfile=bbed.par
Password:
BBED: Release 2.0.0.0.0 - Limited Production on Fri May 17 05:05:22 2019
Copyright (c) 1982, 2011, Oracle and/or its affiliates. All rights reserved.
************* !!! For Oracle Internal Use only !!! ***************
BBED> map
File: /tmp/system01.bak (1)
Block: 1 Dba:0x00400001
------------------------------------------------------------
Data File Header
struct kcvfh, 860 bytes @0
ub4 tailchk @8188
BBED> set dba 1,128
DBA 0x00400080 (4194432 1,128)
BBED> map
File: /tmp/system01.bak (1)
Block: 128 Dba:0x00400080
------------------------------------------------------------
Unlimited Undo Segment Header
struct kcbh, 20 bytes @0
struct ktech, 72 bytes @20
struct ktemh, 16 bytes @92
struct ktetb[6], 48 bytes @108
struct ktuxc, 104 bytes @4148
struct ktuxe[255], 10200 bytes @4252
ub4 tailchk @8188
BBED> p kcbh
struct kcbh, 20 bytes @0
ub1 type_kcbh @0 0x0e
ub1 frmt_kcbh @1 0xa2
ub1 spare1_kcbh @2 0x00
ub1 spare2_kcbh @3 0x00
ub4 rdba_kcbh @4 0x00400080
ub4 bas_kcbh @8 0x000f59bb
ub2 wrp_kcbh @12 0x0000
ub1 seq_kcbh @14 0x01
ub1 flg_kcbh @15 0x04 (KCBHFCKV)
ub2 chkval_kcbh @16 0x3626
ub2 spare3_kcbh @18 0x0000
BBED> p ktuxc
struct ktuxc, 104 bytes @4148
struct ktuxcscn, 8 bytes @4148
ub4 kscnbas @4148 0x000f26af
ub2 kscnwrp @4152 0x0000
struct ktuxcuba, 8 bytes @4156
ub4 kubadba @4156 0x0040021f
ub2 kubaseq @4160 0x001b
ub1 kubarec @4162 0x03
sb2 ktuxcflg @4164 1 (KTUXCFSK)
ub2 ktuxcseq @4166 0x001b
sb2 ktuxcnfb @4168 1
ub4 ktuxcinc @4172 0x00000000
sb2 ktuxcchd @4176 3
sb2 ktuxcctl @4178 91
ub2 ktuxcmgc @4180 0x8002
ub4 ktuxcopt @4188 0x7ffffffe
struct ktuxcfbp[0], 12 bytes @4192
struct ktufbuba, 8 bytes @4192
ub4 kubadba @4192 0x0040021f
ub2 kubaseq @4196 0x001b
ub1 kubarec @4198 0x0d
sb2 ktufbext @4200 3
sb2 ktufbspc @4202 5510
struct ktuxcfbp[1], 12 bytes @4204
struct ktufbuba, 8 bytes @4204
ub4 kubadba @4204 0x00000000
ub2 kubaseq @4208 0x001a
ub1 kubarec @4210 0x02
sb2 ktufbext @4212 2
sb2 ktufbspc @4214 7958
struct ktuxcfbp[2], 12 bytes @4216
struct ktufbuba, 8 bytes @4216
ub4 kubadba @4216 0x00000000
ub2 kubaseq @4220 0x0018
ub1 kubarec @4222 0x3a
sb2 ktufbext @4224 0
sb2 ktufbspc @4226 2062
struct ktuxcfbp[3], 12 bytes @4228
struct ktufbuba, 8 bytes @4228
ub4 kubadba @4228 0x00000000
ub2 kubaseq @4232 0x0000
ub1 kubarec @4234 0x00
sb2 ktufbext @4236 0
sb2 ktufbspc @4238 0
struct ktuxcfbp[4], 12 bytes @4240
struct ktufbuba, 8 bytes @4240
ub4 kubadba @4240 0x00000000
ub2 kubaseq @4244 0x0000
ub1 kubarec @4246 0x00
sb2 ktufbext @4248 0
sb2 ktufbspc @4250 0
BBED> set offset 4168
OFFSET 4168
BBED> p
ktuxc.ktuxcnfb
--------------
sb2 ktuxcnfb @4168 1
BBED> modify 0x0000
Warning: contents of previous BIFILE will be lost. Proceed? (Y/N) y
File: /tmp/system01.bak (1)
Block: 128 Offsets: 4168 to 4679 Dba:0x00400080
------------------------------------------------------------------------
00000000 00000000 03005b00 02800100 68000000 feffff7f 1f024000 1b000d00
03008615 00000000 1a000200 0200161f 00000000 18003a00 00000e08 00000000
00000000 00000000 00000000 00000000 00000000 14000000 1e024000 28570f00
00000000 09005800 00000000 00000000 00000000 01000000 00000000 13000000
1a024000 bc260f00 00000000 09005f00 00000000 00000000 00000000 01000000
00000000 13000000 1b024000 db260f00 00000000 09005c00 00000000 00000000
00000000 01000000 00000000 13000000 1a024000 b2260f00 00000000 09000400
00000000 00000000 00000000 01000000 00000000 13000000 1a024000 b4260f00
00000000 09000600 00000000 00000000 00000000 01000000 00000000 13000000
1b024000 e5260f00 00000000 09000a00 00000000 00000000 00000000 01000000
00000000 13000000 1a024000 b7260f00 00000000 09006100 00000000 00000000
00000000 01000000 00000000 13000000 1b024000 c2260f00 00000000 09005900
00000000 00000000 00000000 02000000 00000000 14000000 1f024000 30570f00
00000000 09005b00 00000000 00000000 00000000 01000000 00000000 13000000
1b024000 ce260f00 00000000 09001200 00000000 00000000 00000000 01000000
00000000 13000000 1b024000 e7260f00 00000000 09001000 00000000 00000000
<32 bytes per line>
BBED> p
ktuxc.ktuxcnfb
--------------
sb2 ktuxcnfb @4168 0
BBED> set offset 4192
OFFSET 4192
BBED> p
ktuxc.ktuxcfbp[0].ktufbuba.kubadba
----------------------------------
ub4 kubadba @4192 0x0040021f
BBED> modify 0x00000000
File: /tmp/system01.bak (1)
Block: 128 Offsets: 4192 to 4703 Dba:0x00400080
------------------------------------------------------------------------
00000000 1b000d00 03008615 00000000 1a000200 0200161f 00000000 18003a00
00000e08 00000000 00000000 00000000 00000000 00000000 00000000 14000000
1e024000 28570f00 00000000 09005800 00000000 00000000 00000000 01000000
00000000 13000000 1a024000 bc260f00 00000000 09005f00 00000000 00000000
00000000 01000000 00000000 13000000 1b024000 db260f00 00000000 09005c00
00000000 00000000 00000000 01000000 00000000 13000000 1a024000 b2260f00
00000000 09000400 00000000 00000000 00000000 01000000 00000000 13000000
1a024000 b4260f00 00000000 09000600 00000000 00000000 00000000 01000000
00000000 13000000 1b024000 e5260f00 00000000 09000a00 00000000 00000000
00000000 01000000 00000000 13000000 1a024000 b7260f00 00000000 09006100
00000000 00000000 00000000 01000000 00000000 13000000 1b024000 c2260f00
00000000 09005900 00000000 00000000 00000000 02000000 00000000 14000000
1f024000 30570f00 00000000 09005b00 00000000 00000000 00000000 01000000
00000000 13000000 1b024000 ce260f00 00000000 09001200 00000000 00000000
00000000 01000000 00000000 13000000 1b024000 e7260f00 00000000 09001000
00000000 00000000 00000000 01000000 00000000 13000000 1c024000 15290f00
<32 bytes per line>
BBED> p
ktuxc.ktuxcfbp[0].ktufbuba.kubadba
----------------------------------
ub4 kubadba @4192 0x00000000
BBED> map
File: /tmp/system01.bak (1)
Block: 128 Dba:0x00400080
------------------------------------------------------------
Unlimited Undo Segment Header
struct kcbh, 20 bytes @0
struct ktech, 72 bytes @20
struct ktemh, 16 bytes @92
struct ktetb[6], 48 bytes @108
struct ktuxc, 104 bytes @4148
struct ktuxe[255], 10200 bytes @4252
ub4 tailchk @8188
BBED> p kcbh
struct kcbh, 20 bytes @0
ub1 type_kcbh @0 0x0e
ub1 frmt_kcbh @1 0xa2
ub1 spare1_kcbh @2 0x00
ub1 spare2_kcbh @3 0x00
ub4 rdba_kcbh @4 0x00400080
ub4 bas_kcbh @8 0x000f59bb
ub2 wrp_kcbh @12 0x0000
ub1 seq_kcbh @14 0x01
ub1 flg_kcbh @15 0x04 (KCBHFCKV)
ub2 chkval_kcbh @16 0x3626
ub2 spare3_kcbh @18 0x0000
BBED> set offset 15
OFFSET 15
BBED> p
kcbh.flg_kcbh
-------------
ub1 flg_kcbh @15 0x04 (KCBHFCKV)
BBED> modify 0x00
File: /tmp/system01.bak (1)
Block: 128 Offsets: 15 to 526 Dba:0x00400080
------------------------------------------------------------------------
00263600 00000000 00000000 00000000 00000000 00060000 002f0000 00201000
00030000 00070000 00080000 001f0240 00000000 00030000 00000000 00000000
00000000 00000000 00000000 00060000 00000000 00000000 00000000 40810040
00070000 00880040 00080000 00100240 00080000 00180240 00080000 00200240
00080000 00280240 00080000 00000000 00000000 00000000 00000000 00000000
00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
<32 bytes per line>
BBED> p
kcbh.flg_kcbh
-------------
ub1 flg_kcbh @15 0x00 (NONE)
BBED> set offset 16
OFFSET 16
BBED> p
kcbh.chkval_kcbh
----------------
ub2 chkval_kcbh @16 0x3626
BBED> modify 0x0000
File: /tmp/system01.bak (1)
Block: 128 Offsets: 16 to 527 Dba:0x00400080
------------------------------------------------------------------------
00000000 00000000 00000000 00000000 00000000 06000000 2f000000 20100000
03000000 07000000 08000000 1f024000 00000000 03000000 00000000 00000000
00000000 00000000 00000000 06000000 00000000 00000000 00000040 81004000
07000000 88004000 08000000 10024000 08000000 18024000 08000000 20024000
08000000 28024000 08000000 00000000 00000000 00000000 00000000 00000000
00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
<32 bytes per line>
BBED> p
kcbh.chkval_kcbh
----------------
ub2 chkval_kcbh @16 0x0000
BBED> sum apply
Check value for File 1, Block 128:
current = 0x0000, required = 0x0000
BBED> exit
[oracle@OEL-ASM tmp]$
3.尝试启动数据库
bbed修改完成，再次尝试启动数据库成功：
SQL> startup mount
ORACLE instance started.
Total System Global Area 1703624704 bytes
Fixed Size 2229024 bytes
Variable Size 989859040 bytes
Database Buffers 704643072 bytes
Redo Buffers 6893568 bytes
Database mounted.
SQL> alter database open;
Database altered.
其他类ORA-600 [4194]的场景，可参考之前的随笔：
模拟一则ORA-600 [4194][][]故障并处理的更多相关文章
- Oracle创建新undo表空间最佳实践(包含段检查)
在处理一则ORA-600 [4194]案例时,参考MOS文档:Step by step to resolve ORA-600 4194 4193 4197 on database crash (文档 ...
- 基于iSCSI的SQL Server 2012群集测试(四)--模拟群集故障转移
6.模拟群集故障转移 6.1 模拟手动故障转移(1+1) 模拟手动故障转移的目的有以下几点: 测试群集是否能正常故障转移 测试修改端口是否能同步到备节点 测试禁用full-text和Browser服务 ...
- [Oracle]如何获得出现故障时，客户端的详细连接信息
[Oracle]如何获得出现故障时,客户端的详细连接信息 客户坚持说 只是在 每天早上5点才运行下面的语句: select / * + FULL (TAB001_TT01) * / 'TAB001_T ...
- 删除online日志測试及ora-600 [4194]错误的处理
今天做了一个关于破坏online日志的恢复測试,主要三个场景: 測试1:正常关闭数据库后删除非当前日志 測试2:正常关库后.删除在线日志文件 測试3:非正常关闭数据库.并删除当前在线日志文件 我的測试 ...
- RHEL 启动系统及故障排除
一:Linux的启动过程: 开机加电自检->MBR引导(boot loader占446字节,分区列表64字节,magic占2字节)-->grub菜单(MBR是grub的第一个字段,第二个字 ...
- CSS 故障艺术
本文的主题是 Glitch Art,故障艺术. 什么是故障艺术?我们熟知的抖音的 LOGO 正是故障艺术其中一种表现形式.它有一种魔幻的感觉,看起来具有闪烁.震动的效果,很吸引人眼球. 故障艺术它模拟 ...
- [UWP]抄抄《CSS 故障艺术》的动画
1. 前言 什么是故障艺术(Glitch Art 风)?我们熟知的抖音的 LOGO 正是故障艺术其中一种表现形式.它有一种魔幻的感觉,看起来具有闪烁.震动的效果,很吸引人眼球.故障艺术它模拟了画面信号 ...
- OCA读书笔记(18) - 使用Support工具
调查和解决问题 问题:数据库中的任一严重的错误定义为一个问题,一般来说,这些错误包括大家熟悉的ORA-600错误和ORA-04031(共享池超出)错误,涉及数据库问题的所有元数据都存储在ADR中,每个 ...
- 关于Oracle数据库故障诊断基础架构
本节包含有关Oracle数据库故障诊断基础结构的背景信息.它包含以下主题: 故障诊断基础架构概述 关于事件和问题 故障诊断基础设施组件 自动诊断信息库的结构,内容和位置 故障诊断基础架构概述 故障诊断 ...
随机推荐
- BZOJ4829: [Hnoi2017]队长快跑
BZOJ4829: [Hnoi2017]队长快跑 Description 众所周知,在P国外不远处盘踞着巨龙大Y. 传说中,在远古时代,巨龙大Y将P国的镇国之宝窃走并藏在了其巢穴中,这吸引着整个P国的 ...
- 为什么说Python是一门动态语言--Python的魅力
动态语言的定义:动态编程语言是高级程序设计语言的一个类别.在计算机科学领域已被广泛应用.它是一类在执行时能够改变其结构的语言:比如新的函数.对象.甚至代码能够被引进.已有的函数能够被删除或是其它结构上 ...
- STemWin显示汉字 — SD卡外挂XBF字库
转载注明出处 方法来自安福莱教程 1: 使用emWin自带小工具生成字库 (1)启动软件 选择4位抗锯齿 (2)根据需求选择字体类型和字体大小 (3)另存为XBF格式 2: 创建XBF字体 #inc ...
- 微信小程序开发：学习笔记[4]——样式布局
微信小程序开发:学习笔记[4]——样式布局 Flex布局 新的布局方式 在小程序开发中,我们需要考虑各种尺寸终端设备上的适配.在传统网页开发,我们用的是盒模型,通过display:inline | b ...
- pymysql 模块的使用
一 . pymysql 的下载和使用 在python 中操作数据库需要用到 pymysql 模块. (1) . pymysql 模块的下载 pip3 install pymysql (2) . ...
- codeforces 112B Petya and Square
B. Petya and Square time limit per test 2 seconds memory limit per test 256 megabytes input standard ...
- 蓝色科技AE宣传片头光晕视频
蓝色科技AE宣传片头光晕视频素材,蓝色AE炫光素材,科技AE片头,精美,AE特效,绚丽,AE模板,视频素材,动画. 地址:http://www.huiyi8.com/xuanguang/ae/
- Stop logging "internal dummy connection" in Apache
Apache 2.x keeps child processes alive by creating internal connections which appear in the log file ...
- MySQL活动期间制定月份注册用户下单情况_20161029
在10.29到10.31号期间 10月新注册的用户订单金额满600元赠与优惠券 #3天内订单满600元且10月注册的用户订单明细 SELECT a.城市,a.用户ID,b.用户名称,DATE(b.注册 ...
- Chrome检查更新总失败？安装细则讲解
现在 Google Chrome 的稳定版都已经发布 68.0 版本了,我机上还是 54, 本想在线更新一下,结果点击菜单项中的“关于 Google Chrome”后,进入的界面提示“更新失败(错误: ...