raid强制上线后数据库无法启动故障处理

惜分飞 2025-10-10 09:23:41 原文

联系：手机/微信(+86 13429648788) QQ(107644445)

标题：raid强制上线后数据库无法启动故障处理

作者：惜分飞版权所有[未经本人同意,不得以任何形式转载,否则有进一步追究法律责任的权利.]

由于raid掉盘过多,强制raid上线,然后启动数据库报以下错误

Mon Apr 19 23:19:28 2021

ALTER DATABASE OPEN

Beginning crash recovery of 1 threads

parallel recovery started with 15 processes

Started redo scan

Completed redo scan

read 106750 KB redo, 9080 data blocks need recovery

Mon Apr 19 23:19:45 2021

Slave exiting with ORA-1115 exception

Errors in file /u01/app/oracle/diag/rdbms/orcl/orcl/trace/orcl_p000_3277.trc:

ORA-01115: IO error reading block from file 9 (block # 339)

ORA-01110: data file 9: '/u01/app/oracle/oradata/orcl/dev02.dbf'

ORA-27072: File I/O error

Additional information: 4

Additional information: 326

Additional information: 24576

ORA-27072: File I/O error

Additional information: 4

Additional information: 326

Additional information: 24576

ORA-27072: File I/O error

Additional information: 4

Additional information: 326

Additional information: 24576

ORA-27072: File I/O error

Additional information: 4

Additional information: 326

Additional information: 24576

ORA-27072: File I/O error

Additional information: 4

Additional information: 326

Additional information: 24576

ORA-27072: File I/O error

Additional information: 4

Additional information: 326

Additional information: 24576

ORA-27072: File I/O error

Additional information: 4

Additional information: 326

Additional information: 24576

ORA-27072: File I/O error

Additional information: 4

Additional information: 326

Additional information: 24576

ORA-27072: File I

Mon Apr 19 23:19:45 2021

Aborting crash recovery due to slave death, attempting serial crash recovery

Beginning crash recovery of 1 threads

Started redo scan

Completed redo scan

read 106750 KB redo, 9080 data blocks need recovery

Aborting crash recovery due to error 1115

Errors in file /u01/app/oracle/diag/rdbms/orcl/orcl/trace/orcl_ora_3275.trc:

ORA-01115: IO error reading block from file 9 (block # 329)

ORA-01110: data file 9: '/u01/app/oracle/oradata/orcl/dev02.dbf'

ORA-1115 signalled during: ALTER DATABASE OPEN...

错误提示比较明显IO error,结合客户强行上线raid的操作,比较明显是由于底层io问题导致该错误,直接对此文件dbv检查

[oracle@database orcl]$ dbv file=dev02.dbf

DBVERIFY: Release 11.2.0.4.0 - Production on Mon Apr 19 23:59:03 2021

Copyright (c) 1982, 2011, Oracle and/or its affiliates. All rights reserved.

DBVERIFY - Verification starting : FILE = /u01/app/oracle/oradata/orcl/dev02.dbf

DBV-00600: Fatal Error - [28] [27061] [0] [0]

对于此类情况,通过工具进行处理

DUL> copy file from /u01/app/oracle/oradata/orcl/dev02.dbf to /oradata/dev02.dbf

starting copy datafile '/u01/app/oracle/oradata/orcl/dev02.dbf' to '/oradata/dev02.dbf'

read data error from file '/u01/app/oracle/oradata/orcl/dev02.dbf'.error message:Input/output error

read block# error: 303

read data error from file '/u01/app/oracle/oradata/orcl/dev02.dbf'.error message:Input/output error

read block# error: 304

read data error from file '/u01/app/oracle/oradata/orcl/dev02.dbf'.error message:Input/output error

read block# error: 329

datafile copy completed with 2 block error.

dbv校验文件

[oracle@database oradata]$ dbv file=dev02.dbf

DBVERIFY: Release 11.2.0.4.0 - Production on Tue Apr 20 00:28:31 2021

Copyright (c) 1982, 2011, Oracle and/or its affiliates. All rights reserved.

DBVERIFY - Verification starting : FILE = /oradata/dev02.dbf

Page 303 is marked corrupt

Corrupt block relative dba: 0x0240012f (file 9, block 303)

Completely zero block found during dbv:

Page 304 is marked corrupt

Corrupt block relative dba: 0x02400130 (file 9, block 304)

Completely zero block found during dbv:

Page 329 is marked corrupt

Corrupt block relative dba: 0x02400149 (file 9, block 329)

Completely zero block found during dbv:

DBVERIFY - Verification complete

Total Pages Examined : 3932160

Total Pages Processed (Data) : 3213723

Total Pages Failing (Data) : 0

Total Pages Processed (Index): 714294

Total Pages Failing (Index): 0

Total Pages Processed (Other): 4139

Total Pages Processed (Seg) : 0

Total Pages Failing (Seg) : 0

Total Pages Empty : 1

Total Pages Marked Corrupt : 3

Total Pages Influx : 0

Total Pages Encrypted : 0

Highest block SCN : 85078875 (6.85078875)

通过对io error的文件进行处理,最终损坏三个block,最大限度抢救数据.使用被恢复出来的文件,尝试open库遭遇以下错误

SQL> alter database open resetlogs;

alter database open resetlogs

*

ERROR at line 1:

ORA-00603: ORACLE server session terminated by fatal error

ORA-00600: internal error code, arguments: [2662], [6], [85035771], [6],

[85084136], [12583040], [], [], [], [], [], []

ORA-00600: internal error code, arguments: [2662], [6], [85035770], [6],

[85084136], [12583040], [], [], [], [], [], []

ORA-01092: ORACLE instance terminated. Disconnection forced

ORA-00600: internal error code, arguments: [2662], [6], [85035764], [6],

[85084136], [12583040], [], [], [], [], [], []

Process ID: 6733

Session ID: 570 Serial number: 3

ora-600 2662这个错误比较明显,处理文件头scn,继续open库

SQL> alter database open ;

alter database open

*

ERROR at line 1:

ORA-03113: end-of-file on communication channel

Process ID: 6840

Session ID: 570 Serial number: 3

查看alert日志信息

Tue Apr 20 01:22:27 2021

alter database open upgrade

Beginning crash recovery of 1 threads

parallel recovery started with 15 processes

Started redo scan

Completed redo scan

read 1 KB redo, 3 data blocks need recovery

Started redo application at

Thread 1: logseq 1, block 3

Recovery of Online Redo Log: Thread 1 Group 1 Seq 1 Reading mem 0

Mem# 0: /u01/app/oracle/oradata/orcl/redo01.log

Completed redo application of 0.00MB

Completed crash recovery at

Thread 1: logseq 1, block 5, scn 25854859541

3 data blocks read, 3 data blocks written, 1 redo k-bytes read

Tue Apr 20 01:22:28 2021

Thread 1 advanced to log sequence 2 (thread open)

Thread 1 opened at log sequence 2

Current log# 2 seq# 2 mem# 0: /u01/app/oracle/oradata/orcl/redo02.log

Successful open of redo thread 1

MTTR advisory is disabled because FAST_START_MTTR_TARGET is not set

Tue Apr 20 01:22:28 2021

SMON: enabling cache recovery

[6840] Successfully onlined Undo Tablespace 2.

Undo initialization finished serial:0 start:5902014 end:5905574 diff:3560 (35 seconds)

Dictionary check beginning

Dictionary check complete

Verifying file header compatibility for 11g tablespace encryption..

Verifying 11g file header compatibility for tablespace encryption completed

SMON: enabling tx recovery

Database Characterset is ZHS16GBK

Errors in file /u01/app/oracle/diag/rdbms/orcl/orcl/trace/orcl_smon_6824.trc (incident=63970):

ORA-00600: internal error code, arguments: [6006], [1], [], [], [], [], [], [], [], [], [], []

Incident details in: /u01/app/oracle/diag/rdbms/orcl/orcl/incident/incdir_63970/orcl_smon_6824_i63970.trc

Use ADRCI or Support Workbench to package the incident.

See Note 411.1 at My Oracle Support for error and packaging details.

ORACLE Instance orcl (pid = 14) - Error 600 encountered while recovering transaction (24, 2) on object 89023.

Errors in file /u01/app/oracle/diag/rdbms/orcl/orcl/trace/orcl_smon_6824.trc:

ORA-00600: internal error code, arguments: [6006], [1], [], [], [], [], [], [], [], [], [], []

Tue Apr 20 01:22:38 2021

ORACLE Instance orcl (pid = 14) - Error 600 encountered while recovering transaction (63, 3) on object 89023.

Errors in file /u01/app/oracle/diag/rdbms/orcl/orcl/trace/orcl_smon_6824.trc:

ORA-00600: internal error code, arguments: [6006], [1], [], [], [], [], [], [], [], [], [], []

Errors in file /u01/app/oracle/diag/rdbms/orcl/orcl/trace/orcl_smon_6824.trc (incident=63974):

ORA-00600: internal error code, arguments: [6006], [1], [], [], [], [], [], [], [], [], [], []

Incident details in: /u01/app/oracle/diag/rdbms/orcl/orcl/incident/incdir_63974/orcl_smon_6824_i63974.trc

Tue Apr 20 01:22:55 2021

PMON (ospid: 6798): terminating the instance due to error 474

这个错误是比较常见的错误,参考:ORACLE Instance XFF (pid = 18) – Error 600 encountered while recovering transaction ，通过处理之后,数据库open成功

SQL> startup mount pfile='/tmp/pfile';

ORACLE instance started.

Total System Global Area 1603411968 bytes

Fixed Size 2253664 bytes

Variable Size 1023413408 bytes

Database Buffers 570425344 bytes

Redo Buffers 7319552 bytes

Database mounted.

SQL> recover database;

Media recovery complete.

SQL> alter database open;

Database altered.

后续安排逻辑导出,导入新库

raid强制上线后数据库无法启动故障处理的更多相关文章

Oracle误删表空间文件后数据库无法启动
[问题描述]Oracle误删表空间文件后数据库无法启动,报错表空间文件不存在 [解决办法]sqlplus / as sysdba #以dba身份登陆数据库shutdown immediat ...
oracle修改字符集后数据库不能启动
最近在做修改字符集的实验,悲剧的是修改后重启,数据库启动不了. SQL> alter system set nls_language='AMERICAN' scope = spfile; S ...
10g异机恢复后EM无法启动故障处理一例
之前在自己的測试环境上做了个异机恢复,原来的库上是配置过EM的,可是在恢复的库上去启动EM就报错了.以下看详细解决过程: PS:原主机名为zlm,恢复出来的主机名为bak [root@bak ~]# ...
删除undotbs后,数据库无法启动
SQL> archive log list;Database log mode No Archive ModeAutomatic archival ...
Oracle常用命令13（数据库的启动、关闭）
数据库的启动.关闭数据库的启动:安装启动.非安装启动.共享启动.独占启动.约束启动.强制启动 --不登陆的方式进入 Sqlplus /nolog 安装启动: Startup {pfile=<f ...
深刻理解Oracle数据库的启动和关闭 .
Oracle数据库提供了几种不同的数据库启动和关闭方式,本文将详细介绍这些启动和关闭方式之间的区别以及它们各自不同的功能. 一.启动和关闭Oracle数据库对于大多数Oracle DBA来说,启动和 ...
Oracle数据库的启动和关闭
深刻理解Oracle数据库的启动和关闭 Oracle数据库提供了几种不同的数据库启动和关闭方式,本文将详细介绍这些启动和关闭方式之间的区别以及它们各自不同的功能. 一.启动和关闭Oracle数据库对 ...
oracle_深刻理解数据库的启动和关闭
Oracle数据库提供了几种不同的数据库启动和关闭方式,本文将详细介绍这些启动和关闭方式之间的区别以及它们各自不同的功能. 一.启动和关闭Oracle数据库对于大多数Oracle DBA来说,启动和 ...
raid5两块硬盘离线怎么办? 强制上线失败如何恢复数据
服务器故障描述: 客户使用Dell 2850服务器组建了raid5磁盘阵列,阵列中包含有6块硬盘(SCSI硬盘,单盘容量300G),服务器操作系统为linux Redhat4:文件系统为ext3文件系 ...
Oracle日常运维操作总结-数据库的启动和关闭
下面是工作中对Oracle日常管理操作的一些总结,都是一些基本的oracle操作和SQL语句写法,在此梳理成手册,希望能帮助到初学者(如有梳理不准确之处,希望指出). 一.数据库的启动和关闭 1.1 ...

随机推荐

【iPaaS &ESB】论企业在数据集成的抉择
随着信息化时代的到来,企业在发展过程中引入了众多且不协同的应用.系统和软件,每个系统都有着独立的信息,渐渐地出现数据信息不协同.数据集成异构的现象.因此企业对于数据的处理和分析需求也越来越多元及个性化 ...
golang多协程并发工作示例
golang多协程并发工作 package main import ( "fmt" "log" "os" "sync" ...
「CSP-2023 游记」落叶随风将要去何方，只留给天空美丽一场。
落叶随风将要去何方, 只留给天空美丽一场. 曾飞舞的声音, 像天使的翅膀. $\ \ \ \ \ \ \ \ \ \ $--<天使的翅膀> \(\tt{Day}\) \(-1\) 像往常一 ...
深度揭秘：我们如何用Prompt工程“训练”AI，从0到1成为顶尖UI设计师？
你是否想过,在AI飞速发展的今天,我们离"一句话生成一个APP"的未来还有多远? 不久前,我用一段精心构造的提示词,就让AI为我生成了一整套设计精良.风格现代的记账APP UI方案 ...
MyEMS开源能源管理系统核心代码解读026
本期解读: Modbus数据字节翻转算法:myems-modbus-tcp/byte_swap.py 源代码链接:https://gitee.com/myems/myems/blob/master/m ...
windows下安装redis7
一.下载地址:https://github.com/zkteco-home/redis-windows 二.解压到电脑指定目录并注册为服务管理员方式打开cmd,进入到解压到的目录,执行redis-s ...
vue-ref、js获取dom子元素
querySelector的参数是css选择器,任何选择器都可以作为它的参数,这样就使得它非常方便灵活: 比如获取class='test'的标签下的第一个子元素,可以这样写querySelector( ...
洛谷 P3650 [USACO1.3] 滑雪课程设计 Ski Course Design 题解
题意概述给定一个长度为 \(n\) 的数列 \(\{a_i\}_{i=1}^n\),将 \(a_i\) 改为 \(b\) 所需的代价是 \((a_i-b)^2\).求使得 \(\max\{a_i\} ...
[WPF] 使用 MVVM Toolkit 构建 MVVM 程序(CommunityToolkit.Mvvm)
1. 什么是 MVVM Toolkit 模型-视图-视图模型 (MVVM) 是用于解耦 UI 代码和非 UI 代码的 UI 体系结构设计模式. 借助 MVVM,可以在 XAML 中以声明方式定义 UI ...
【转】SQL 中 Drop、Delete 与 Truncate 的区别
删除表中的数据的方法有delete,truncate, 其中TRUNCATE TABLE用于删除表中的所有行,而不记录单个行删除操作.TRUNCATE TABLE 与没有 WHERE 子句的 DELE ...