rac重新启动遭遇ORA-01078、ORA-01565、ORA-17503、ORA-12547
今天測试环境server重新启动导致一个节点集群无法重新启动，遭遇ORA-12547错误。详细例如以下：
server重新启动后，rac1集群无法启动，rac2正常启动：
[root@rac1 ~]# ps -ef|grep ora
grid 3975 1 0 16:42 ?
00:00:00 /u01/grid11g/bin/oraagent.bin
root 3998 3692 0 16:42 pts/0 00:00:00 grep ora
[grid@rac2 ~]$ crs_stat -t
Name Type Target State Host
------------------------------------------------------------
ora.ARCH.dg ora....up.type ONLINE ONLINE rac2
ora.DATA.dg ora....up.type ONLINE ONLINE rac2
ora....ER.lsnr ora....er.type ONLINE ONLINE rac2
ora....N1.lsnr ora....er.type ONLINE ONLINE rac2
ora.OCR.dg ora....up.type ONLINE ONLINE rac2
ora.asm ora.asm.type ONLINE ONLINE rac2
ora.cvu ora.cvu.type ONLINE ONLINE rac2
ora.gsd ora.gsd.type OFFLINE OFFLINE
ora....network ora....rk.type ONLINE ONLINE rac2
ora.oc4j ora.oc4j.type ONLINE ONLINE rac2
ora.ons ora.ons.type ONLINE ONLINE rac2
ora.rac1.vip ora....t1.type ONLINE ONLINE rac2
ora....SM2.asm application ONLINE ONLINE rac2
ora....C2.lsnr application ONLINE ONLINE rac2
ora.rac2.gsd application OFFLINE OFFLINE
ora.rac2.ons application ONLINE ONLINE rac2
ora.rac2.vip ora....t1.type ONLINE ONLINE rac2
ora.racdb.db ora....se.type ONLINE ONLINE rac2
ora.scan1.vip ora....ip.type ONLINE ONLINE rac2
[oracle@rac1 ~]$ sqlplus / as sysdba
SQL*Plus: Release 11.2.0.3.0 Production on Tue Dec 16 16:47:58 2014
Copyright (c) 1982, 2011, Oracle. All rights reserved.
ERROR:
ORA-12547: TNS:lost contact
Enter user-name: exit
Enter password:
[oracle@rac1 ~]$
遭遇ORA-12547错误。一般为权限问题，发现集群文件夹权限变了。可能有人为错误导致：
[root@rac1 cdata]# cd /u01/
[root@rac1 u01]# ls -lhrt
total 40K
drwx------ 2 mongodb mongodb 16K Aug 14 2013 lost+found
drwxr-xr-x 8 mongodb mongodb 4.0K Aug 19 2013 grid_anzhuangbao
drwxr-xr-x 66 mongodb mongodb 4.0K Aug 20 2013 grid11g
drwxrwx--- 6 grid oinstall 4.0K Aug 20 2013 oraInventory
drwxr-xr-x 9 mongodb mongodb 4.0K Dec 25 2013 grid
drwxr-xr-x 5 mongodb mongodb 4.0K Jan 6 2014 mongodb
drwxr-xr-x 9 oracle oinstall 4.0K Nov 27 14:45 oracle
更改权限为合适的权限：
[root@rac1 u01]# chown grid:oinstall grid -R
[root@rac1 u01]# chown grid:oinstall grid11g -R
[root@rac1 u01]# ls -lhrt
total 40K
drwx------ 2 mongodb mongodb 16K Aug 14 2013 lost+found
drwxr-xr-x 8 mongodb mongodb 4.0K Aug 19 2013 grid_anzhuangbao
drwxr-xr-x 66 grid oinstall 4.0K Aug 20 2013 grid11g
drwxrwx--- 6 grid oinstall 4.0K Aug 20 2013 oraInventory
drwxr-xr-x 9 grid oinstall 4.0K Dec 25 2013 grid
drwxr-xr-x 5 mongodb mongodb 4.0K Jan 6 2014 mongodb
drwxr-xr-x 9 oracle oinstall 4.0K Nov 27 14:45 oracle
重新启动机器：
[root@rac1 u01]# reboot
集群起来。可是实例没有启动：
[oracle@rac1 ~]$ ps -ef|grep ora
grid 3699 1 0 17:03 ? 00:00:00 /u01/grid11g/bin/oraagent.bin
root 3845 1 0 17:03 ? 00:00:00 /u01/grid11g/bin/orarootagent.bin
grid 4017 1 0 17:03 ? 00:00:00 oracle+ASM1 (DESCRIPTION=(LOCAL=YES)(ADDRESS=(PROTOCOL=beq)))
grid 4032 1 0 17:03 ? 00:00:00 oracle+ASM1_ocr (DESCRIPTION=(LOCAL=YES)(ADDRESS=(PROTOCOL=beq)))
grid 4036 1 0 17:03 ?
00:00:00 oracle+ASM1_asmb_+asm1 (DESCRIPTION=(LOCAL=YES)(ADDRESS=(PROTOCOL=beq)))
grid 4040 1 0 17:03 ? 00:00:00 oracle+ASM1_o000_+asm1 (DESCRIPTION=(LOCAL=YES)(ADDRESS=(PROTOCOL=beq)))
grid 4160 1 0 17:04 ? 00:00:00 /u01/grid11g/bin/oraagent.bin
root 4164 1 0 17:04 ? 00:00:00 /u01/grid11g/bin/orarootagent.bin
grid 4210 1 0 17:04 ? 00:00:00 oracle+ASM1 (DESCRIPTION=(LOCAL=YES)(ADDRESS=(PROTOCOL=beq)))
grid 4212 1 0 17:04 ? 00:00:00 oracle+ASM1 (DESCRIPTION=(LOCAL=YES)(ADDRESS=(PROTOCOL=beq)))
grid 4214 1 0 17:04 ? 00:00:00 oracle+ASM1 (DESCRIPTION=(LOCAL=YES)(ADDRESS=(PROTOCOL=beq)))
root 4286 4052 0 17:04 pts/1 00:00:00 su - oracle
oracle 4287 4286 0 17:04 pts/1 00:00:00 -bash
oracle 4887 4287 0 17:05 pts/1 00:00:00 ps -ef
oracle 4888 4287 0 17:05 pts/1 00:00:00 grep ora
[grid@rac2 u01]$ crs_stat -t -v
Name Type R/RA F/FT Target State Host
----------------------------------------------------------------------
ora.ARCH.dg ora....up.type 0/5 0/ ONLINE ONLINE rac1
ora.DATA.dg ora....up.type 0/5 0/ ONLINE ONLINE rac1
ora....ER.lsnr ora....er.type 0/5 0/ ONLINE ONLINE rac1
ora....N1.lsnr ora....er.type 0/5 0/0 ONLINE ONLINE rac2
ora.OCR.dg ora....up.type 0/5 0/ ONLINE ONLINE rac1
ora.asm ora.asm.type 0/5 0/ ONLINE ONLINE rac1
ora.cvu ora.cvu.type 0/5 0/0 ONLINE ONLINE rac2
ora.gsd ora.gsd.type 0/5 0/ OFFLINE OFFLINE
ora....network ora....rk.type 0/5 0/ ONLINE ONLINE rac1
ora.oc4j ora.oc4j.type 0/1 0/2 ONLINE ONLINE rac2
ora.ons ora.ons.type 0/3 0/ ONLINE ONLINE rac1
ora....SM1.asm application 0/5 0/0 ONLINE ONLINE rac1
ora....C1.lsnr application 0/5 0/0 ONLINE ONLINE rac1
ora.rac1.gsd application 0/5 0/0 OFFLINE OFFLINE
ora.rac1.ons application 0/3 0/0 ONLINE ONLINE rac1
ora.rac1.vip ora....t1.type 0/0 0/0 ONLINE ONLINE rac1
ora....SM2.asm application 0/5 0/0 ONLINE ONLINE rac2
ora....C2.lsnr application 0/5 0/0 ONLINE ONLINE rac2
ora.rac2.gsd application 0/5 0/0 OFFLINE OFFLINE
ora.rac2.ons application 0/3 0/0 ONLINE ONLINE rac2
ora.rac2.vip ora....t1.type 0/0 0/0 ONLINE ONLINE rac2
ora.racdb.db ora....se.type 0/2 0/1 ONLINE ONLINE rac2
ora.scan1.vip ora....ip.type 0/0 0/0 ONLINE ONLINE rac2
手动登录数据库，依旧遭遇ORA-12547，某些文件权限可能依旧有问题：
[oracle@rac1 ~]$ sqlplus / as sysdba
SQL*Plus: Release 11.2.0.3.0 Production on Tue Dec 16 17:06:08 2014
Copyright (c) 1982, 2011, Oracle. All rights reserved.
ERROR:
ORA-12547: TNS:lost contact
Enter user-name: exit
Enter password:
[oracle@rac1 ~]$
[oracle@rac1 11g]$ cd /u01/
[oracle@rac1 u01]$ ls -lhrt
total 40K
drwx------ 2 mongodb mongodb 16K Aug 14 2013 lost+found
drwxr-xr-x 8 mongodb mongodb 4.0K Aug 19 2013 grid_anzhuangbao
drwxr-xr-x 66 grid oinstall 4.0K Aug 20 2013 grid11g
drwxrwx--- 6 grid oinstall 4.0K Aug 20 2013 oraInventory
drwxr-xr-x 9 grid oinstall 4.0K Dec 25 2013 grid
drwxr-xr-x 5 mongodb mongodb 4.0K Jan 6 2014 mongodb
drwxr-xr-x 9 oracle oinstall 4.0K Nov 27 14:45 oracle
[oracle@rac1 u01]$ cd oracle/
[oracle@rac1 oracle]$ ls -lrht
total 28K
drwxrwxr-x 11 mongodb mongodb 4.0K Aug 20 2013 diag
drwxr-xr-x 2 mongodb mongodb 4.0K Aug 20 2013 checkpoints
drwxr-x--- 3 oracle oinstall 4.0K Aug 20 2013 admin
drwxr-x--- 5 mongodb mongodb 4.0K Aug 20 2013 cfgtoollogs
drwxr-xr-x 73 mongodb mongodb 4.0K Nov 5 15:47 11g
drwxr-xr-x 2 mongodb mongodb 4.0K Nov 27 14:59 chtest
drwxr-xr-x 2 mongodb mongodb 4.0K Dec 15 18:45 expdp
ORACLE_HOME文件夹下文件权限有问题。更改权限：
[oracle@rac1 oracle]$ cd ..
[oracle@rac1 u01]$ chown oracle:oinstall -R oracle
重新启动server：
[root@rac1 u01]# reboot
[root@rac1 u01]# ps -ef|grep ora
grid 3674 1 0 17:13 ? 00:00:01 /u01/grid11g/bin/oraagent.bin
root 3956 1 0 17:13 ? 00:00:03 /u01/grid11g/bin/orarootagent.bin
grid 4139 1 0 17:14 ?
00:00:00 oracle+ASM1 (DESCRIPTION=(LOCAL=YES)(ADDRESS=(PROTOCOL=beq)))
grid 4321 1 0 17:14 ?
00:00:00 oracle+ASM1_ocr (DESCRIPTION=(LOCAL=YES)(ADDRESS=(PROTOCOL=beq)))
grid 4325 1 0 17:14 ?
00:00:00 oracle+ASM1_asmb_+asm1 (DESCRIPTION=(LOCAL=YES)(ADDRESS=(PROTOCOL=beq)))
grid 4434 1 0 17:14 ? 00:00:00 /u01/grid11g/bin/oraagent.bin
root 4441 1 0 17:14 ? 00:00:03 /u01/grid11g/bin/orarootagent.bin
grid 4482 1 0 17:14 ? 00:00:00 oracle+ASM1 (DESCRIPTION=(LOCAL=YES)(ADDRESS=(PROTOCOL=beq)))
grid 4487 1 0 17:14 ?
00:00:00 oracle+ASM1 (DESCRIPTION=(LOCAL=YES)(ADDRESS=(PROTOCOL=beq)))
grid 4498 1 0 17:14 ? 00:00:00 oracle+ASM1 (DESCRIPTION=(LOCAL=YES)(ADDRESS=(PROTOCOL=beq)))
root 5906 5595 0 17:24 pts/0 00:00:00 grep ora
奇怪。实例依旧无法重新启动，sqlplus 连接不再报12547，尝试启动实例。报错例如以下：
[oracle@rac1 ~]$ sqlplus / as sysdba
SQL*Plus: Release 11.2.0.3.0 Production on Tue Dec 16 17:48:12 2014
Copyright (c) 1982, 2011, Oracle. All rights reserved.
Connected to an idle instance.
SQL> startup nomount
ORA-01078: failure in processing system parameters
ORA-01565: error in identifying file '+DATA/RACDB/spfileRACDB.ora'
ORA-17503: ksfdopn:2 Failed to open file +DATA/RACDB/spfileRACDB.ora
ORA-12547: TNS:lost contact
SQL> exit
Disconnected
依据网上说，为$GRID_HOME/bin/oracle权限问题引起：
[grid@rac1 ~]$ cd /u01/grid11g/bin/
[grid@rac1 bin]$ ls -lhrt orac
ls: orac: No such file or directory
[grid@rac1 bin]$ ls -lhrt ora
ls: ora: No such file or directory
[grid@rac1 bin]$ pwd
/u01/grid11g/bin
[grid@rac1 bin]$ ls -lhrt oracle
-rwxr-x--x 1 grid oinstall 195M Aug 20 2013 oracle
[grid@rac1 bin]$ pwd
/u01/grid11g/bin
改动权限：
[grid@rac1 bin]$ chmod 6751 oracle
[grid@rac1 bin]$ ls -lhrt oracle
-rwsr-s--x 1 grid oinstall 195M Aug 20 2013 oracle
[grid@rac1 bin]$ exit
logout
[root@rac1 oracleasm]# su - oracle
[oracle@rac1 ~]$ exit
logout
[root@rac1 oracleasm]# su - grid
正常启动实例：
[grid@rac1 ~]$ srvctl start instance -d racdb -i RACDB1
[grid@rac1 ~]$
[grid@rac1 ~]$ crs_stat -t -v
Name Type R/RA F/FT Target State Host
----------------------------------------------------------------------
ora.ARCH.dg ora....up.type 0/5 0/ ONLINE ONLINE rac1
ora.DATA.dg ora....up.type 0/5 0/ ONLINE ONLINE rac1
ora....ER.lsnr ora....er.type 0/5 0/ ONLINE ONLINE rac1
ora....N1.lsnr ora....er.type 0/5 0/0 ONLINE ONLINE rac2
ora.OCR.dg ora....up.type 0/5 0/ ONLINE ONLINE rac1
ora.asm ora.asm.type 0/5 0/ ONLINE ONLINE rac1
ora.cvu ora.cvu.type 0/5 0/0 ONLINE ONLINE rac2
ora.gsd ora.gsd.type 0/5 0/ OFFLINE OFFLINE
ora....network ora....rk.type 0/5 0/ ONLINE ONLINE rac1
ora.oc4j ora.oc4j.type 0/1 0/2 ONLINE ONLINE rac2
ora.ons ora.ons.type 0/3 0/ ONLINE ONLINE rac1
ora....SM1.asm application 0/5 0/0 ONLINE ONLINE rac1
ora....C1.lsnr application 0/5 0/0 ONLINE ONLINE rac1
ora.rac1.gsd application 0/5 0/0 OFFLINE OFFLINE
ora.rac1.ons application 0/3 0/0 ONLINE ONLINE rac1
ora.rac1.vip ora....t1.type 0/0 0/0 ONLINE ONLINE rac1
ora....SM2.asm application 0/5 0/0 ONLINE ONLINE rac2
ora....C2.lsnr application 0/5 0/0 ONLINE ONLINE rac2
ora.rac2.gsd application 0/5 0/0 OFFLINE OFFLINE
ora.rac2.ons application 0/3 0/0 ONLINE ONLINE rac2
ora.rac2.vip ora....t1.type 0/0 0/0 ONLINE ONLINE rac2
ora.racdb.db ora....se.type 0/2 0/1 ONLINE ONLINE rac1
ora.scan1.vip ora....ip.type 0/0 0/0 ONLINE ONLINE rac2
[grid@rac1 ~]$ crsctl stat res -t
--------------------------------------------------------------------------------
NAME TARGET STATE SERVER STATE_DETAILS
--------------------------------------------------------------------------------
Local Resources
--------------------------------------------------------------------------------
ora.ARCH.dg
ONLINE ONLINE rac1
ONLINE ONLINE rac2
ora.DATA.dg
ONLINE ONLINE rac1
ONLINE ONLINE rac2
ora.LISTENER.lsnr
ONLINE ONLINE rac1
ONLINE ONLINE rac2
ora.OCR.dg
ONLINE ONLINE rac1
ONLINE ONLINE rac2
ora.asm
ONLINE ONLINE rac1 Started
ONLINE ONLINE rac2 Started
ora.gsd
OFFLINE OFFLINE rac1
OFFLINE OFFLINE rac2
ora.net1.network
ONLINE ONLINE rac1
ONLINE ONLINE rac2
ora.ons
ONLINE ONLINE rac1
ONLINE ONLINE rac2
--------------------------------------------------------------------------------
Cluster Resources
--------------------------------------------------------------------------------
ora.LISTENER_SCAN1.lsnr
1 ONLINE ONLINE rac2
ora.cvu
1 ONLINE ONLINE rac2
ora.oc4j
1 ONLINE ONLINE rac2
ora.rac1.vip
1 ONLINE ONLINE rac1
ora.rac2.vip
1 ONLINE ONLINE rac2
ora.racdb.db
1 ONLINE ONLINE rac1 Open
2 ONLINE ONLINE rac2 Open
ora.scan1.vip
1 ONLINE ONLINE rac2
[grid@rac1 ~]$
SQL> show parameter name
NAME TYPE VALUE
------------------------------------ ----------- ------------------------------
db_file_name_convert string
db_name string RACDB
db_unique_name string RACDB
global_names boolean FALSE
instance_name string RACDB1
lock_name_space string
log_file_name_convert string
processor_group_name string
service_names string RACDB
SQL> select open_mode from v$database;
OPEN_MODE
--------------------
READ WRITE
SQL>
rac重新启动遭遇ORA-01078、ORA-01565、ORA-17503、ORA-12547的更多相关文章
- 11gR2 RAC重新启动后仅仅能起单节点
11gR2 RAC重新启动后仅仅能起单节点 问题背景: 将11gR2 RAC正常部署完毕之后运行两节点重新启动操作发现当中有一个节点的集群资源无法启动,遂再次重新启动该无法启动集群资源的节点,还是不可 ...
- ORACLE 12.2 RAC TNS-12520 遭遇连接风爆 (connection storm)
故障现象:数据库迁移到新环境刚过两天.今天生产核心数,断断继续的告警连接不上.这是问题! 如理思路:1.查看alert日志,日志无报错 2.查看连接数,参数设置的20 ...
- ORACLE RAC 下非缺省端口监听配置(listener.ora tnsnames.ora)
不论是单实例还是RAC,对于非缺省端口下(1521)的监听器,pmon进程不会将service/instance注册到监听器,即不会实现动态注册.与单实例相同,RAC非缺省端口的监听器也是通过设置参数 ...
- Oracle的tnsnames.ora配置(PLSQL Developer)
首先打开tnsnames.ora的存放目录,一般为D:\app\Administrator\product\11.2.0\client_1\network\admin,就看安装具体位置了. 步骤阅读 ...
- 【练习】sqlnet.ora
在SQLNET.ora文件中设置以下参数可以实现IP访问限制: $ pwd/u01/app/oracle/product/10.2.0/db_1/network/admin$ vi sqlnet.or ...
- 转载《Oracle的tnsnames.ora配置(PLSQL Developer)》
源地址:https://www.cnblogs.com/qq3245792286/p/6212617.html. 首先打开tnsnames.ora的存放目录,一般为D:\app\Administrat ...
- CRS-2800: Cannot start resource 'ora.asm' as it is already in the INTERMEDIATE state on server ‘RAC02’
在安装ORACLE RAC的Grid Infrastructure时,在节点1运行/u01/app/11.2.0/grid/root.sh正常,当在节点2运行/u01/app/11.2.0/grid/ ...
- 【ORA】ORA-00371: not enough shared pool memory
今天rac中有一个节点asm实例起不来包了ora-000371的错误,错误贴在下面: [oracle@rac2 dbs]$ srvctl start asm -n rac2 PRKS-1009 : F ...
- oracle三个重要参数文件：pfile和spfile和init.ora
Oracle中的参数文件是一个包含一系列参数以及参数对应值的操作系统文件.它们是在数据库实例启动第一个阶段时候加载的, 决定了数据库的物理 结构.内存.数据库的限制及系统大量的默认值.数据库的各种物理 ...
随机推荐
- 肆、js的DOM模型
一.网页中的dom模型框架 1.dom中的3中节点:元素节点.文本节点.属性节点 a.元素节点:html中的各种标签就是各个元素节点,元素节点可以包含其他元素,只有html根节点例外. b.文本节点: ...
- mysql 将时间转换成时间戳
select UNIX_TIMESTAMP(addtime/*date_column*/) from tablename 输出:1548658912 数据库原格式:2019-01-28 15:01:2 ...
- [NOIP补坑计划]NOIP2014 题解&做题心得
六道普及组题,没啥好说的 场上预计得分:100+100+100+100+100+100=600(省一分数线490) (AK是不可能AK的,这辈子不可能AK的) 题解: D1T1 生活大爆炸版石头剪刀布 ...
- （WC2016模拟十八）Gangsters of Treeland
HINT: $1\leq N,Q\leq 10^5$ 原题:CodeChef November Challenge 2013 - MONOPLOY 题解: 其实这题是[SDOI2017]树点涂色的弱化 ...
- tinymce原装插件源码分析（四）-fullscreen
fullscreen 作为一款文本编辑器,全屏功能是非常有必要的.在插件中主要是修改一些css style和触发resize事件. style问题(反例): 见github源码:https://git ...
- vue-cli3+typescript+路由懒加载报错问题
vue-cli3的版本是3.4.1 出现的情况是网页显示正常,但是终端一直提示找不到模块: 如果去掉路由懒加载的方式,就没有报错: 原因是以前我们习惯直接写文件名而不加后缀, 现在使用ts时就需要写v ...
- 紫书 例题8-7 UVa 11572（滑动窗口）
滑动窗口这个方法名字非常形象, 先是窗口的右指针尽量往右滑, 滑不动了就滑窗口的左指针, 滑到右指针又可以开始滑动为止. 这道题是要记录滑的过程中最大的窗口长度, 限制条件是窗口中不能出现重复的值. ...
- gps 地图
http://www.cnblogs.com/sylvanas2012/p/5342530.html http://blog.csdn.net/ma969070578/article/details/ ...
- 3D拾取技术
在unity3d中用户通过触摸屏选中虚拟3D世界中的物体进行操控,就须要掌握3d 拾取技术. 3d拾取技术很的简单:由摄像机与屏幕上的触控点之间确定一条射线.由此射线射向3d世界, 最先和此射线相交的 ...
- 电源管理ACPI、及APM、GNU/Linux系统下的相应命令使用
/********************************************************************* * Author : Samson * Date ...