12C RAC 故障分析 - ORA-17503: ksfdopn:2 Failed to open file +DATA/EIC1/PASSWORD/pwdeic1.256.957086685
一、故障描述
Oracle 12C PDBS（PDB NAME = WRYPC） 在note1节点上是MOUNTED状态，在note2节点上是READ WRITE状态。note1节点上启动该PDB长时间无反应hang住，并且伴有日志报错。
//note1
SQL> select DBID,NAME,LOG_MODE,OPEN_MODE from v$database; DBID NAME LOG_MODE OPEN_MODE
---------- --------- ------------ --------------------
2140168445 EIC1 ARCHIVELOG READ WRITE SQL> select instance_name,status from v$instance; INSTANCE_NAME STATUS
---------------- ------------
eic12 OPEN SQL> select DBID,NAME,LOG_MODE,OPEN_MODE from v$database; DBID NAME LOG_MODE OPEN_MODE
---------- --------- ------------ --------------------
2140168445 EIC1 ARCHIVELOG READ WRITE SQL> select con_id,dbid,guid,name,open_mode from v$pdbs; CON_ID DBID GUID NAME OPEN_MODE
---------- ---------- -------------------------------- --------------------------------- ----------
2 3257667166 5B3C58220E311678E0532CF2640A4165 PDB$SEED READ ONLY
3 2473517642 5B3C7CE162C953F6E0532CF2640A910E EIC1PDB READ WRITE
4 1620899158 6A1F75EB99FE3131E0532DF2640A95C0 PDB_NAME READ WRITE
5 493040432 6A1F75EB9A003131E0532DF2640A95C0 ERWUPU MOUNTED
6 2865274021 6A224E09130541B9E0532DF2640AAE5F EWP2 MOUNTED
7 2198790855 6B3463863B9C1D6BE0532DF2640A61C5 ODS READ WRITE
8 2689821097 703D1085A55C3376E0532DF2640A8A3E EWPSHIDIANSHENG MOUNTED
9 1167482729 703DEDEFF33FDE66E0532DF2640A8E9F EWPSHIDIANGJ MOUNTED
10 1008500739 711B1C42A2F34FA9E0532DF2640AC62B ERWUPUMAP MOUNTED
11 148782956 A401C78AC106DC34E0532DF2640A8AA5 WRYPC READ WRITE
12 1161538067 75BEA3722224E4DAE0532CF2640AD0F6 ERWUPUMAP_XJ MOUNTED
13 1728756282 75BD0918B56DB368E0532CF2640A9170 WRYPCNEI2018W MOUNTED
14 1579638091 75BEE5B84C9E23A3E0532CF2640A7E2E ERWUPUMAP_XZ MOUNTED
15 2065390671 75BF0ECA028E34A4E0532CF2640AFFC3 ERWUPUMAP_BT MOUNTED
16 493305058 75C309E9051CCE0CE0532CF2640ABF80 WRYPCNEI2018Z MOUNTED
17 222405979 75CD5BD04A3846F9E0532CF2640AAE77 WRYPCWAI54W MOUNTED
18 855842903 75CDC85DE82DB0CCE0532CF2640ABD02 WRYPCWAI54Z MOUNTED
19 727403284 75CE11270B33EE13E0532CF2640ADC8A WRYPCWAI65W MOUNTED
20 1858334523 75CE387EA16712E1E0532CF2640AE409 WRYPCNEI65Z MOUNTED
21 2081645259 75CE6B8F25483504E0532CF2640AC72A WRYPCNEI66Z MOUNTED
22 3702096573 78057D27A412F5BEE0532CF2640A3B24 HLWZWFWPT READ WRITE
23 4268531149 7805BC8E63A35B78E0532CF2640A3FFA HLWZWFWPTER READ WRITE
24 331720291 7841DABFA10E7C55E0532CF2640AC927 EGOVA READ WRITE
25 744750214 78CE617BF1D4F540E0532CF2640AF51E HJXXYZT READ WRITE
26 1668454202 78421DAF6EF3D301E0532CF2640AB57D STHJXXYZT READ WRITE
27 3378782880 796DCEB39C43282FE0532CF2640A26C7 IWHEREORCL READ WRITE
28 3623836438 7C2FEDCF7B4291E1E0532CF2640A4072 ODSTEST READ WRITE
29 3912941240 7CE2F2FE4E47514DE0532CF2640A5754 ESERVICE READ WRITE
30 3016044583 A6874758312BDF72E0532CF2640A2F9F DECWRYPC READ WRITE 29 rows selected. SQL> //note2
SQL> set linesize 200
SQL> select DBID,NAME,LOG_MODE,OPEN_MODE from v$database; DBID NAME LOG_MODE OPEN_MODE
---------- --------- ------------ --------------------
2140168445 EIC1 ARCHIVELOG READ WRITE SQL> select con_id,dbid,guid,name,open_mode from v$pdbs; CON_ID DBID GUID NAME OPEN_MODE
---------- ---------- -------------------------------- -------------------------------------------------- --------------------
2 3257667166 5B3C58220E311678E0532CF2640A4165 PDB$SEED READ ONLY
3 2473517642 5B3C7CE162C953F6E0532CF2640A910E EIC1PDB READ WRITE
4 1620899158 6A1F75EB99FE3131E0532DF2640A95C0 PDB_NAME READ WRITE
5 493040432 6A1F75EB9A003131E0532DF2640A95C0 ERWUPU MOUNTED
6 2865274021 6A224E09130541B9E0532DF2640AAE5F EWP2 MOUNTED
7 2198790855 6B3463863B9C1D6BE0532DF2640A61C5 ODS READ WRITE
8 2689821097 703D1085A55C3376E0532DF2640A8A3E EWPSHIDIANSHENG MOUNTED
9 1167482729 703DEDEFF33FDE66E0532DF2640A8E9F EWPSHIDIANGJ MOUNTED
10 1008500739 711B1C42A2F34FA9E0532DF2640AC62B ERWUPUMAP MOUNTED
11 148782956 A401C78AC106DC34E0532DF2640A8AA5 WRYPC MOUNTED
12 1161538067 75BEA3722224E4DAE0532CF2640AD0F6 ERWUPUMAP_XJ MOUNTED CON_ID DBID GUID NAME OPEN_MODE
---------- ---------- -------------------------------- -------------------------------------------------- --------------------
13 1728756282 75BD0918B56DB368E0532CF2640A9170 WRYPCNEI2018W MOUNTED
14 1579638091 75BEE5B84C9E23A3E0532CF2640A7E2E ERWUPUMAP_XZ MOUNTED
15 2065390671 75BF0ECA028E34A4E0532CF2640AFFC3 ERWUPUMAP_BT MOUNTED
16 493305058 75C309E9051CCE0CE0532CF2640ABF80 WRYPCNEI2018Z MOUNTED
17 222405979 75CD5BD04A3846F9E0532CF2640AAE77 WRYPCWAI54W MOUNTED
18 855842903 75CDC85DE82DB0CCE0532CF2640ABD02 WRYPCWAI54Z MOUNTED
19 727403284 75CE11270B33EE13E0532CF2640ADC8A WRYPCWAI65W MOUNTED
20 1858334523 75CE387EA16712E1E0532CF2640AE409 WRYPCNEI65Z MOUNTED
21 2081645259 75CE6B8F25483504E0532CF2640AC72A WRYPCNEI66Z MOUNTED
22 3702096573 78057D27A412F5BEE0532CF2640A3B24 HLWZWFWPT READ WRITE
23 4268531149 7805BC8E63A35B78E0532CF2640A3FFA HLWZWFWPTER READ WRITE CON_ID DBID GUID NAME OPEN_MODE
---------- ---------- -------------------------------- -------------------------------------------------- --------------------
24 331720291 7841DABFA10E7C55E0532CF2640AC927 EGOVA READ WRITE
25 744750214 78CE617BF1D4F540E0532CF2640AF51E HJXXYZT READ WRITE
26 1668454202 78421DAF6EF3D301E0532CF2640AB57D STHJXXYZT READ WRITE
27 3378782880 796DCEB39C43282FE0532CF2640A26C7 IWHEREORCL READ WRITE
28 3623836438 7C2FEDCF7B4291E1E0532CF2640A4072 ODSTEST READ WRITE
29 3912941240 7CE2F2FE4E47514DE0532CF2640A5754 ESERVICE READ WRITE
30 3016044583 A6874758312BDF72E0532CF2640A2F9F DECWRYPC READ WRITE 29 rows selected. SQL> SQL> alter pluggable database WRYPC open;
^C alter pluggable database WRYPC open
*
ERROR at line 1:
ORA-12152: TNS:unable to send break message // alert_eic11.log
--日志报错
2020-11-23T12:44:29.311665+08:00
alter pluggable database WRYPC open
2020-11-23T12:44:29.490214+08:00
WRYPC(11):Recovering pdb: pdbid=11
WRYPC(11):JIT: pid 192727 requesting stop
2020-11-23T12:46:37.858454+08:00
DBRM (ospid: 58076) waits for event 'latch: shared pool' for 18 secs.
DBRM (ospid: 58076) waits for latch 'shared pool' for 18 secs.
2020-11-23T12:46:49.379038+08:00
Errors in file /u01/app/oracle/diag/rdbms/eic1/eic11/trace/eic11_lmhb_58243.trc (incident=2049040) (PDBNAME=C
DB$ROOT):
ORA-29771: process USER (OSID 192727) blocks DBRM (OSID 58076) for more than 70 seconds
Incident details in: /u01/app/oracle/diag/rdbms/eic1/eic11/incident/incdir_2049040/eic11_lmhb_58243_i2049040.t
rc
2020-11-23T12:46:58.068303+08:00
USER (ospid: 192727) is blocking DBRM (ospid: 58076) in a wait
LMHB (ospid: 58243) kills USER (ospid: 192727).
Please check LMHB trace file for more detail.
2020-11-23T12:47:01.204284+08:00 // alert_eic11.log
--多次出现的错误
2020-11-23T05:49:10.563954+08:00
Errors in file /u01/app/oracle/diag/rdbms/eic1/eic11/trace/eic11_ora_186547.trc:
ORA-17503: ksfdopn:2 Failed to open file +DATA/EIC1/PASSWORD/pwdeic1.256.957086685
ORA-27300: OS system dependent operation:open failed with status: 13
ORA-27301: OS failure message: Permission denied
ORA-27302: failure occurred at: sskgmsmr_7
2020-11-23T05:49:10.608316+08:00
Errors in file /u01/app/oracle/diag/rdbms/eic1/eic11/trace/eic11_ora_186547.trc:
ORA-17503: ksfdopn:2 Failed to open file +DATA/EIC1/PASSWORD/pwdeic1.256.957086685
ORA-27300: OS system dependent operation:open failed with status: 13
ORA-27301: OS failure message: Permission denied
ORA-27302: failure occurred at: sskgmsmr_7
故障代码
软件配置
Red Hat Enterprise Linux Server release 6.9 (Santiago)
Oracle Database 12c Enterprise Edition Release 12.2.0.1.0 - 64bit Production
10.100.242.44 eicdb1
10.100.242.45 eicdb2
10.100.242.61 eicdb1-vip
10.100.242.62 eicdb2-vip
10.10.10.44 eicdb1-pri
10.10.10.45 eicdb2-pri
10.100.242.63 eicdb-scan
configuration
二、定位问题
1.关键性报错（错误）
2020-11-23T05:49:10.563954+08:00
Errors in file /u01/app/oracle/diag/rdbms/eic1/eic11/trace/eic11_ora_186547.trc:
ORA-17503: ksfdopn:2 Failed to open file +DATA/EIC1/PASSWORD/pwdeic1.256.957086685
ORA-27300: OS system dependent operation:open failed with status: 13
ORA-27301: OS failure message: Permission denied
ORA-27302: failure occurred at: sskgmsmr_7
2.从trace文件中寻找更有价值的信息
Trace file /u01/app/oracle/diag/rdbms/eic1/eic11/trace/eic11_ora_186547.trc
Oracle Database 12c Enterprise Edition Release 12.2.0.1.0 - 64bit Production
Build label: RDBMS_12.2.0.1.0_LINUX.X64_170125
ORACLE_HOME: /u01/app/oracle/product/12.2.0/db_1
System name: Linux
Node name: eicdb1
Release: 4.1.12-61.1.28.el6uek.x86_64
Version: #2 SMP Thu Feb 23 20:03:53 PST 2017
Machine: x86_64
Instance name: eic11
Redo thread mounted by this instance: 1
Oracle process number: 193
Unix process pid: 186547, image: oracle@eicdb1 (TNS V1-V3) *** 2020-11-23T05:49:10.528101+08:00 (CDB$ROOT(1))
*** SESSION ID:(44.52374) 2020-11-23T05:49:10.528221+08:00
*** CLIENT ID:() 2020-11-23T05:49:10.528244+08:00
*** SERVICE NAME:(SYS$USERS) 2020-11-23T05:49:10.528264+08:00
*** MODULE NAME:(eefprocess@eicdb1 (TNS V1-V3)) 2020-11-23T05:49:10.528285+08:00
*** ACTION NAME:() 2020-11-23T05:49:10.528311+08:00
*** CLIENT DRIVER:() 2020-11-23T05:49:10.528328+08:00
*** CONTAINER ID:(1) 2020-11-23T05:49:10.528348+08:00 SUCCESS: retrieved DB password file location:+DATA/EIC1/PASSWORD/pwdeic1.256.957086685
2020-11-23 05:49:10.546 : [ GPNP][ GPNP]clsgpnpkwf_initwfloc: [at clsgpnpkwf.c:496] Result: (7) CLSGPNP_IO. (:GPNP01002:)Fatal: Cannot open neither PEER nor PRDR GPnP wallet. No more wallets to verify GPnP configuration (profile). Check GPnP configuration: wallet(s) either missing or do not have access privileges. statres: -8, Wallet home: /u01/12.2.0/grid/gpnp/eicdb1/wallets/
2020-11-23 05:49:10.546 : [ GPNP][ GPNP]clsgpnpkwf_initwfloc: [at clsgpnpkwf.c:517] Result: (66) CLSGPNP_WALLET_NONE. (:GPNP01003:)Failed to find peer wallet dir in either OCR_CRS_HOME, or ORACLE_HOME locations.
2020-11-23 05:49:10.546 : [ GPNP][ GPNP]clsgpnp_InitCKProviders: [at clsgpnp0.c:5225] Result: (66) CLSGPNP_WALLET_NONE. (:GPNP00254:)Error initializing gpnp security key provider: file wallet (LSKP-FSW).
2020-11-23 05:49:10.551 : [ GPNP][ GPNP]clsgpnp_getCK: [at clsgpnp0.c:2879] (:GPNP00233:)Fatal error: failed to get local gpnp security keys (wallet). Gpnp profiles cannot be verified. ***LOCAL GPNP SETUP INVALID***.>
2020-11-23 05:49:10.551 : [ GPNP][ GPNP]clsgpnp_InitIdSetCtxCK: [at clsgpnp0.c:5612] Result: (66) CLSGPNP_WALLET_NONE. (:GPNP00267:)Cannot get stored certkey for id=1
2020-11-23 05:49:10.551 : [ GPNP][ GPNP]clsgpnp_Init: [at clsgpnp0.c:1063] Result: (66) CLSGPNP_WALLET_NONE. (:GPNP00211:)Error getting certkeys.
2020-11-23 05:49:10.551 : [ GPNP][ GPNP]clsgpnp_Init init failed. Error: CLSGPNP_ERR (1) .
2020-11-23 05:49:10.553 : [ default][ default](:CLSUG0001:)Failed to initialize clsgpnp context grv CLSGPNP_ERR (1). Return GPNP [12]
2020-11-23 05:49:10.553 : [ GPNP][ GPNP][at clsgpnp_dbms.c:263] (:GPNPD01786:)Failed to get gpnp global profile. Returned: GPNP (12)
ORA-17503: ksfdopn:2 Failed to open file +DATA/EIC1/PASSWORD/pwdeic1.256.957086685
ORA-27300: OS system dependent operation:open failed with status: 13
ORA-27301: OS failure message: Permission denied
ORA-27302: failure occurred at: sskgmsmr_7
SUCCESS: retrieved DB password file location:+DATA/EIC1/PASSWORD/pwdeic1.256.957086685
2020-11-23 05:49:10.595 : [ GPNP][ GPNP]clsgpnpkwf_initwfloc: [at clsgpnpkwf.c:496] Result: (7) CLSGPNP_IO. (:GPNP01002:)Fatal: Cannot open neither PEER nor PRDR GPnP wallet. No more wallets to verify GPnP configuration (profile). Check GPnP configuration: wallet(s) either missing or do not have access privileges. statres: -8, Wallet home: /u01/12.2.0/grid/gpnp/eicdb1/wallets/
2020-11-23 05:49:10.595 : [ GPNP][ GPNP]clsgpnpkwf_initwfloc: [at clsgpnpkwf.c:517] Result: (66) CLSGPNP_WALLET_NONE. (:GPNP01003:)Failed to find peer wallet dir in either OCR_CRS_HOME, or ORACLE_HOME locations.
2020-11-23 05:49:10.595 : [ GPNP][ GPNP]clsgpnp_InitCKProviders: [at clsgpnp0.c:5225] Result: (66) CLSGPNP_WALLET_NONE. (:GPNP00254:)Error initializing gpnp security key provider: file wallet (LSKP-FSW).
2020-11-23 05:49:10.598 : [ GPNP][ GPNP]clsgpnp_getCK: [at clsgpnp0.c:2879] (:GPNP00233:)Fatal error: failed to get local gpnp security keys (wallet). Gpnp profiles cannot be verified. ***LOCAL GPNP SETUP INVALID***.>
2020-11-23 05:49:10.598 : [ GPNP][ GPNP]clsgpnp_InitIdSetCtxCK: [at clsgpnp0.c:5612] Result: (66) CLSGPNP_WALLET_NONE. (:GPNP00267:)Cannot get stored certkey for id=1
2020-11-23 05:49:10.598 : [ GPNP][ GPNP]clsgpnp_Init: [at clsgpnp0.c:1063] Result: (66) CLSGPNP_WALLET_NONE. (:GPNP00211:)Error getting certkeys.
2020-11-23 05:49:10.598 : [ GPNP][ GPNP]clsgpnp_Init init failed. Error: CLSGPNP_ERR (1) .
2020-11-23 05:49:10.600 : [ GPNP][ GPNP](:CLSUG0001:)Failed to initialize clsgpnp context grv CLSGPNP_ERR (1). Return GPNP [12]
2020-11-23 05:49:10.600 : [ GPNP][ GPNP][at clsgpnp_dbms.c:263] (:GPNPD01786:)Failed to get gpnp global profile. Returned: GPNP (12)
ORA-17503: ksfdopn:2 Failed to open file +DATA/EIC1/PASSWORD/pwdeic1.256.957086685
ORA-27300: OS system dependent operation:open failed with status: 13
ORA-27301: OS failure message: Permission denied
ORA-27302: failure occurred at: sskgmsmr_7
trace file
trace文件【eic11_ora_186547.trc】初步定位问题点：
2020-11-23 05:49:10.546 : [ GPNP][ GPNP]clsgpnpkwf_initwfloc: [at clsgpnpkwf.c:496] Result: (7) CLSGPNP_IO. (:GPNP01002:)Fatal: Cannot open neither PEER nor PRDR GPnP wallet. No more wallets to verify GPnP configuration (profile). Check GPnP configuration: wallet(s) either missing or do not have access privileges. statres: -8, Wallet home: /u01/12.2.0/grid/gpnp/eicdb1/wallets/
检查Wallet home文件：
//note1
[oracle@eicdb1 ~]$ ls -ltr /u01/12.2.0/grid/gpnp/eicdb1/wallets/**/
ls: cannot open directory /u01/12.2.0/grid/gpnp/eicdb1/wallets/root: Permission denied
/u01/12.2.0/grid/gpnp/eicdb1/wallets/prdr:
total 4
-rwxr-x--- 1 grid oinstall 1725 Oct 11 2017 cwallet.sso
-rwxrwx--- 1 grid oinstall 0 Oct 11 2017 cwallet.sso.lck
ls: cannot open directory /u01/12.2.0/grid/gpnp/eicdb1/wallets/peer: Permission denied
ls: cannot open directory /u01/12.2.0/grid/gpnp/eicdb1/wallets/pa: Permission denied
[oracle@eicdb1 ~]$ exit
logout
[root@eicdb1 ~]# su - grid
[grid@eicdb1 ~]$ ls -ltr /u01/12.2.0/grid/gpnp/eicdb1/wallets/**/
/u01/12.2.0/grid/gpnp/eicdb1/wallets/root:
total 4
-rwx------ 1 grid oinstall 2416 Oct 11 2017 ewallet.p12 /u01/12.2.0/grid/gpnp/eicdb1/wallets/prdr:
total 4
-rwxr-x--- 1 grid oinstall 1725 Oct 11 2017 cwallet.sso
-rwxrwx--- 1 grid oinstall 0 Oct 11 2017 cwallet.sso.lck /u01/12.2.0/grid/gpnp/eicdb1/wallets/peer:
total 4
-rwx------ 1 grid oinstall 2941 Oct 11 2017 cwallet.sso
-rwx------ 1 grid oinstall 0 Oct 11 2017 cwallet.sso.lck /u01/12.2.0/grid/gpnp/eicdb1/wallets/pa:
total 4
-rwx------ 1 grid oinstall 2933 Oct 11 2017 cwallet.sso
-rwx------ 1 grid oinstall 0 Oct 11 2017 cwallet.sso.lck
[grid@eicdb1 ~]$ //note2
[oracle@eicdb2 dbs]$ ls -ltr /u01/12.2.0/grid/gpnp/eicdb1/wallets/* */
ls: cannot access /u01/12.2.0/grid/gpnp/eicdb1/wallets/*: No such file or directory */
3.发现
note1节点oracle用户Wallet home下没有文件夹peer的权限，这一点与上面定位的问题点贴合。note2节点oracle用户Wallet home下没有文件。
三、故障修复
//修改Wallet home文件夹权限
[grid@eicdb1 ~]$ cd /u01/12.2.0/grid/gpnp/eicdb1/wallets
[grid@eicdb1 wallets]$ ls -ltr
total 16
drwx-----T 2 grid oinstall 4096 Nov 23 16:03 root
drwx-----T 2 grid oinstall 4096 Nov 23 16:03 peer
drwx-----T 2 grid oinstall 4096 Nov 23 16:03 pa
drwxr-x--T 2 grid oinstall 4096 Nov 23 16:03 prdr
[grid@eicdb1 wallets]$ cd ..
[grid@eicdb1 eicdb1]$ cp -r wallets/ wallets.bak
[grid@eicdb1 eicdb1]$ chmod -R 775 wallets
[grid@eicdb1 eicdb1]$ ls -ltr
total 12
drwxr-x--- 3 grid oinstall 4096 Oct 11 2017 profiles
drwxrwxr-x 6 grid oinstall 4096 Oct 11 2017 wallets
drwxr-x--T 6 grid oinstall 4096 Nov 23 16:03 wallets.bak
[grid@eicdb1 eicdb1]$ cd wallets
[grid@eicdb1 wallets]$ ls -ltr
total 16
drwxrwxr-x 2 grid oinstall 4096 Oct 11 2017 root
drwxrwxr-x 2 grid oinstall 4096 Oct 11 2017 prdr
drwxrwxr-x 2 grid oinstall 4096 Oct 11 2017 peer
drwxrwxr-x 2 grid oinstall 4096 Oct 11 2017 pa //启动PDB
SQL> alter pluggable database WRYPC open; Pluggable database altered. //检查alert日志
2020-11-23T16:05:16.663872+08:00
alter pluggable database WRYPC open
2020-11-23T16:05:17.752765+08:00
WRYPC(11):Recovering pdb: pdbid=11
WRYPC(11):JIT: pid 168631 requesting stop
2020-11-23T16:06:45.136175+08:00
WRYPC(11):detach called for domid 11 (domuid: 0x8de3f6c, options: 0x10, pid: 168631)
WRYPC(11):Autotune of undo retention is turned on.
WRYPC(11):attach called for domid 11 (domuid: 0x8de3f6c, options: 0x4, pid: 168631)
WRYPC(11):queued attach broadcast request 0x5e4dd47f30
WRYPC(11):Endian type of dictionary set to little
2020-11-23T16:06:46.854466+08:00
WRYPC(11):[168631] Successfully onlined Undo Tablespace 2.
WRYPC(11):Undo initialization finished serial:0 start:3416128516 end:3416129053 diff:537 ms (0.5 seconds)
WRYPC(11):Database Characterset for WRYPC is AL32UTF8
2020-11-23T16:06:50.341552+08:00
WRYPC(11):Opening pdb with no Resource Manager plan active
Pluggable database WRYPC opened read write
Completed: alter pluggable database WRYPC open
note1节点该PDB状态：
[oracle@eicdb1 ~]$ sqlplus / as sysdba SQL*Plus: Release 12.2.0.1.0 Production on Mon Nov 23 20:31:20 2020 Copyright (c) 1982, 2016, Oracle. All rights reserved. Connected to:
Oracle Database 12c Enterprise Edition Release 12.2.0.1.0 - 64bit Production SQL> set lines 200
SQL> show pdbs; CON_ID CON_NAME OPEN MODE RESTRICTED
---------- ------------------------------ ---------- ----------
2 PDB$SEED READ ONLY NO
3 EIC1PDB READ WRITE NO
4 PDB_NAME READ WRITE NO
5 ERWUPU MOUNTED
6 EWP2 MOUNTED
7 ODS READ WRITE NO
8 EWPSHIDIANSHENG MOUNTED
9 EWPSHIDIANGJ MOUNTED
10 ERWUPUMAP MOUNTED
11 WRYPC READ WRITE NO
12 ERWUPUMAP_XJ MOUNTED CON_ID CON_NAME OPEN MODE RESTRICTED
---------- ------------------------------ ---------- ----------
13 WRYPCNEI2018W MOUNTED
14 ERWUPUMAP_XZ MOUNTED
15 ERWUPUMAP_BT MOUNTED
16 WRYPCNEI2018Z MOUNTED
17 WRYPCWAI54W MOUNTED
18 WRYPCWAI54Z MOUNTED
19 WRYPCWAI65W MOUNTED
20 WRYPCNEI65Z MOUNTED
21 WRYPCNEI66Z MOUNTED
22 HLWZWFWPT READ WRITE NO
23 HLWZWFWPTER READ WRITE NO CON_ID CON_NAME OPEN MODE RESTRICTED
---------- ------------------------------ ---------- ----------
24 EGOVA READ WRITE NO
25 HJXXYZT READ WRITE NO
26 STHJXXYZT READ WRITE NO
27 IWHEREORCL READ WRITE NO
28 ODSTEST READ WRITE NO
29 ESERVICE READ WRITE NO
30 DECWRYPC READ WRITE NO
SQL>
PDB
故障解决。
12C RAC 故障分析 - ORA-17503: ksfdopn:2 Failed to open file +DATA/EIC1/PASSWORD/pwdeic1.256.957086685的更多相关文章
- rac的一次问题 ORA-01565: error in identifying file '+DATA/bol/spfilebol.ora'
昨天安装的测试环境的rac--2节点 CentOS release 6.8 (Final) SQL*Plus: Release 11.2.0.4.0 Production 今天测试突然出现问题 在ra ...
- 12c RAC 用Rman 恢复到异机单实例
准备工作 原服务器软件部署:Redhat 6.6 + Oracle 12.2.0.1 rac Oracle12c单实例安装 1.创建恢复服务器,设置大于原库数据大小的磁盘容量.设置相同的服务器主机名参 ...
- CRS-2674: Start of 'ora.cssd' on 'rac2' failed 引发的rac集群服务起不来问题
问题背景:客户反馈Oracle rac集群节点宕机 1.首先查看宕机原因,归档日志满导致服务重启,查看归档日志路径是USE_DB_RECOVERY_FILE_DEST (默认路径), 安装的时候没有做 ...
- 12C RAC中的一个数据库实例自动crash并报ORA-27157、ORA-27300等错误
rhel7.2上安装12C RAC数据库后,其中一个数据库实例经常会自动crash.查看alert日志发现以下错误信息: Errors in file /d12/app/oracle/diag/rdb ...
- ORACLE 12c RAC的常用管理命令
ORACLE 12c RAC的常用管理命令 一.查询 1.RAC查询 1.1.查询节点 [grid@swnode1 ~]$ su - grid [grid@swnode1 ~]$ /u01/app/1 ...
- Oracle 12c RAC 静默安装文档
参考文档: https://docs.oracle.com/en/database/oracle/oracle-database/12.2/cwlin/index.html https://docs. ...
- Oracle 12c RAC 安装文档
参考文档: https://docs.oracle.com/en/database/oracle/oracle-database/12.2/cwlin/index.html https://docs. ...
- Error Domain=ASIHTTPRequestErrorDomain Code=8 "Failed to move file from"xxx/xxx"to"xxx/xxx"
今天真的好高兴呀 我解决了一个折磨了我一周的问题,真的是激动地要哭出来了,为了这个问题,我嘴也烂了,头发抓了一地啊.虽然解决方法,最后还是展现出了“百度”的伟大,但是我还是很开心,在这里我展示一下我的 ...
- Maven-008-Nexus 私服部署发布报错 Failed to deploy artifacts: Failed to transfer file: ... Return code is: 4XX, ReasonPhrase: ... 解决方案
我在部署构件至 maven nexus 私服时,有时会出现 Failed to deploy artifacts: Failed to transfer file: ... Return code i ...
- QA:Failed to deploy artifacts from/to snapshots XX Failed to transfer file Return code is: 405, ReasonPhrase:Method Not Allowed.
QA: Failed to deploy artifacts from/to snapshots XX Failed to transfer file Return code is: 405, Rea ...
随机推荐
- java多线程之-不可变final
1.背景 final这个关键字相信大家不陌生吧... 看看下面的案例 2.时间格式化之线程不安全SimpleDateFormat package com.ldp.demo08final; import ...
- centos 7 安装 flask
最近 Python 特别火,尤其是在人工智能和大数据分析方面,更是如火如荼.正好放假有空就简单看了下Python 先从熟悉的地方入手,那就从web框架开始学学吧. 首先,官方给了安装方法:http:/ ...
- 图扑 HT for Web 轻松构建组态拓扑结构
在现代的数据可视化和网络管理中,拓扑图是一种非常重要的工具.它可以直观地展示节点(Node)和节点之间的关系(Edge).无论是在 2D 还是 3D 环境中,拓扑图都可以帮助我们更好地理解和管理复 ...
- Python-目标检测-将xml文件转换成.txt文件
代码说明:labels文件夹是工程下的一个文件夹,里面存放的是一些xml文件. 然后我们将这些xml文件中的内容取出来,放在路径path1的文件名下.这样也就完成了xml文件到txt文件的转化. 该代 ...
- odoo openErp 随笔
环境: win7 x64 Python 2.7.18 nodejs pip: C:\> python --version C:\> pip --version C:\> cd \Co ...
- API 接口是什么？怎么对接 API？
API接口是预先定义的函数,允许应用间共享数据和功能.对接API涉及获取接口文档,通过POST请求调用如http://域名地址/queryLoginWx的URL,使用特定Headers.成功返回会包含 ...
- C# 使用正则表达式 将金额转换为中文大写
/// <summary> /// decimal转换成中文大写 /// </summary> /// <param name="number"> ...
- Java 读取命令行输入
在 Java 中,您可以使用 Scanner 类从命令行读取输入.这个类属于 java.util 包,因此在使用之前您需要导入该包. 下面是一个如何从命令行读取输入的 Java 程序示例: impor ...
- Chrome扩展插件的开发--获取网页Cookies
Chrome扩展插件的开发--获取网页Cookies Chrome浏览器在浏览器类应用软件中一直居于榜首,很多人选择Chrome浏览器不仅仅是因为它的稳定,还有它丰富的可拓展性.那么有没有想自己开发一 ...
- 数据库中查询含有某个emoji表情的行数据
数据库中查询含有某个emoji表情的行数据 MySQL的情况 代码如下 create table tt6(id int, name varchar(800)); insert into tt6 s ...