vmware workstation9.0 RHEL5.8 oracle 10g RAC安装指南及问题总结
一，虚拟机规划
(1)虚拟机：添加三块网卡 eth0 eth1 eth2 ,分别用于内网，心跳，外网
RAC1 内网：192.168.1.10/24 心跳：192.168.2.10/24 VIP：192.168.1.100 外网：DHCP
RAC2 内网：192.168.1.11/24 心跳：192.168.2.11/24 VIP：192.168.1.101 外网：DHCP
(2)磁盘大小：20GB 安装系统时使用逻辑卷管理磁盘，以方便后续空间不够时进行扩展
系统：RHEL5.8
(3)共享磁盘
OCR磁盘：100M
Voting disk：100M
两块作为ASM磁盘：
asmdisk1:2GB
asmdisk2:2GB
二，配置
1.主节点配置
(1)网络设置
修改网络配置文件
(2)防火墙和SElinux
关闭防火墙
service iptables stop
禁用SELinux（需要重启主机）
编辑/etc/selinux/config
修改
SELINUX=disabled
(3)修改主机名
编辑/etc/sysconfig/network
设置
HOSTNAME=db10a
(4)修改/etc/hosts文件
添加
##Public Network - (eth0)
192.168.1.10 db10a
192.168.1.11 db10b
##Private Interconnect - (eth1)
192.168.2.10 db10a-priv
192.168.2.11 db10b-priv
##Public Virtual IP (VIP) addresses - (eth0)
192.168.1.100 db10a-vip
192.168.1.101 db10b-vip
(5)创建所需用户和用户组
groupadd -g oinstall
groupadd -g dba
useradd -m -u -g oinstall -G dba -d /home/oracle -s /bin/bash -c "Oracle Software Owner" oracle
设置密码：
passwd oracle
(6)创建所需目录并授权(其中media为存放oracle所需软件的目录)
mkdir -p /oracle/media
chown -R oracle:oinstall /oracle/media/
chmod -R /oracle/media/
mkdir -p /u01/crs1020
chown -R oracle:oinstall /u01/crs1020
chmod -R /u01/crs1020/
mkdir -p /u01/app/oracle
chown -R oracle:oinstall /u01/app/oracle/
chmod -R /u01/app/oracle/
(7)修改环境变量文件
su - oracle
vi .bash_profile
把文件中的内容替换
# .bash_profile
# Get the aliases and functions
if [ -f ~/.bashrc ]; then
. ~/.bashrc
fi
# User specific environment and startup programs
PATH=$PATH:$HOME/bin
export PATH
##################################################
# User specific environment and startup programs
##################################################
export ORACLE_BASE=/u01/app/oracle
export ORACLE_HOME=$ORACLE_BASE/product/10.2./db_1
export CRS_HOME=/u01/crs1020
export ORA_CRS_HOME=/u01/crs1020
export ORACLE_PATH=$ORACLE_BASE/common/oracle/sql:.:$ORACLE_HOME/rdbms/admin
##################################################
# Each RAC node must have a unique ORACLE_SID. (i.e. orcl1, orcl2,...)
##################################################
export ORACLE_SID=testdb101
export PATH=$ORA_CRS_HOME/bin:.:${JAVA_HOME}/bin:${PATH}:$HOME/bin:$ORACLE_HOME/bin
export PATH=${PATH}:/usr/bin:/bin:/usr/bin/X11:/usr/local/bin
export PATH=${PATH}:$ORACLE_BASE/common/oracle/bin:$ORA_CRS_HOME/bin:/sbin
export ORACLE_TERM=xterm
export TNS_ADMIN=$ORACLE_HOME/network/admin
export ORA_NLS10=$ORACLE_HOME/nls/data
export LD_LIBRARY_PATH=$ORACLE_HOME/lib
export LD_LIBRARY_PATH=${LD_LIBRARY_PATH}:$ORACLE_HOME/oracm/lib
export LD_LIBRARY_PATH=${LD_LIBRARY_PATH}:/lib:/usr/lib:/usr/local/lib
export CLASSPATH=$ORACLE_HOME/JRE
export CLASSPATH=${CLASSPATH}:$ORACLE_HOME/jlib
export CLASSPATH=${CLASSPATH}:$ORACLE_HOME/rdbms/jlib
export CLASSPATH=${CLASSPATH}:$ORACLE_HOME/network/jlib
export THREADS_FLAG=native
export TEMP=/tmp
export TMPDIR=/tmp
##################################################
# set NLS_LANG to resolve messy code in SQLPLUS
##################################################
export NLS_LANG=AMERICAN_AMERICA.WE8ISO8859P1
##################################################
# Shell setting.
##################################################
umask
set -o vi
export PS1="\${ORACLE_SID}@`hostname` \${PWD}$ "
##################################################
# Oracle Alias
##################################################
alias ls="ls -FA"
alias vi=vim
alias base='cd $ORACLE_BASE'
alias home='cd $ORACLE_HOME'
alias alert='tail -200f $ORACLE_BASE/admin/RACDB/bdump/alert_$ORACLE_SID.log'
alias tnsnames='vi $ORACLE_HOME/network/admin/tnsnames.ora'
alias listener='vi $ORACLE_HOME/network/admin/listener.ora'
(8)修改内核参数
vi /etc/sysctl.conf
添加：
kernel.shmmax =
kernel.shmmni =
kernel.sem =
fs.file-max =
net.ipv4.ip_local_port_range =
net.core.rmem_default =
net.core.rmem_max =
net.core.wmem_default =
net.core.wmem_max =
生效
sysctl -p
(9)限制参数
编辑/etc/security/limits.conf
添加：
oracle soft nproc
oracle hard nproc
oracle soft nofile
oracle hard nofile
在/etc/pam.d/login中添加：
session required /lib/security/pam_limits.so
如下：
cat >> /etc/pam.d/login << EOF
session required /lib/security/pam_limits.so
EOF
(10)设置计时器
cat >> /etc/rc.local << EOF
modprobe hangcheck-timer hangcheck-tick= hangcheck_margin=
EOF
(11)检查安装包并安装所需要的rpm包
rpm -q --qf '%{NAME}-%{VERSION}-%{RELEASE} (%{ARCH})\n' binutils \
compat-libstdc++- \
elfutils-libelf \
elfutils-libelf-devel \
elfutils-libelf-devel-static \
gcc \
gcc-c++ \
glibc \
glibc-common \
glibc-devel \
glibc-headers \
kernel-headers \
ksh \
libaio \
libaio-devel \
libgcc \
libgomp \
libstdc++ \
libstdc++-devel \
make \
sysstat \
unixODBC \
unixODBC-devel \
libXp
可配置本地yum源
a. mount /dev/cdrom /mnt
b. cat >> /etc/yum.repos.d/dvd.repo<<EOF
[dvd]
name=install dvd
baseurl=file:///mnt/Server
enabled=
gpgcheck=
EOF
c. yum clean all
d. yum list
配置成功后，安装缺失软件包
(12)配置并启动ntp服务
ntp服务
rpm -qa | grep ntp
vi /etc/ntp.conf
restrict 192.168.1.0 mask 255.255.255.0 nomodify notrap service ntpd start chkconfig ntpd on
(13)关闭虚拟机，添加共享磁盘(这一步最好在前面开始的时候做，否则多重启一下虚拟机系统)
添加4块儿磁盘：ocr磁盘为100M
voting disk 为:100M
ASM1:2G
ASM2:2G
添加的4块儿磁盘要与本地的磁盘不要设置在同一总线下
在节点以的vmx文件中添加(开启前添加)：
disk.locking="false"
diskLib.dataCacheMaxSize = ""
diskLib.dataCacheMaxReadAheadSize = ""
diskLib.DataCacheMinReadAheadSize = ""
diskLib.dataCachePageSize = ""
diskLib.maxUnsyncedWrites = ""
scsi1:.deviceType = "disk"
scsi1:.deviceType = "disk"
scsi1:.deviceType = "disk"
scsi1:.deviceType = "disk"
disk.EnableUUID ="true"
对4块儿盘进行分区
fdisk /dev/sdb
分别为：sdb1,sdc1,sdd1,sde1
使用udev进行绑定裸设备
编辑/etc/udev/rules.d/60-raw.rules
添加：
ACTION=="add", KERNEL=="sdb", RUN+="/bin/raw /dev/raw/raw1 %N"
ACTION=="add", KERNEL=="sdc", RUN+="/bin/raw /dev/raw/raw2 %N"
ACTION=="add", KERNEL=="sdd", RUN+="/bin/raw /dev/raw/raw3 %N"
ACTION=="add", KERNEL=="sde", RUN+="/bin/raw /dev/raw/raw4 %N"
KERNEL=="raw[1-4]", OWNER="oracle", GROUP="oinstall", MODE=""
重启udev
start_udev
查看：
[root@db10a ~]# raw -qa
/dev/raw/raw1: bound to major , minor
/dev/raw/raw2: bound to major , minor
/dev/raw/raw3: bound to major , minor
/dev/raw/raw4: bound to major , minor
[root@db10a ~]# ls -l /dev/raw
total
crw-rw---- oracle oinstall , Sep : raw1
crw-rw---- oracle oinstall , Sep : raw2
crw-rw---- oracle oinstall , Sep : raw3
crw-rw---- oracle oinstall , Sep : raw4
注意权限和属组
使用上面的方式进行绑定的时候报磁盘没有共享的错误
使用rawdevice方式进行绑定
在/etc/sysconfig/rawdevices 中加入：
/dev/raw/raw1 /dev/sdb1
/dev/raw/raw2 /dev/sdc1
/dev/raw/raw3 /dev/sdd1
/dev/raw/raw4 /dev/sde1
将赋权限的命令加到/etc/rc.d/rc.local文件中，以便重启的时候对裸设备赋正确的权限
chown –R oracle:oinstall /dev/raw/raw*
chmod /dev/raw/raw*
2.副节点设置
(1)复制或者克隆节点一
(2)修改的地方有
IP地址
主机名
oracle用户中的实例名(这里是testdb102)
3.配互信
在主节点
节点一
su - oracle
mkdir ~/.ssh
ssh-keygen -t rsa Generating public/private rsa key pair.
Enter file in which to save the key (/home/oracle/.ssh/id_rsa):
Enter passphrase (empty for no passphrase):
Enter same passphrase again:
Your identification has been saved in /home/oracle/.ssh/id_rsa.
Your public key has been saved in /home/oracle/.ssh/id_rsa.pub.
The key fingerprint is:
df:1c:ee:d1:::fb:b8:a4:f6:c5::c6::: oracle@rac1 ssh-keygen -t dsa Generating public/private dsa key pair.
Enter file in which to save the key (/home/oracle/.ssh/id_dsa):
Enter passphrase (empty for no passphrase):
Enter same passphrase again:
Your identification has been saved in /home/oracle/.ssh/id_dsa.
Your public key has been saved in /home/oracle/.ssh/id_dsa.pub.
The key fingerprint is:
:7f:a4:2f:::0e:3f:c6:5b:6a:f4:::cb:8e oracle@rac1
在副节点上执行相同的操作，确保通信无阻
su - oracle
mkdir ~/.ssh
ssh-keygen -t rsa Generating public/private rsa key pair.
Enter file in which to save the key (/home/oracle/.ssh/id_rsa):
Enter passphrase (empty for no passphrase):
Enter same passphrase again:
Your identification has been saved in /home/oracle/.ssh/id_rsa.
Your public key has been saved in /home/oracle/.ssh/id_rsa.pub.
The key fingerprint is:
7f:1f::db::e9:da::f5:f4:7c:8c:3d:3f:c9: oracle@rac2 ssh-keygen -t dsa Generating public/private dsa key pair.
Enter file in which to save the key (/home/oracle/.ssh/id_dsa):
Enter passphrase (empty for no passphrase):
Enter same passphrase again:
Your identification has been saved in /home/oracle/.ssh/id_dsa.
Your public key has been saved in /home/oracle/.ssh/id_dsa.pub.
The key fingerprint is:
:b8:c7:7a:6c:b3::ca:ab:::db::a4:8d:1d oracle@rac2
在主节点 rac1 上以 oracle 用户执行以下操作
cat ~/.ssh/id_rsa.pub >> ./.ssh/authorized_keys
cat ~/.ssh/id_dsa.pub >> ./.ssh/authorized_keys
ssh db10b cat ~/.ssh/id_rsa.pub >> ./.ssh/authorized_keys The authenticity of host 'db10b (192.168.1.11)' can't be established.
RSA key fingerprint is 2a:e9:a7:db:dc:7a:cf:c9:7c:2d:ca:fa:d8:::4f.
Are you sure you want to continue connecting (yes/no)? yes
Warning: Permanently added 'db10b,192.168.1.11' (RSA) to the list of known hosts.
oracle@db10b's password: ssh db10b cat ~/.ssh/id_dsa.pub >> ./.ssh/authorized_keys oracle@db10b's password: scp ~/.ssh/authorized_keys db10b:~/.ssh/authorized_keys
oracle@rac2's password:
authorized_keys
% .9KB/s :
在主节点上执行下面操作进行校验
RACDB1@rac1 /home/oracle$ vi ssh.sh ssh db10a date
ssh db10b date
ssh db10a-priv date
ssh db10b-priv date
ssh db10b RACDB1@rac1 /home/oracle$ sh ssh.sh
The authenticity of host 'rac1 (192.168.1.103)' can't be established.
RSA key fingerprint is :ca:c8:ef:::d7:f2:f6:1a:::2f:5e::.
Are you sure you want to continue connecting (yes/no)? yes
Warning: Permanently added 'rac1,192.168.1.103' (RSA) to the list of known
hosts.
Mon May :: CST
Mon May :: CST
The authenticity of host 'rac1-priv (192.168.2.101)' can't be established.
RSA key fingerprint is :ca:c8:ef:::d7:f2:f6:1a:::2f:5e::.
Are you sure you want to continue connecting (yes/no)? yes
Warning: Permanently added 'rac1-priv,192.168.2.101' (RSA) to the list of known
hosts.
Mon May :: CST
The authenticity of host 'rac2-priv (192.168.2.102)' can't be established.
RSA key fingerprint is :ca:c8:ef:::d7:f2:f6:1a:::2f:5e::.
Are you sure you want to continue connecting (yes/no)? yes
Warning: Permanently added 'rac2-priv,192.168.2.102' (RSA) to the list of known
hosts.
Mon May :: CST
RACDB2@rac2 /home/oracle$
这时已经通过 ssh 切换到 rac2 上，
副节点 rac2 上同样进行校验
RACDB2@rac2 /home/oracle$ vi ssh.sh
ssh rac1 date
ssh rac2 date
ssh rac1-priv date
ssh rac2-priv date
ssh rac1
RACDB2@rac2 /home/oracle$ sh ssh.sh
The authenticity of host 'rac1 (192.168.1.103)' can't be established.
RSA key fingerprint is :ca:c8:ef:::d7:f2:f6:1a:::2f:5e::.
Are you sure you want to continue connecting (yes/no)? yes
Warning: Permanently added 'rac1,192.168.1.103' (RSA) to the list of known
hosts.
Mon May :: CST
The authenticity of host 'rac2 (192.168.1.102)' can't be established.
RSA key fingerprint is :ca:c8:ef:::d7:f2:f6:1a:::2f:5e::.
Are you sure you want to continue connecting (yes/no)? yes
Warning: Permanently added 'rac2,192.168.1.102' (RSA) to the list of known
hosts.
Mon May :: CST
The authenticity of host 'rac1-priv (192.168.2.101)' can't be established.
RSA key fingerprint is :ca:c8:ef:::d7:f2:f6:1a:::2f:5e::.
Are you sure you want to continue connecting (yes/no)? yes
Warning: Permanently added 'rac1-priv,192.168.2.101' (RSA) to the list of known
hosts.
Mon May :: CST
The authenticity of host 'rac2-priv (192.168.2.102)' can't be established.
RSA key fingerprint is :ca:c8:ef:::d7:f2:f6:1a:::2f:5e::.
Are you sure you want to continue connecting (yes/no)? yes
Warning: Permanently added 'rac2-priv,192.168.2.102' (RSA) to the list of known
hosts.
Mon May :: CST
RACDB1@rac1 /home/oracle$
校验完毕同时切回了 rac1 节点
再次进行测试看看是否需要手动操作
RACDB1@rac1 /home/oracle$ sh ssh.sh
Mon May :: CST
Mon May :: CST
Mon May :: CST
Mon May :: CST
Last login: Mon May :: from rac1
RACDB2@rac2 /home/oracle$ sh ssh.sh
Mon May :: CST
Mon May :: CST
Mon May :: CST
Mon May :: CST
Last login: Mon May :: from rac2
一去一回，完全不用进行手动操作，两个节点间的互信关系就此配置完毕！！！
PS：保证两节点的时间同步，在二节点停止ntpd服务，并部署下面的脚本，1s进行一次时间同步
[root@rac2 ~]# cat ntpdate_to_rac1.sh -----注意：使用这个脚本的时候客户端的ntpd服务不启动
while :; do ntpdate db10a; sleep ; done
如若仍不满足需求，可以在后台同时启动多个同步脚本。后台启动方法如下。
[root@rac2 ~]# nohup sh ntpdate_to_rac1.sh >> ntpdate_to_rac1.log&
[root@db10b ~]# tail -f ntpdate_to_rac1.log
Sep :: ntpdate[]: adjust time server 192.168.1.10 offset -0.000113 sec
Sep :: ntpdate[]: adjust time server 192.168.1.10 offset 0.000029 sec
Sep :: ntpdate[]: adjust time server 192.168.1.10 offset -0.000058 sec
Sep :: ntpdate[]: adjust time server 192.168.1.10 offset 0.000010 sec
Sep :: ntpdate[]: adjust time server 192.168.1.10 offset -0.000062 sec
Sep :: ntpdate[]: adjust time server 192.168.1.10 offset -0.000022 sec
Sep :: ntpdate[]: adjust time server 192.168.1.10 offset -0.000017 sec
.....
三，安装
1.安装cluster软件
解压：
gzip -d 10201_clusterware_linux_x86_64.cpio.gz
gzip -d 10201_database_linux_x86_64.cpio.gz
cpio -idmv < 10201_clusterware_linux_x86_64.cpio
cpio -idmv < 10201_database_linux_x86_64.cpio
检查安装环境：
cd /oracle/media/clusterware/
./runcluvfy.sh stage -pre crsinst -n db10a,db10b -verbose
检查报：
Could not find a suitable set of interfaces for VIPs.
忽略，继续安装
安装cluster软件的最后要执行两个脚本
[root@rac1 ~]# /u01/app/oracle/oraInventory/orainstRoot.sh Changing permissions of /u01/app/oracle/oraInventory to .
Changing groupname of /u01/app/oracle/oraInventory to oinstall.
The execution of the script is complete [root@rac2 ~]# /u01/app/oracle/oraInventory/orainstRoot.sh Changing permissions of /u01/app/oracle/oraInventory to .
Changing groupname of /u01/app/oracle/oraInventory to oinstall.
The execution of the script is complete
第二个脚本在第一个节点 rac1 上执行
[root@rac1 ~]# /u01/crs1020/root.sh -----时间较长
在第二个节点 rac2 上执行这个脚本前，完成以下工作
[root@rac2 ~]# cd /u01/crs1020/bin/
修改
[root@rac2 bin]# vi vipca
在
if [ "$arch" = "i686" -o "$arch" = "ia64" ] then
LD_ASSUME_KERNEL=2.4.
export LD_ASSUME_KERNEL
fi
下面加入
unset LD_ASSUME_KERNEL
修改
[root@rac2 bin]# vi srvctl
在
LD_ASSUME_KERNEL=2.4.
export LD_ASSUME_KERNEL
下面加入
unset LD_ASSUME_KERNEL
此时
Rac2 上执行
[root@rac2 ~]# /u01/crs1020/root.sh
最后还会报错
Running vipca(silent) for configuring nodeapps
Error (Native: listNetInterfaces:[]) [Error (Native: listNetInterfaces:[])]
解决办法：
[root@rac2 bin]# ./oifcfg getif [root@rac2 bin]# ./oifcfg iflist eth0 192.168.1.0 eth1 192.168.2.0 eth2 192.168.0.0
[root@rac2 bin]# ./oifcfg setif -global eth0/192.168.1.0:public
[root@rac2 bin]# ./oifcfg setif -global eth1/192.168.2.0:cluster_interconnect
[root@rac2 bin]# ./oifcfg getif eth0 192.168.1.0 global public eth1 192.168.2.0 global cluster_interconnect
然后 rac2 上启动 vipca 图形界面
[root@rac2 ~]# cd /u01/crs1020/bin/
[root@rac2 bin]# ./vipca
点击 next
VIP配置成功后（显示如下）
2.安装数据库软件
在安装的时候选择只安装软件
3.listener配置
手工配置或者使用netca配置（推荐使用netca）
安装完成之后使用crs_stat命令查看：
[root@db10b ~]# /u01/crs1020/bin/crs_stat -t -v
Name Type R/RA F/FT Target State Host
----------------------------------------------------------------------
ora....0A.lsnr application / / ONLINE ONLINE db10a
ora.db10a.gsd application / / ONLINE ONLINE db10a
ora.db10a.ons application / / ONLINE ONLINE db10a
ora.db10a.vip application / / ONLINE ONLINE db10a
ora....0B.lsnr application / / ONLINE ONLINE db10b
ora.db10b.gsd application / / ONLINE ONLINE db10b
ora.db10b.ons application / / ONLINE ONLINE db10b
ora.db10b.vip application / / ONLINE ONLINE db10b
4.创建ASM实例和创建数据库
最后一步，使用dbca建库，建库完成后检查服务
testdb101@db10a /home/oracle$ crs_stat -t -v
Name Type R/RA F/FT Target State Host
----------------------------------------------------------------------
ora....SM1.asm application / / ONLINE ONLINE db10a
ora....0A.lsnr application / / ONLINE ONLINE db10a
ora.db10a.gsd application / / ONLINE ONLINE db10a
ora.db10a.ons application / / ONLINE ONLINE db10a
ora.db10a.vip application / / ONLINE ONLINE db10a
ora....SM2.asm application / / ONLINE ONLINE db10b
ora....0B.lsnr application / / ONLINE ONLINE db10b
ora.db10b.gsd application / / ONLINE ONLINE db10b
ora.db10b.ons application / / ONLINE ONLINE db10b
ora.db10b.vip application / / ONLINE ONLINE db10b
ora.....DSG.cs application / / ONLINE ONLINE db10a
ora.....srv application / / ONLINE ONLINE db10a
ora....db10.db application / / ONLINE ONLINE db10b
ora.....inst application / / ONLINE ONLINE db10a
ora.....inst application / / ONLINE ONLINE db10b
四，问题总结
这次安装RAC是遇到问题最多的一次，一一总结如下：
第一，在安装最后执行两个脚本，第一个脚本在两个节点顺利执行，第二个脚本root.sh在主节点顺利执行，在副节点执行的时候等了n长时间报下面的错误：
[root@db10b bin]# /u01/crs1020/root.sh
Checking to see if Oracle CRS stack is already configured Setting the permissions on OCR backup directory
Setting up NS directories
Oracle Cluster Registry configuration upgraded successfully
Successfully accumulated necessary OCR keys.
Using ports: CSS= CRS= EVMC= and EVMR=.
node <nodenumber>: <nodename> <private interconnect name> <hostname>
node : db10a db10a-priv db10a
node : db10b db10b-priv db10b
Creating OCR keys for user 'root', privgrp 'root'..
Operation successful.
Now formatting voting device: /dev/raw/raw2
Format of voting devices complete.
Startup will be queued to init within seconds.
Adding daemons to inittab
Expecting the CRS daemons to be up within seconds. Failure at final check of Oracle CRS stack.
10
查看日志
注释：这个日志在crs目录下的log目录下的db10a（主机名），例如，/u01/crs1020/log/db10b下面的alertdb10b.log
[client()]CRS-:The OCR location /dev/raw/raw1 is inaccessible. Details in /u01/crs1020/log/db10a/client/ocrconfig_20498.log.
-- ::38.503
[client()]CRS-:The OCR location /dev/raw/raw1 is inaccessible. Details in /u01/crs1020/log/db10a/client/ocrconfig_20498.log.
-- ::38.533
[client()]CRS-:The OCR location /dev/raw/raw1 is inaccessible. Details in /u01/crs1020/log/db10a/client/ocrconfig_20498.log.
-- ::38.616
[client()]CRS-:The OCR was formatted using version .
CRS
crsd.log:
Oracle Database 10g CRS Release 10.2.0.1. Production Copyright , Oracle. All rights reserved.
-- ::35.663: [ default][][ENTER]
Oracle Database 10g CRS Release 10.2.0.1. Production Copyright , , Oracle. All rights reserved
-- ::35.663: [ default][]0CRS Daemon Starting
-- ::35.664: [ CRSMAIN][]0Checking the OCR device
-- ::35.669: [ CRSMAIN][]0Connecting to the CSS Daemon
-- ::35.743: [ COMMCRS][]clsc_connect: (0x86592a8) no listener at (ADDRESS=(PROTOCOL=ipc)(KEY=OCSSD_LL_rac2_crs)) -- ::35.743: [ CSSCLNT][]clsssInitNative: connect failed, rc -- ::35.743: [ CRSRTI][]0CSS is not ready. Received status from CSS. Waiting for good status .. -- ::36.753: [ COMMCRS][]clsc_connect: (0x86050a8) no listener at (ADDRESS=(PROTOCOL=ipc)(KEY=OCSSD_LL_rac2_crs)) -- ::36.753: [ CSSCLNT][]clsssInitNative: connect failed, rc -- ::36.753: [ CRSRTI][]0CSS is not ready. Received status from CSS. Waiting for good status ..
.
..(后面一直重复同样的错误信息)
解决方法：
有三种说法：
.防火墙（排除）
.
CRS-:The OCR location /dev/raw/raw4 is inaccessible. 手动格式/dev/raw/raw4：
dd if=/dev/zero of=/dev/raw/raw4 bs=1m
然后
rm -fr /etc/oracle on all nodes 然后在每个节点
$CRS_HOME/root.sh .我应该是属于下面的一种情况：（因为我的二节点上没有下面的参数）
diskLib.dataCacheMaxSize = ""
diskLib.dataCacheMaxReadAheadSize = ""
diskLib.DataCacheMinReadAheadSize = ""
diskLib.dataCachePageSize = ""
diskLib.maxUnsyncedWrites = "" 还有在后面的fdisk，只用对rac1操作就行了，重启后cat /proc/partiion 确定2台虚拟机上都是一样的配置；
另外附上完全清理CRS，卸载RAC的方法：
dd if=/dev/zero of=/dev/raw/raw1 bs=1M count=
dd if=/dev/zero of=/dev/raw/raw2 bs=1M count=
dd if=/dev/zero of=/dev/raw/raw3 bs=1M count=
dd if=/dev/zero of=/dev/raw/raw4 bs=1M count= rm -rf /u01/app/oracle/*
rm -rf /u01/crs1020/* rm -rf /etc/rc.d/rc5.d/S96init.crs
rm -rf /etc/rc.d/init.d/init.crs
rm -rf /etc/rc.d/rc4.d/K96init.crs
rm -rf /etc/rc.d/rc6.d/K96init.crs
rm -rf /etc/rc.d/rc1.d/K96init.crs
rm -rf /etc/rc.d/rc0.d/K96init.crs
rm -rf /etc/rc.d/rc2.d/K96init.crs
rm -rf /etc/rc.d/rc3.d/S96init.crs
rm -rf /etc/oracle/*
rm -rf /etc/oraInst.loc
rm -rf /etc/oratab
rm -rf /usr/local/bin/coraenv
rm -rf /usr/local/bin/dbhome
rm -rf /usr/local/bin/oraenv
rm -f /etc/init.d/init.cssd
rm -f /etc/init.d/init.crs
rm -f /etc/init.d/init.crsd
rm -f /etc/init.d/init.evmd
rm -f /etc/rc2.d/K96init.crs
rm -f /etc/rc2.d/S96init.crs
rm -f /etc/rc3.d/K96init.crs
rm -f /etc/rc3.d/S96init.crs
rm -f /etc/rc5.d/K96init.crs
rm -f /etc/rc5.d/S96init.crs
rm -f /etc/inittab.crs vi /etc/inittab 删除掉与crs和css有关的服务
解决了上面的错误，但是在副节点上再次执行root.sh的时候报下面的错误：
PRKH-1010 、PRKH-1000、PRKN-1008
[root@db10b u01]# /u01/crs1020/root.sh
Checking to see if Oracle CRS stack is already configured Setting the permissions on OCR backup directory
Setting up NS directories
Oracle Cluster Registry configuration upgraded successfully
clscfg: EXISTING configuration version detected.
clscfg: version is 10G Release .
Successfully accumulated necessary OCR keys.
Using ports: CSS= CRS= EVMC= and EVMR=.
node <nodenumber>: <nodename> <private interconnect name> <hostname>
node : db10a db10a-priv db10a
node : db10b db10b-priv db10b
clscfg: Arguments check out successfully. NO KEYS WERE WRITTEN. Supply -force parameter to override.
-force is destructive and will destroy any previous cluster
configuration.
Oracle Cluster Registry for cluster has already been initialized
Startup will be queued to init within seconds.
Adding daemons to inittab
Expecting the CRS daemons to be up within seconds.
CSS is active on these nodes.
db10a
db10b
CSS is active on all nodes.
Waiting for the Oracle CRSD and EVMD to start
Oracle CRS stack installed and running under init(1M)
Running vipca(silent) for configuring nodeapps
PRKH-1010 : Unable to communicate with CRS services.
[PRKH-1000 : Unable to load the SRVM HAS shared library
[PRKN-1008 : Unable to load the shared library "srvmhas10"
or a dependent library, from
LD_LIBRARY_PATH="/u01/crs1020/jdk/jre/lib/i386/client:/u01/crs1020/jdk/jre/lib/i386:/u01/crs1020/jdk/jre/../lib/i386:/u01/crs1020/lib32:/u01/crs1020/srvm/lib32:/u01/crs1020/lib:/u01/crs1020/srvm/lib:/u01/crs1020/lib"
[java.lang.UnsatisfiedLinkError: /u01/crs1020/lib32/libsrvmhas10.so: libclntsh.so.10.1: wrong ELF class: ELFCLASS64]]]
PRKH- : Unable to communicate with CRS services.
[PRKH- : Unable to load the SRVM HAS shared library
[PRKN- : Unable to load the shared library "srvmhas10"
or a dependent library, from
LD_LIBRARY_PATH="/u01/crs1020/jdk/jre/lib/i386/client:/u01/crs1020/jdk/jre/lib/i386:/u01/crs1020/jdk/jre/../lib/i386:/u01/crs1020/lib32:/u01/crs1020/srvm/lib32:/u01/crs1020/lib:/u01/crs1020/srvm/lib:/u01/crs1020/lib"
[java.lang.UnsatisfiedLinkError: /u01/crs1020/lib32/libsrvmhas10.so: libclntsh.so.10.1: wrong ELF class: ELFCLASS64]]]
PRKH- : Unable to communicate with CRS services.
[PRKH- : Unable to load the SRVM HAS shared library
[PRKN- : Unable to load the shared library "srvmhas10"
or a dependent library, from
LD_LIBRARY_PATH="/u01/crs1020/jdk/jre/lib/i386/client:/u01/crs1020/jdk/jre/lib/i386:/u01/crs1020/jdk/jre/../lib/i386:/u01/crs1020/lib32:/u01/crs1020/srvm/lib32:/u01/crs1020/lib:/u01/crs1020/srvm/lib:/u01/crs1020/lib"
[java.lang.UnsatisfiedLinkError: /u01/crs1020/lib32/libsrvmhas10.so: libclntsh.so.10.1: wrong ELF class: ELFCLASS64]]]
解决：
这个错误是由于64位的系统上缺失32位的glibc-devel包导致
在2上节点安装32位的glibc-devel-2.3.4-2.43.i386.rpm，
然后再重新安装CRS
注意：必要是2个节点上都要安装这个包，而且需要重新安装CRS
解决后继续安装，执行root.sh的时候报下面的错误就正常了，这个是oracle10g 10201上面的一个bug，在10205上解决
[root@db10b u01]# /u01/crs1020/root.sh
Checking to see if Oracle CRS stack is already configured Setting the permissions on OCR backup directory
Setting up NS directories
Oracle Cluster Registry configuration upgraded successfully
clscfg: EXISTING configuration version detected.
clscfg: version is 10G Release .
Successfully accumulated necessary OCR keys.
Using ports: CSS= CRS= EVMC= and EVMR=.
node <nodenumber>: <nodename> <private interconnect name> <hostname>
node : db10a db10a-priv db10a
node : db10b db10b-priv db10b
clscfg: Arguments check out successfully. NO KEYS WERE WRITTEN. Supply -force parameter to override.
-force is destructive and will destroy any previous cluster
configuration.
Oracle Cluster Registry for cluster has already been initialized
Startup will be queued to init within seconds.
Adding daemons to inittab
Expecting the CRS daemons to be up within seconds.
CSS is active on these nodes.
db10a
db10b
CSS is active on all nodes.
Oracle CRS stack installed and running under init(1M)
Running vipca(silent) for configuring nodeapps
Error 0(Native: listNetInterfaces:[3])
[Error 0(Native: listNetInterfaces:[3])]
解决：
[root@rac2 bin]# ./oifcfg getif [root@rac2 bin]# ./oifcfg iflist
eth0 192.168.1.0
eth1 192.168.2.0
eth2 192.168.0.0
[root@rac2 bin]# ./oifcfg setif -global eth0/192.168.1.0:public
[root@rac2 bin]# ./oifcfg setif -global eth1/192.168.2.0:cluster_interconnect
[root@rac2 bin]# ./oifcfg getif
eth0 192.168.1.0 global public
eth1 192.168.2.0 global cluster_interconnect
然后再root用户下启动vipca配置好VIP
vmware workstation9.0 RHEL5.8 oracle 10g RAC安装指南及问题总结的更多相关文章
- rhel5.4+oracle 10g rac
各种报错各种愁啊 ... 1> 不知道什么原因,在节点2执行root.sh 报错 .无解 . 还原虚拟机,重新安装 .唯一与以前不同的是,执行orainroot.sh后 接着在节点2执行.再去分 ...
- 【转】Oracle 10g RAC TAF
本人转自:http://www.cnblogs.com/future2012lg/archive/2013/10/12/3365978.html Oracle RAC 同一时候具备HA(High Av ...
- Oracle 10g RAC启动与关闭命令
一. 检查共享设备 一般情况下, 存放OCR 和 Voting Disk 的OCFS2 或者raw 都是自动启动的. 如果他们没有启动,RAC 肯定是启动不了的. 1.1 如果使用ocfs2的,检查o ...
- Oracle 10g RAC TAF
Oracle RAC 同时具备HA(High Availiablity) 和LB(LoadBalance). 而其高可用性的基础就是Failover(故障转移). 它指集群中任何一个节点的故障都不会影 ...
- Oracle 10g RAC的负载均衡配置[转载]
Oracle 10g RAC的负载均衡配置 负载均衡是指连接的负载均衡.RAC的负载均衡主要是指新会话连接到RAC数据库时,如何判定这个新的连接要连到哪个节点进行工作.在RAC中,负载均衡分为两种,一 ...
- VMware WorkStation9.0虚拟机如何运行WINPE
VMware WorkStation9.0虚拟机如何运行WINPE...我们在使用VMware的过程中,有些时候需要让VMware来运行WINPE系统,比如在使用VMware进行系统封装的过程中,其中 ...
- 安装Oracle 10g RAC是否需要安装HACMP
实际上无论在哪个操作系统(AIX,HP-UX,Solaris,Linux)上安装Oracle10g RAC都不再需要Vendor Clusterware(IBM的HACMP,HP的Service Gu ...
- Oracle 10g RAC 如何配置 VIP IPMP
metalink note 283107.1介绍了如何设置VIP的IPMP,此处记录一下设置过程. o Existing 10g RAC installation ^^^^^^^^^^^^^^^^^^ ...
- oracle 10g RAC psu过程
1 升级crs 至10.2.0.5.2 1) 升级opatch 程序,PSU对opatch的版本有要求,详见readme文件,此步操作共涉及到每个节点的ORACLE_HOME和ORA_CRS_HOME ...
随机推荐
- caffe中accuracy和loss用python从log日志里面获取
import re import pylab as pl import numpy as np if __name__=="__main__": accuracys=[] loss ...
- Xshell远程管理Linux
Xshell[1]是一个强大的安全终端模拟软件,它支持SSH1, SSH2, 以及Microsoft Windows 平台的TELNET 协议. Xshell 通过互联网到远程主机的安全连接以及它创新 ...
- PMD宣传文案
队名:Clover 李烈争 031402614 林昊斌 031402615 李坤隆 031402612 林瑞斌 031402617 解宇虹 031402338 林 锦 031402339 目录 一. ...
- 简要介绍BASE64、MD5、SHA、HMAC几种方法。
加密解密,曾经是我一个毕业设计的重要组件.在工作了多年以后回想当时那个加密.解密算法,实在是太单纯了. 言归正传,这里我们主要描述Java已经实现的一些加密解密算法,最后介绍数字证书. ...
- arcgis engine 监听element的添加、更新和删除事件（使用IGraphicsContainerEvents）
IGraphicsContainerEvents Interface 如何监听 element事件? 如,当我们在Mapcontrol上添加.删除.更新了一个Element后,如何捕捉到这个事件? ...
- session生命周期(一)
Session存储在服务器端,一般为了防止在服务器的内存中(为了高速存取),Session在用户访问第一次访问服务器时创建,需要注意只有访问JSP.Servlet等程序时才会创建Session,只访问 ...
- PG 函数的易变性（Function Volatility Categories）
此概念的接触是在做分区表的时候碰到的,分区表按时间字段分区,在查询时当where条件中时间为now()或者current_time()等时是无法查询的,即使进行格式转换也不行,只有是时间格式如‘201 ...
- C# 的界面控件属性修改线程安全问题
今天在实验delegate与thread 在初步的实验结束后,因为原来的delegate只有一个函数会被调用,感觉没有达到delegate的极致,所以又重新自己定义了一个delegate,在另一个线程 ...
- Ulink2 "No Ulink Device found" 解决办法
一.背景 keil使用ULINK2调试的时候,提示 "No Ulink Device found", "error: flash download failed - Ta ...
- 【荐1】Total Commander 7.57 个人使用设置 及 常用快捷键 备忘
Total Commander 7.57a 下载地址:http://www.baidu.com/s?wd=total commander 7.57 破解版 软件整体预览图:(注意,下面的版本我用的是 ...