基于CentOS与VmwareStation10搭建Oracle11G RAC 64集群环境：3.安装Oracle RAC-3.1.安装并配置ASM驱动

3.1.安装并配置ASM驱动

3.3.1.检查内核

[root@linuxrac2 etc]# uname -r

2.6.18-164.el5

　　下载以下rpm包(注意rpm包版本和Linux内核版本一致):

　　Oracle ASMlib下载地址:http://www.oracle.com/technetwork/server-storage/linux/downloads/rhel5-084877.html

oracleasm-2.6.18-164.el5-2.0.5-1.el5.x86_64.rpm

oracleasmlib-2.0.4-1.el5.x86_64.rpm

oracleasm-support-2.1.7-1.el5.ppc64.rpm

3.1.2.安装oracleasm包(所有节点执行)

[root@linuxrac1]# su root

[root@linuxrac1]# ll

total 128

-rw-r--r--. 1 root root 33840 Aug 5 2014 oracleasm-2.6.18-164.el5-2.0.5-1.el5.x86_64.rpm

-rw-r--r--. 1 root root 13300 Aug 5 2014 oracleasmlib-2.0.4-1.el5.x86_64.rpm

-rw-r--r--. 1 root root 74984 Aug 5 2014 oracleasm-support-2.1.7-1.el5.ppc64.rpm

[root@linuxrac1 ~]# rpm -ivh oracleasm-support-2.1.8-1.el5.x86_64.rpm

warning: oracleasm-support-2.1.8-1.el5.x86_64.rpm: Header V3 DSA signature: NOKEY, key ID 1e5e0159

Preparing... ########################################### [100%]

1:oracleasm-support ########################################### [100%]

[root@linuxrac1 ~]# rpm -ivh oracleasm-2.6.18-164.el5-2.0.5-1.el5.x86_64.rpm

warning: oracleasm-2.6.18-164.el5-2.0.5-1.el5.x86_64.rpm: Header V3 DSA signature: NOKEY, key ID 1e5e0159

Preparing... ########################################### [100%]

1:oracleasm-2.6.18-164.el########################################### [100%]

[root@linuxrac1 ~]# rpm -ivh oracleasmlib-2.0.4-1.el5.x86_64.rpm

warning: oracleasmlib-2.0.4-1.el5.x86_64.rpm: Header V3 DSA signature: NOKEY, key ID 1e5e0159

Preparing... ########################################### [100%]

1:oracleasmlib ########################################### [100%]

[oracle@linuxrac2 home]$ scp linuxrac1@192.168.2.106:/home/linuxrac1/Downloads/2.zip linuxrac2@192.168.2.206:/home/linuxrac2/Downloads

linuxrac1@192.168.2.106's password:

linuxrac2@192.168.2.206's password:

2.zip 100% 110KB 110.5KB/s 00:00

Connection to 192.168.2.106 closed.

[oracle@linuxrac2 home]$ su root

[root@linuxrac2 linuxrac2]# cd Downloads

[root@linuxrac2 Downloads]# ll

total 7736

-rw-r--r--. 1 linuxrac2 linuxrac2 113141 Aug 7 19:45 2.zip

drwxrwxr-x. 2 linuxrac2 linuxrac2 4096 Jul 25 15:05 rpms

-rw-rw-r--. 1 linuxrac2 linuxrac2 7801347 Jul 26 01:27 rpms.zip

[root@linuxrac2 Downloads]# unzip 2.zip

[root@linuxrac2 ]# ll

total 128

-rw-r--r--. 1 root root 33840 Aug 5 16:28 kmod-oracleasm-2.0.6.rh1-2.el6.x86_64.rpm

-rw-r--r--. 1 root root 13300 Aug 5 15:59 oracleasmlib-2.0.4-1.el6.x86_64.rpm

-rw-r--r--. 1 root root 74984 Aug 5 15:52 oracleasm-support-2.1.8-1.el6.x86_64.rpm

Last login: Tue Sep 23 00:39:40 2014

[root@linuxrac2 ~]# rpm -ivh oracleasm-support-2.1.8-1.el5.x86_64.rpm

warning: oracleasm-support-2.1.8-1.el5.x86_64.rpm: Header V3 DSA signature: NOKEY, key ID 1e5e0159

Preparing... ########################################### [100%]

1:oracleasm-support ########################################### [100%]

[root@linuxrac2 ~]# rpm -ivh oracleasm-2.6.18-164.el5-2.0.5-1.el5.x86_64.rpm

warning: oracleasm-2.6.18-164.el5-2.0.5-1.el5.x86_64.rpm: Header V3 DSA signature: NOKEY, key ID 1e5e0159

Preparing... ########################################### [100%]

1:oracleasm-2.6.18-164.el########################################### [100%]

[root@linuxrac2 ~]# rpm -ivh oracleasmlib-2.0.4-1.el5.x86_64.rpm

warning: oracleasmlib-2.0.4-1.el5.x86_64.rpm: Header V3 DSA signature: NOKEY, key ID 1e5e0159

Preparing... ########################################### [100%]

1:oracleasmlib ########################################### [100%]

[root@linuxrac1 etc]# rpm -qa | grep oracleasm

oracleasmlib-2.0.4-1.el5

oracleasm-support-2.1.8-1.el5

oracleasm-2.6.18-164.el5-2.0.5-1.el5

3.1.3. 初始化 asmlib(在所有节点执行)

启动oracle asmlib:

[root@linuxrac1 etc]# /etc/init.d/oracleasm start

Initializing the Oracle ASMLib driver: [ OK ]

Scanning the system for Oracle ASMLib disks: [ OK ]

启用asmlib：

[root@linuxrac1 etc]# /etc/init.d/oracleasm enable

Writing Oracle ASM library driver configuration: done

Initializing the Oracle ASMLib driver: [ OK ]

Scanning the system for Oracle ASMLib disks: [ OK ]

以root用户配置节点linuxrac1

[root@linuxrac1 /]# /etc/init.d/oracleasm configure -i

Configuring the Oracle ASM library driver.

This will configure the on-boot properties of the Oracle ASM library

driver. The following questions will determine whether the driver is

loaded on boot and what permissions it will have. The current values

will be shown in brackets ('[]'). Hitting <ENTER> without typing an

answer will keep that current value. Ctrl-C will abort.

Default user to own the driver interface []: grid

Default group to own the driver interface []: oinstall

Start Oracle ASM library driver on boot (y/n) [n]: y

Scan for Oracle ASM disks on boot (y/n) [y]: y

Writing Oracle ASM library driver configuration: done

Initializing the Oracle ASMLib driver: [ OK ]

Scanning the system for Oracle ASMLib disks: [ OK ]

[root@linuxrac1 /]# /usr/sbin/oracleasm init

Creating /dev/oracleasm mount point: /dev/oracleasm

Loading module "oracleasm": oracleasm

Mounting ASMlib driver filesystem: /dev/oracleasm

以root用户配置节点linuxrac2

[root@linuxrac2 /]# oracleasm configure -i

Configuring the Oracle ASM library driver.

This will configure the on-boot properties of the Oracle ASM library

driver. The following questions will determine whether the driver is

loaded on boot and what permissions it will have. The current values

will be shown in brackets ('[]'). Hitting <ENTER> without typing an

answer will keep that current value. Ctrl-C will abort.

Default user to own the driver interface []: grid

Default group to own the driver interface []: oinstall

Start Oracle ASM library driver on boot (y/n) [n]: y

Scan for Oracle ASM disks on boot (y/n) [y]: y

Writing Oracle ASM library driver configuration: done

Initializing the Oracle ASMLib driver: [ OK ]

Scanning the system for Oracle ASMLib disks: [ OK ]

[root@linuxrac2 /]# oracleasm init

Creating /dev/oracleasm mount point: /dev/oracleasm

Loading module "oracleasm": oracleasm

Mounting ASMlib driver filesystem: /dev/oracleasm

3.1.4. 磁盘分区(节点1执行)

1.查询磁盘

[root@linuxrac1 dev]# fdisk -l

Disk /dev/sda: 32.2 GB, 32212254720 bytes

255 heads, 63 sectors/track, 3916 cylinders

Units = cylinders of 16065 * 512 = 8225280 bytes

Sector size (logical/physical): 512 bytes / 512 bytes

I/O size (minimum/optimal): 512 bytes / 512 bytes

Disk identifier: 0x0005464c

Device Boot Start End Blocks Id System

/dev/sda1 * 1 39 307200 83 Linux

Partition 1 does not end on cylinder boundary.

/dev/sda2 39 545 4063232 82 Linux swap / Solaris

Partition 2 does not end on cylinder boundary.

/dev/sda3 545 3917 27085824 83 Linux

Disk /dev/sdb: 4294 MB, 4294967296 bytes

255 heads, 63 sectors/track, 522 cylinders

Units = cylinders of 16065 * 512 = 8225280 bytes

Sector size (logical/physical): 512 bytes / 512 bytes

I/O size (minimum/optimal): 512 bytes / 512 bytes

Disk identifier: 0x00000000

Disk /dev/sde: 5368 MB, 5368709120 bytes

255 heads, 63 sectors/track, 652 cylinders

Units = cylinders of 16065 * 512 = 8225280 bytes

Sector size (logical/physical): 512 bytes / 512 bytes

I/O size (minimum/optimal): 512 bytes / 512 bytes

Disk identifier: 0x00000000

Disk /dev/sdc: 21.5 GB, 21474836480 bytes

255 heads, 63 sectors/track, 2610 cylinders

Units = cylinders of 16065 * 512 = 8225280 bytes

Sector size (logical/physical): 512 bytes / 512 bytes

I/O size (minimum/optimal): 512 bytes / 512 bytes

Disk identifier: 0x00000000

Disk /dev/sdd: 21.5 GB, 21474836480 bytes

255 heads, 63 sectors/track, 2610 cylinders

Units = cylinders of 16065 * 512 = 8225280 bytes

Sector size (logical/physical): 512 bytes / 512 bytes

I/O size (minimum/optimal): 512 bytes / 512 bytes

Disk identifier: 0x00000000

2.磁盘分区，注意分区的Last cylinder的值不能选错，选择default 值就好。

[root@linuxrac1 /]# fdisk /dev/sdb

Device contains neither a valid DOS partition table, nor Sun, SGI or OSF disklabel

Building a new DOS disklabel with disk identifier 0x52362e93.

Changes will remain in memory only, until you decide to write them.

After that, of course, the previous content won't be recoverable.

Warning: invalid flag 0x0000 of partition table 4 will be corrected by w(rite)

WARNING: DOS-compatible mode is deprecated. It's strongly recommended to

switch off the mode (command 'c') and change display units to

sectors (command 'u').

Command (m for help): n

Command action

e extended

p primary partition (1-4)

Partition number (1-4): 1

First cylinder (1-522, default 1): 1

Last cylinder, +cylinders or +size{K,M,G} (1-522, default 522): 522

Command (m for help): w

The partition table has been altered!

Calling ioctl() to re-read partition table.

Syncing disks.

　　/dev/sdc,/dev/sdd，/dev/sde执行相同操作。

3.1.5.创建 asm 磁盘,在节点1执行

1.使用oracleasm createdisk 创建ASM磁盘label:在一个节点执行即可

[root@linuxrac1 /]# /etc/init.d/oracleasm createdisk OCR_VOTE /dev/sdb1

Marking disk "OCR_VOTE" as an ASM disk: [ OK ]

[root@linuxrac1 /]# oracleasm createdisk OCR_VOTE /dev/sdb1

Device "/dev/sdb1" is already labeled for ASM disk "OCR_VOTE"

[root@linuxrac1 /]# oracleasm createdisk DATA /dev/sdc1

Writing disk header: done

Instantiating disk: done

[root@linuxrac1 /]# oracleasm createdisk DATA2 /dev/sdd1

Writing disk header: done

Instantiating disk: done

[root@linuxrac1 /]# oracleasm createdisk FRA /dev/sde1

Writing disk header: done

Instantiating disk: done

[root@linuxrac1 /]# oracleasm scandisks

Reloading disk partitions: done

Cleaning any stale ASM disks...

Scanning system for ASM disks...

2.查看创建后的ASM磁盘

[root@linuxrac1 /]# oracleasm listdisks

DATA

DATA2

FRA

OCR_VOTE

3.检查磁盘是否已挂载在oracleasm文件系统：

[root@linuxrac1 /]# ls -l /dev/oracleasm/disks

total 0

brw-rw---- 1 grid oinstall 8, 33 Sep 24 18:29 DATA

brw-rw---- 1 grid oinstall 8, 49 Sep 24 18:29 DATA2

brw-rw---- 1 grid oinstall 8, 65 Sep 24 18:29 FRA

brw-rw---- 1 grid oinstall 8, 17 Sep 24 18:29 OCR_VOTE

[root@linuxrac1 /]# oracleasm querydisk /dev/sdb1

3.1.6. 节点2扫描识别ASM磁盘

节点2扫描识别ASM磁盘

root@linuxrac2 etc]# oracleasm scandisks

Reloading disk partitions: done

Cleaning any stale ASM disks...

Scanning system for ASM disks...

Instantiating disk "OCR_VOTE"

Instantiating disk "DATA"

Instantiating disk "DATA2"

Instantiating disk "FRA"

基于CentOS与VmwareStation10搭建Oracle11G RAC 64集群环境所有链接:

1.资源准备
http://www.cnblogs.com/HondaHsu/p/4046352.html

2.搭建环境-2.1创建虚拟机
http://www.cnblogs.com/HondaHsu/p/4046378.html

2.搭建环境-2.2安装操作系统CentOS5.4
http://www.cnblogs.com/HondaHsu/p/4046384.html

2.搭建环境-2.3配置共享磁盘
http://www.cnblogs.com/HondaHsu/p/4046389.html

2.搭建环境-2.4. 安装JDK
http://www.cnblogs.com/HondaHsu/p/4046430.html

2.搭建环境-2.5. 配置网络
http://www.cnblogs.com/HondaHsu/p/4046443.html

2.搭建环境-2.6. 安装Oracle所依赖的必要包
http://www.cnblogs.com/HondaHsu/p/4054216.html

2.搭建环境-2.7. 配置资源与参数
http://www.cnblogs.com/HondaHsu/p/4054238.html

2.搭建环境-2.8. 配置用户环境
http://www.cnblogs.com/HondaHsu/p/4054259.html

2.搭建环境-2.9. 配置用户等效性(可选项)
http://www.cnblogs.com/HondaHsu/p/4054277.html

2.搭建环境-2.10.配置用户NTF服务
http://www.cnblogs.com/HondaHsu/p/4054333.html

3.安装Oracle RAC-3.1.安装并配置ASM驱动
http://www.cnblogs.com/HondaHsu/p/4054367.html

3.安装Oracle RAC-3.2.安装 cvuqdisk 软件包
http://www.cnblogs.com/HondaHsu/p/4054395.html

3.安装Oracle RAC-3.3.安装前检查
http://www.cnblogs.com/HondaHsu/p/4054481.html

3.安装Oracle RAC-3.4.安装Grid Infrastructure
http://www.cnblogs.com/HondaHsu/p/4054518.html

3.安装Oracle RAC-3.5.安装oracle11gr2 database 软件与创建数据库
http://www.cnblogs.com/HondaHsu/p/4054586.html

3.安装Oracle RAC-3.6.集群管理命令
http://www.cnblogs.com/HondaHsu/p/4054635.html

4.安装Oracle RAC FAQ-4.1.系统界面报错Gnome
http://www.cnblogs.com/HondaHsu/p/4046314.html

4.安装Oracle RAC FAQ-4.2.Oracleasm Createdisk ASM磁盘失败:Instantiating disk: failed
http://www.cnblogs.com/HondaHsu/p/4046248.html

4.安装Oracle RAC FAQ-4.3.Oracle 集群节点间连通失败
http://www.cnblogs.com/HondaHsu/p/4046263.html

4.安装Oracle RAC FAQ-4.4.无法图形化安装Grid Infrastructure
http://www.cnblogs.com/HondaHsu/p/4046273.html

4.安装Oracle RAC FAQ-4.5.安装Grid，创建ASM磁盘组空间不足
http://www.cnblogs.com/HondaHsu/p/4046285.html

4.安装Oracle RAC FAQ-4.6.重新配置与缷载11R2 Grid Infrastructure
http://www.cnblogs.com/HondaHsu/p/4046300.html

4.安装Oracle RAC FAQ-4.7.Oracle 11G R2 RAC修改public网络IP
http://www.cnblogs.com/HondaHsu/p/4054953.html