Oracle11g RAC+DG搭建

项目环境准备

3.1虚拟机配置

• 版本选择

注意Linux操作系统。此次项目我选择的版本是Oracle Enterprise Linux 5.4

• 内存的设置

本人电脑物理内存8G，由于此次实验要开三台虚拟机，基于集群两台机需要的内存较大，故每台给2G，单实例做standby的给1.5G。

• 添加选择网卡类型

使用桥接方式容易引发IP冲突，所以我选择的是Host Only方式，避免IP冲突。

两个网卡使用分配：

NAT:作Public IP

Host Only:作Private IP

注意主机和虚拟机的防火墙要关闭，达到互信。

• 分配磁盘空间

在分配磁盘空间的时候不要立即分配，避免占用实际空间大小，可以分配给其他进程。这里我分配50G给根分区，选择将虚拟磁盘存储为单个文件，性能较好。

• 添加共享磁盘

添加3个共享磁盘，分别为asm1,asm2,asm3.(注意：共享磁盘不能建为本地磁盘），也就是说SCSI设置为1：n,而不是0：n。模式选择独立永久，立即分配磁盘，存储为单个文件方式。每个磁盘均给3G，用于存储数据库相关文件。

由上可知，做RAC需要一块本地硬盘，两块网卡，3个共享磁盘及OEL5.4的安装配置。

3.2 安装OEL5.4操作系统

• 这里不要全部选择，sdb,sdc,sdd三个作裸设备，格式sda即可。防止其他三个盘全部被系统占用。

• 主机名：rac1.example.com

eth0:192.168.23.100/255.255.255.0(public)

eth1:192.168.21.10/255.255.255.0(private)

gateway:192.168.23.1

• 禁用防火墙和SELinux

Oracle不推荐私有网络使用iptables.

• 安装VMTOOLS

让鼠标脱离虚拟机，便于虚拟机和主机的文件复制。

3.3配置操作系统

• 搭建yum仓库，安装所需要的包。

[root@rac1～]vi /etc/yum.repo.d/server

[server]

name=oel5.4

baseurl=file:///mnt/Server

gpgcheck=0

enable=1

[root@rac1～]yum install -y oracle-validate*

[root@rac1～]yum install -y *asm*

• 配置host文件

• 添加用户和组

[root@rac1 ~]# userdel -r grid

userdel: user grid does not exist

[root@rac1 ~]# userdel -r oracle

[root@rac1 ~]# groupdel oinstall

[root@rac1 ~]# groupdel dba

[root@rac1 ~]# groupdel asmadmin

groupdel: group asmadmin does not exist

[root@rac1 ~]# groupdel oper

groupdel: group oper does not exist

[root@rac1 ~]# groupdel oper

groupdel: group oper does not exist

[root@rac1 ~]# groupdel asmdba

groupdel: group asmdba does not exist

[root@rac1 ~]# groupdel asmoper

groupdel: group asmoper does not exist

[root@rac1 ~]# groupadd -g 1000 oinstall

[root@rac1 ~]# groupadd -g 1100 asmadmin

[root@rac1 ~]# groupadd -g 1200 dba

[root@rac1 ~]# groupadd -g 1201 oper

[root@rac1 ~]# groupadd -g 1300 asmdba

[root@rac1 ~]# groupadd -g 1301 asmoper

[root@rac1 ~]# useradd -u 1100 -g oinstall -G asmadmin,asmdba,asmoper grid

[root@rac1 ~]# useradd -u 1101 -g oinstall -G dba,oper,asmdba oracle

[root@rac1 ~]# passwd oracle

Changing password for user oracle.

New UNIX password:

BAD PASSWORD: it is based on a dictionary word

Retype new UNIX password:

passwd: all authentication tokens updated successfully.

[root@rac1 ~]# passwd grid

• 修改配置用户环境变量

grid用户

export TMP=/tmp

export TMPDIR=$TMP

export ORACLE_SID=+ASM1

export ORACLE_BASE=/u01/app/grid

export ORACLE_HOME=/u01/app/11.2.0/grid

export NLS_DATE_FORMAT="yyyy-mm-dd HH24:MI:SS"

export PATH=$ORACLE_HOME/bin:$PATH

if [ $USER = "oracle" ] || [ $USER = "grid" ]; then

if [ $SHELL = "/bin/ksh" ]; then

ulimit -p 16384

ulimit -n 65536

else

ulimit -u 16384 -n 65536

fi

umask 022

fi

Oracle 用户

export TMP=/tmp

export TMPDIR=$TMP

export ORACLE_SID=racdb1

export ORACLE_BASE=/u01/app/oracle

export ORACLE_HOME=/u01/app/oracle/product/11.2.0/db_1

export NLS_DATE_FORMAT="yyyy-mm-dd HH24:MI:SS"

export PATH=$ORACLE_HOME/bin:$PATH

if [ $USER = "oracle" ] || [ $USER = "grid" ]; then

if [ $SHELL = "/bin/ksh" ]; then

ulimit -p 16384

ulimit -n 65536

else

ulimit -u 16384 -n 65536

fi

umask 022

Fi

• 修改系统参数（用户限制）

[root@rac1 ~]# vi /etc/security/limits.conf

grid soft nproc 2047

grid hard nproc 16384

grid soft nofile 1024

grid hard nofile 65536

oracle soft nproc 2047

oracle hard nproc 16384

oracle soft nofile 1024

oracle hard nofile 65536

• 创建相关目录

[root@rac1 ~]# mkdir -p /u01/app/grid/11.2.0

[root@rac1 ~]# chown -R grid:oinstall /u01/

[root@rac1 ~]# mkdir -p /u01/app/oracle

[root@rac1 ~]# chown -R oracle:oinstall /u01/app/oracle

3.4创建第二个节点

• 修改虚拟机配置文件以创建共享磁盘

到E:\RAC\rac1目录下找到rac1.vmx文件，记事本打开，进行修改

• 创建第二台主机

关闭rac1，复制所有rac1 虚拟机文件，放置文件夹rac2 中。

打开rac2，选择“我已复制”。

1) 将rac2 的两块网卡删除，重新添加；或者重新给定mac 地址，并给予正确的IP。

eth0:192.168.23.200/255.255.255.0(public)

eth1:192.168.21.20/255.255.255.0(private)

gateway:192.168.23.1

注意：两台机器都要有默认网关。

2) 修改rac2 的主机名为rac2.example.com（/etc/sysconfig/network）

3) 修改rac2 中oracle 用户换进变量的ORACLE_SID 为racdb2,grid用户的ORACLE_SID为+ASM2。

4）再执行[root@rac1 ~]# hostname rac2.example.com

注意：配置完以后重启rac2，确保主机名生效。

3.5安装配置Grid软件

• 对磁盘进行分区

[root@rac1 ~]#fdisk /dev/sdb

[root@rac1 ~]#fdisk /dev/sdc

[root@rac1 ~]#fdisk /dev/sdd

‘n’----’p’----’1’----’w’

• 配置oracleasm（两个节点执行rac1,rac2)

/etc/init.d/oracleasm configure

Configuring the Oracle ASM library driver.

This will configure the on-boot properties of the Oracle ASM library

driver.  The following questions will determine whether the driver is

loaded on boot and what permissions it will have.  The current values

will be shown in brackets ('[]').  Hitting <ENTER> without typing an

answer will keep that current value.  Ctrl-C will abort.

Default user to own the driver interface []: grid

Default group to own the driver interface []: oinstall

Start Oracle ASM library driver on boot (y/n) [n]: y

Scan for Oracle ASM disks on boot (y/n) [y]: y

Writing Oracle ASM library driver configuration: done

Initializing the Oracle ASMLib driver:                     [  OK  ]

Scanning the system for Oracle ASMLib disks:               [  OK  ]

• 创建asm磁盘（rac1执行）

[root@rac1 ~]# oracleasm createdisk VOL1 /dev/sdb1

Writing disk header: done

Instantiating disk: done

[root@rac1 ~]# oracleasm createdisk VOL2 /dev/sdc1

Writing disk header: done

Instantiating disk: done

[root@rac1 ~]# oracleasm createdisk VOL3 /dev/sdd1

Writing disk header: done

Instantiating disk: done

[root@rac1 ~]# /etc/init.d/oracleasm listdisks

VOL1

VOL2

VOL3

• 扫描生成rac1创建的asm磁盘(rac2执行）

[root@rac2 ~]# oracleasm scandisks

Reloading disk partitions: done

Cleaning any stale ASM disks...

Scanning system for ASM disks...

[root@rac2 ~]# /etc/init.d/oracleasm listdisks

VOL1

VOL2

VOL3

• 两个节点停止ntp服务

/etc/init.d/ntpd stop

/etc/init.d/ntpd status

chkconfig ntpd off

rm -rf /etc/ntp.conf

• 安装Grid

拷贝grid压缩软件赋权解压后执行安装。（rac1执行）

[grid@rac1 grid]$ ./runInstaller

注意顺序（rac2,rac1)root用户

注意顺序，所有脚本都在root用户执行。

跑第二个脚本成功输出结果：

/u01/app/11.2.0/grid/root.sh

Changing permissions of /u01/app/oraInventory.

Adding read,write permissions for group.

Removing read,write,execute permissions for world.

Changing groupname of /u01/app/oraInventory to oinstall.

The execution of the script is complete.

You have mail in /var/spool/mail/root

[root@rac1 ~]# /u01/app/11.2.0/grid/root.sh

Performing root user operation for Oracle 11g

The following environment variables are set as:

ORACLE_OWNER= grid

ORACLE_HOME=  /u01/app/11.2.0/grid

Enter the full pathname of the local bin directory: [/usr/local/bin]:

Copying dbhome to /usr/local/bin ...

Copying oraenv to /usr/local/bin ...

Copying coraenv to /usr/local/bin ...

..........................................................................................

...........................................................................................

.........................................................................................

##  STATE    File Universal Id                File Name Disk group

--  -----    -----------------                --------- ---------

1. ONLINE   6f12fa9ffe274fc3bfa64e25d3e270de (/dev/oracleasm/disks/VOL1) [DATA]

Located 1 voting disk(s).

CRS-2672: Attempting to start 'ora.asm' on 'rac1'

CRS-2676: Start of 'ora.asm' on 'rac1' succeeded

CRS-2672: Attempting to start 'ora.DATA.dg' on 'rac1'

CRS-2676: Start of 'ora.DATA.dg' on 'rac1' succeeded

CRS-2672: Attempting to start 'ora.registry.acfs' on 'rac1'

CRS-2676: Start of 'ora.registry.acfs' on 'rac1' succeeded

Configure Oracle Grid Infrastructure for a Cluster ... succeeded

这是由于没有配置DNS服务导致的，可以忽略。

• 检测安装结果

3.6创建ASM磁盘组

[grid@rac1 ~]$ asmca

3.7安装数据库

3.7.1安装数据库软件

[oracle@rac1 database]$ ./runInstaller

 

 

 

 

 

 

 

 

 

 

注意先后顺序

成功输出结果

/u01/app/oracle/product/11.2.0/db_1/root.sh

Performing root user operation for Oracle 11g

The following environment variables are set as:

ORACLE_OWNER= oracle

ORACLE_HOME=  /u01/app/oracle/product/11.2.0/db_1

Enter the full pathname of the local bin directory: [/usr/local/bin]:

The contents of "dbhome" have not changed. No need to overwrite.

The contents of "oraenv" have not changed. No need to overwrite.

The contents of "coraenv" have not changed. No need to overwrite.

Entries will be added to the /etc/oratab file as needed by

Database Configuration Assistant when a database is created

Finished running generic part of root script.

Now product-specific root actions will be performed.

Finished product-specific root actions.

You have new mail in /var/spool/mail/root

3.7.2 配置监听

3.7.3创建数据库

[oracle@rac1 admin]$ dbca

[grid@rac1 grid]$ srvctl config database -d racdb

Database unique name: racdb

Database name: racdb

Oracle home: /u01/app/oracle/product/11.2.0/db_1

Oracle user: oracle

Spfile: +DBDATA/racdb/spfileracdb.ora

Domain:

Start options: open

Stop options: immediate

Database role: PRIMARY

Management policy: AUTOMATIC

Server pools: racdb

Database instances: racdb1,racdb2

Disk Groups: DBDATA,DATA,RECOVER

Mount point paths:

Services:

Type: RAC

Database is administrator managed

[grid@rac1 grid]$

四、项目实现

4，配置RAC+Data Guard

4.1创建第三台机rac3

• 主机名：rac3.example.com

IP:192.168.23.155/255.255.255.0

Gateway:192.168.23.1

• 禁用防火墙和SELinux
• 安装VMTOOLS

让鼠标脱离虚拟机，便于虚拟机和主机的文件复制。

• 搭建yum仓库，安装所需要的包。

[root@rac1～]vi /etc/yum.repo.d/server

[server]

name=oel5.4

baseurl=file:///mnt/Server

gpgcheck=0

enable=1

[root@rac1～]yum install -y oracle-validate*

• 编辑/etc/hosts文件

• 用户及环境变量配置

• 安装数据库软件

4.2检查环境

• 归档模式

SYS@racdb1>select log_mode from v$database;

LOG_MODE

------------

ARCHIVELOG

• 参数设置

SYS@racdb1>alter database force logging;

4.3配置监听

• Tnsnames.ora文件配置，三台机

• Listener.ora(备库主机racdg)

SID_LIST_LISTENER =

(SID_LIST =

(SID_DESC =

(GLOBAL_DBNAME = racdg)

(ORACLE_HOME = /u01/app/oracle/product/11.2.0/db_1)

(SID_NAME = racdg)

)

)

LISTENER =

(DESCRIPTION =

(ADDRESS = (PROTOCOL = TCP)(HOST = rac3.example.com)(PORT = 1521))

)

ADR_BASE_LISTENER = /u01/app/oracle

4.4文件准备

• 口令文件准备

[oracle@rac1 dbs]$ scp orapwracdb1 rac3:$ORACLE_HOME/dbs/orapwracdg

• 参数文件准备

主库添加以下参数

#primary

DB_UNIQUE_NAME=racdb

LOG_ARCHIVE_CONFIG='DG_CONFIG=(racdb,racdg)'

LOG_ARCHIVE_DEST_1=

'LOCATION=+RECOVER

VALID_FOR=(ALL_LOGFILES,ALL_ROLES)

DB_UNIQUE_NAME=racdb'

LOG_ARCHIVE_DEST_2=

'SERVICE=racdg ASYNC

VALID_FOR=(ONLINE_LOGFILES,PRIMARY_ROLE)

DB_UNIQUE_NAME=racdg'

LOG_ARCHIVE_DEST_STATE_1=ENABLE

LOG_ARCHIVE_DEST_STATE_2=defer

LOG_ARCHIVE_FORMAT=%t_%s_%r.arc

#standby

FAL_SERVER=racdg

racdb1.fal_client=racdb1

racdb2.fal_client=racdb2

DB_FILE_NAME_CONVERT='/disk1/racdg/datafile','+DBDATA/racdb/datafile'

LOG_FILE_NAME_CONVERT=

'/disk2/racdg/logfile','+DBDATA/racdb/onlinelog'

STANDBY_FILE_MANAGEMENT=AUTO

备库参数

racdg.__db_cache_size=138412032

racdg.__java_pool_size=4194304

racdg.__large_pool_size=4194304

racdg.__pga_aggregate_target=209715200

racdg.__sga_target=314572800

racdg.__shared_io_pool_size=0

racdg.__shared_pool_size=159383552

racdg.__streams_pool_size=0

*.audit_file_dest='/u01/app/oracle/admin/racdg/adump'

*.audit_trail='db'

*.compatible='11.2.0.0.0'

*.control_files='/disk3/racdg/controlfile/control01.ctl'

*.db_block_size=8192

*.db_create_file_dest='/disk3/racdg/fast'

*.db_domain=''

*.db_name='racdb'

*.diagnostic_dest='/u01/app/oracle'

*.log_archive_format='%t_%s_%r.dbf'

*.memory_target=524288000

*.open_cursors=300

*.processes=150

*.remote_login_passwordfile='exclusive'

racdg.undo_tablespace='UNDOTBS1'

#primary

DB_UNIQUE_NAME=racdg

LOG_ARCHIVE_CONFIG='DG_CONFIG=(racdg,racdb)'

LOG_ARCHIVE_DEST_1=

'LOCATION=/disk4/racdg/archivelog

VALID_FOR=(ALL_LOGFILES,ALL_ROLES)

DB_UNIQUE_NAME=racdg'

LOG_ARCHIVE_DEST_2=

'SERVICE=racdb1 ASYNC

VALID_FOR=(ONLINE_LOGFILES,PRIMARY_ROLE)

DB_UNIQUE_NAME=racdb'

LOG_ARCHIVE_FORMAT=%t_%s_%r.arc

#standby

FAL_SERVER=racdb1,racdb2

fal_client='racdg

DB_FILE_NAME_CONVERT='+DBDATA/racdb/datafile','/disk1/racdg/datafile'

LOG_FILE_NAME_CONVERT=

'+DBDATA/racdb/onlinelog', '/disk2/racdg/logfile'

STANDBY_FILE_MANAGEMENT=AUTO

• 创建standby redo

SYS@racdb1>alter database add standby logfile thread 1 group 5 size 50m;

SYS@racdb1>>alter database add standby logfile thread 1 group 6 size 50m;

SYS@racdb1>alter database add standby logfile thread 1 group 7 size 50m;

SYS@racdb1>alter database add standby logfile thread 2 group 8 size 50m;

SYS@racdb1>alter database add standby logfile thread 2 group 9 size 50m;

SYS@racdb1>alter database add standby logfile thread 2 group 10 size 50m;

• 数据文件和控制文件（rman备份复制）

主库备份rman target

RMAN> backup format '/home/oracle/backup/bk_%u' current controlfile for standby;

RMAN>backup format '/home/oracle/backup/bkk_%u' database plus archivelog;

[oracle@rac1 backup]$ scp * rac3:/home/oracle/backup

备库端复制

[oracle@rac3 backup]$ rman target sys/oracle@racdb1 auxiliary /

RMAN> duplicate target database for standby nofilenamecheck;

4.5测试及应用

• 查看两库的日志传送情况和状态

• 测试表空间和表数据

SYS@racdb1>create tablespace test datafile '/disk5/racdb1/test.dbf' size 20m;

SYS@racdb1>create table testdat(id number,name varchar2(20)) tablespace test;

SYS@racdb1>alter system switch logfile;

SYS@racdg>alter database recover managed standby database disconnect from session;

SYS@racdg>desc testdat;

Name                                      Null?    Type

----------------------------------------- --------

ID                                                   NUMBER

NAME                                               VARCHAR2(20)

SYS@racdb1>insert into testdat values(41,'Leader.Zhang');

SYS@racdb1>commit;

SYS@racdb1>alter system switch logfile;

SYS@racdg>select * from testdat;

ID NAME

---------- --------------------

41 Leader.Zhang

4.6切换

• 从主库切换到备库（主库执行）

SYS@racdb1>alter database commit to switchover to physical standby;

SYS@racdb1>shutdown immediate

SYS@racdb1>startup mount

SYS@racdb1>alter database recover managed standby database disconnect from session;

SYS@racdb1>select database_role,switchover_status from v$database;

DATABASE_ROLE    SWITCHOVER_STATUS

---------------- --------------------

PHYSICAL STANDBY NOT ALLOWED

• 从备库切换到主库

SYS@racdg>alter database commit to switchover to primary;

SYS@racdg>shutdown immediate

SYS@racdg>startup

SYS@racdg>select database_role,switchover_status from v$database;

DATABASE_ROLE    SWITCHOVER_STATUS

---------------- --------------------

PRIMARY          RESOLVABLE GAP

SYS@racdg>alter system switch logfile;

SYS@racdg>select database_role,switchover_status from v$database;

DATABASE_ROLE    SWITCHOVER_STATUS

---------------- --------------------

PRIMARY          TO STANDBY

注意关机开机顺序：主库先关后起，备库后关先起。