Oracle启动报错ORA-03113解决

环境：RHEL6.4 + Oracle 11.2.0.4

步骤摘要：
1.启动报错ORA-03113
2.查看alert日志查找原因
3.根据实际情况采取合理的措施，这里我们先增加闪回区大小，把库启动起来
4.制定对应的归档日志删除策略

1.启动报错ORA-03113

$ sqlplus / as sysdba
 
SQL*Plus: Release 11.2.0.4. Production on 星期六 2月  :: 
 
Copyright (c) , , Oracle.  All rights reserved.
 
Connected to an idle instance.
 
SQL> startup mount
ORACLE instance started.
 
Total System Global Area  bytes
Fixed Size                   bytes
Variable Size             bytes
Database Buffers           bytes
Redo Buffers                bytes
Database mounted.
SQL> alter database open;
alter database open
*
ERROR at line :
ORA-: 通信通道的文件结尾
进程 ID:
会话 ID:  序列号: 
 
SQL> 

2.查看alert日志查找原因

Sat Feb  ::
Starting ORACLE instance (normal)
LICENSE_MAX_SESSION =
LICENSE_SESSIONS_WARNING =
Initial number of CPU is
CELL communication is configured to use  interface(s):
CELL IP affinity details:
    NUMA status: non-NUMA system
    cellaffinity.ora status: N/A
CELL communication will use  IP group(s):
    Grp :
Picked latch-free SCN scheme
Using LOG_ARCHIVE_DEST_1 parameter default value as USE_DB_RECOVERY_FILE_DEST
Autotune of undo retention is turned on.
IMODE=BR
ILAT =
LICENSE_MAX_USERS =
SYS auditing is disabled
Starting up:
Oracle Database 11g Enterprise Edition Release 11.2.0.4. - 64bit Production
With the Partitioning, OLAP, Data Mining and Real Application Testing options.
ORACLE_HOME = /opt/app/oracle/product/11.2.0.4/dbhome_1
System name:    Linux
Node name:      JJFAB01
Release:        2.6.-.el6.x86_64
Version:        # SMP Tue Jan  :: EST
Machine:        x86_64
VM name:        Xen Version: 4.1 (PVM)
Using parameter settings in server-side spfile /opt/app/oracle/product/11.2.0.4/dbhome_1/dbs/spfileJJFAB.ora
System parameters with non-default values:
  processes                =
  sessions                 =
  memory_target            = 3G
  control_files            = "/opt/oradata/gxwj/control01.ctl"
  control_files            = "/opt/app/oracle/fast_recovery_area/gxwj/control02.ctl"
  db_block_size            =
  compatible               = "11.2.0.0.0"
  db_recovery_file_dest    = "/opt/app/oracle/fast_recovery_area"
  db_recovery_file_dest_size= 4122M
  undo_tablespace          = "UNDOTBS1"
  remote_login_passwordfile= "EXCLUSIVE"
  db_domain                = ""
  dispatchers              = "(PROTOCOL=TCP) (SERVICE=gxwjXDB)"
  audit_file_dest          = "/opt/app/oracle/admin/gxwj/adump"
  audit_trail              = "DB"
  db_name                  = "JJFAB"
  open_cursors             =
  diagnostic_dest          = "/opt/app/oracle"
Sat Feb  ::
PMON started with pid=, OS id=
Sat Feb  ::
PSP0 started with pid=, OS id=
Sat Feb  ::
VKTM started with pid=, OS id= at elevated priority
VKTM running at ()millisec precision with DBRM quantum ()ms
Sat Feb  ::
GEN0 started with pid=, OS id=
Sat Feb  ::
DIAG started with pid=, OS id=
Sat Feb  ::
DBRM started with pid=, OS id=
Sat Feb  ::
DIA0 started with pid=, OS id=
Sat Feb  ::
MMAN started with pid=, OS id=
Sat Feb  ::
DBW0 started with pid=, OS id=
Sat Feb  ::
LGWR started with pid=, OS id=
Sat Feb  ::
CKPT started with pid=, OS id=
Sat Feb  ::
SMON started with pid=, OS id=
Sat Feb  ::
RECO started with pid=, OS id=
Sat Feb  ::
MMON started with pid=, OS id=
starting up  dispatcher(s) for network address '(ADDRESS=(PARTIAL=YES)(PROTOCOL=TCP))'...
Sat Feb  ::
MMNL started with pid=, OS id=
starting up  shared server(s) ...
ORACLE_BASE from environment = /opt/app/oracle
Sat Feb  ::
ALTER DATABASE   MOUNT
Successful mount of redo thread , with mount id
Database mounted in Exclusive Mode
Lost write protection disabled
Completed: ALTER DATABASE   MOUNT
Sat Feb  ::
alter database open
Sat Feb  ::
LGWR: STARTING ARCH PROCESSES
Sat Feb  ::
ARC0 started with pid=, OS id=
ARC0: Archival started
LGWR: STARTING ARCH PROCESSES COMPLETE
ARC0: STARTING ARCH PROCESSES
Sat Feb  ::
ARC1 started with pid=, OS id=
Sat Feb  ::
ARC2 started with pid=, OS id=
Errors in file /opt/app/oracle/diag/rdbms/jjfab/JJFAB/trace/JJFAB_ora_13501.trc:
ORA-: 警告: db_recovery_file_dest_size 字节 (共  字节) 已使用 100.00%, 尚有  字节可用。
************************************************************************
You have following choices to free up space from recovery area:
. Consider changing RMAN RETENTION POLICY. If you are using Data Guard,
   then consider changing RMAN ARCHIVELOG DELETION POLICY.
. Back up files to tertiary device such as tape using RMAN
   BACKUP RECOVERY AREA command.
. Add disk space and increase db_recovery_file_dest_size parameter to
   reflect the new space.
. Delete unnecessary files using RMAN DELETE command. If an operating
   system command was used to delete files, then use RMAN CROSSCHECK and
   DELETE EXPIRED commands.
************************************************************************
ARCH: Error  Creating archive log file to '/opt/app/oracle/fast_recovery_area/JJFAB/archivelog/2015_02_28/o1_mf_1_130_%u_.arc'
Errors in file /opt/app/oracle/diag/rdbms/jjfab/JJFAB/trace/JJFAB_ora_13501.trc:
ORA-: 日志  sequence#  无法归档
ORA-: 超出了恢复文件数的限制
ORA-: 联机日志  线程 : '/opt/oradata/gxwj/redo01.log'
Sat Feb  ::
ARC3 started with pid=, OS id=
USER (ospid: ): terminating the instance due to error
Sat Feb  ::
System state dump requested by (instance=, osid=), summary=[abnormal instance termination].
System State dumped to trace file /opt/app/oracle/diag/rdbms/jjfab/JJFAB/trace/JJFAB_diag_13471_20150228135750.trc
Dumping diagnostic data in directory=[cdmp_20150228135750], requested by (instance=, osid=), summary=[abnormal instance termination].
Instance terminated by USER, pid = 

发现告警日志中已经明确给出了原因和建议。

3.根据实际情况采取合理的措施，这里我们先增加闪回区大小，把库启动起来。

SQL> startup mount
ORA-: 未初始化服务句柄
ORA-: 内部错误, hostdef 扩展名不存在
SQL> exit
Disconnected from Oracle Database 11g Enterprise Edition Release 11.2.0.4. - 64bit Production
With the Partitioning, OLAP, Data Mining and Real Application Testing options
$ sqlplus / as sysdba
 
SQL*Plus: Release 11.2.0.4. Production on 星期六 2月  :: 
 
Copyright (c) , , Oracle.  All rights reserved.
 
Connected to an idle instance.
 
SQL> startup mount
ORACLE instance started.
 
Total System Global Area  bytes
Fixed Size                   bytes
Variable Size             bytes
Database Buffers           bytes
Redo Buffers                bytes
Database mounted.
SQL> show parameter db_recover
 
NAME                                 TYPE        VALUE
------------------------------------ ----------- ------------------------------
db_recovery_file_dest                string      /opt/app/oracle/fast_recovery_
                                                 area
db_recovery_file_dest_size           big integer 4122M
SQL> !
$ df -h /opt/
文件系统              容量  已用  可用 已用%% 挂载点
/dev/mapper/vg_extend-lv_opt
                      493G  423G   45G  % /opt
$ exit
exit
 
SQL> alter system set db_recovery_file_dest_size=10G;
 
System altered.
 
SQL> alter database open;
 
Database altered.
 
SQL> select status from v$instance;
 
STATUS
------------
OPEN
 
SQL> 

4.制定对应的归档日志删除策略

SQL> set linesize
SQL> select * from v$flash_recovery_area_usage;
 
FILE_TYPE            PERCENT_SPACE_USED PERCENT_SPACE_RECLAIMABLE NUMBER_OF_FILES
-------------------- ------------------ ------------------------- ---------------
CONTROL FILE
REDO LOG
ARCHIVED LOG                      41.54
BACKUP PIECE
IMAGE COPY
FLASHBACK LOG
FOREIGN ARCHIVED LOG                                                          
 
 rows selected.
可以rman直接删除不再需要的归档，比如删除1天之前的归档
RMAN> delete noprompt archivelog until time 'sysdate-1';
此处省略删除归档的输出..
RMAN> exit
 
Recovery Manager complete.
 
SQL> select * from v$flash_recovery_area_usage;
 
FILE_TYPE            PERCENT_SPACE_USED PERCENT_SPACE_RECLAIMABLE NUMBER_OF_FILES
-------------------- ------------------ ------------------------- ---------------
CONTROL FILE
REDO LOG
ARCHIVED LOG                        .
BACKUP PIECE
IMAGE COPY
FLASHBACK LOG
FOREIGN ARCHIVED LOG                                                          
 
 rows selected.

当然还可以设置crontab定时每天删除1天前的归档：

$ crontab -l
  * * * /opt/shell/del_arch.sh
$ more /opt/shell/del_arch.sh
#!/bin/bash
export ORACLE_BASE=/opt/app/oracle
export ORACLE_HOME=/opt/app/oracle/product/11.2.0.4/dbhome_1
export ORACLE_SID=JJFAB
export NLS_LANG="simplified chinese_china.ZHS16GBK"
export NLS_DATE_FORMAT="YYYY -MM-DD HH24:Mi:SS"
export PATH=.:/opt/app/oracle/product/11.2.0.4/dbhome_1:/usr/sbin:$ORACLE_HOME/bin:$PATH
export LD_LIBRARY_PATH=$ORACLE_HOME/lib
 
rman target / log=/opt/backup/del_arch.log <<EOF
list archivelog all;
delete noprompt archivelog until time 'sysdate-1';
show all;
list archivelog all;
EOF