当DataGuard升级CPU后。发现主备库不能同步了,日志报错,所以在主库的运行的升级的后脚本“@catbundle.sql cpu apply”不能同步到备库

现象:

broker状态:

[oracle@webdb2 ~]$ dgmgrl sys/oracle

DGMGRL for Linux: Version 11.2.0.3.0 -64bit Production

Copyright (c) 2000, 2009, Oracle. Allrights reserved.

欢迎使用 DGMGRL, 要获取有关信息请键入 "help"。

已连接。

DGMGRL> show configuration

配置 - webdb

保护模式:        MaxAvailability

数据库:

webdb  - 主数据库

webdb2 - 物理备用数据库

高速启动故障转移: DISABLED

配置状态:

ORA-16664: 无法从数据库接收结果

DGM-17017: 无法确定配置状态

--查看主库状态:

SQL> Select timestamp, message FROMV$DATAGUARD_STATUS Where Rownum < 5;

TIMESTAMP  MESSAGE

-------------------------------------------------------------------------------------------

2014-10-23 Error 604 received logging on to the standby

2014-10-23  PING[ARC2]: Heartbeat failed to connect tostandby'(DESCRIPTION=(ADDRESS=(PROTOCOL=tcp)(HOST=webdb2)(PORT=1521))(CONNECT_DATA=(SERVICE_NAME=webdb2)(SERVER=DEDICATED)))'.Error is 604.

2014-10-23 Error 604 received logging on to the standby

2014-10-23 PING[ARC2]: Heartbeat failed to connect to standby'(DESCRIPTION=(ADDRESS=(PROTOCOL=tcp)(HOST=webdb2)(PORT=1521))(CONNECT_DATA=(SERVICE_NAME=webdb2)(SERVER=DEDICATED)))'.Error is 604.

--此时查看日志

主库日志:

ORA-00604: 递归 SQL 级别 1 出现错误

ORA-20154: TNS: 监听程序当前无法识别连接描写叙述符中请求的服务

ORA-06512: 在 line 29

Thu Oct 23 00:25:52 2014

Errors in file/u01/app/ora11g/diag/rdbms/webdb/webdb/trace/webdb_ora_18833.trc:

ORA-00604: 递归 SQL
级别 1 出现错误

ORA-20154: TNS: 监听程序当前无法识别连接描写叙述符中请求的服务

ORA-06512: 在 line 29

Thu Oct 23 00:25:52 2014

Errors in file/u01/app/ora11g/diag/rdbms/webdb/webdb/trace/webdb_ora_18842.trc:

ORA-00604: 递归 SQL 级别 1 出现错误

ORA-20154: TNS: 监听程序当前无法识别连接描写叙述符中请求的服务

ORA-06512: 在 line 29

Thu Oct 23 00:25:53 2014

Error 604 receivedlogging on to the standby

PING[ARC2]: Heartbeatfailed to connect to standby'(DESCRIPTION=(ADDRESS=(PROTOCOL=tcp)(HOST=webdb2)(PORT=1521))(CONNECT_DATA=(SERVICE_NAME=webdb2)(SERVER=DEDICATED)))'.Error is 604.

Thu Oct 23 00:26:12 2014

Errors in file /u01/app/ora11g/diag/rdbms/webdb/webdb/trace/webdb_ora_18961.trc:

ORA-00604: 递归 SQL 级别 1 出现错误

ORA-20154: TNS: 监听程序当前无法识别连接描写叙述符中请求的服务

ORA-06512: 在 line 29

备库日志:

ORA-00604: 递归 SQL
级别 1 出现错误

ORA-16000: 打开数据库以进行仅仅读訪问

ORA-06512: 在 line 3

Thu Oct 23 00:27:39 2014

Errors in file /u01/app/ora11g/diag/rdbms/webdb2/webdb2/trace/webdb2_ora_30130.trc:

ORA-00604: 递归 SQL
级别 1 出现错误

ORA-20154: TNS: 监听程序当前无法识别连接描写叙述符中请求的服务

ORA-06512: 在 line 29

Errors in file/u01/app/ora11g/diag/rdbms/webdb2/webdb2/trace/webdb2_ora_30130.trc:

ORA-00604: 递归 SQL 级别 1 出现错误

ORA-16000: 打开数据库以进行仅仅读訪问

ORA-06512: 在 line 3

--进一步查看trace文件

主库trace:

[oracle@webdb1 trace]$ more/u01/app/ora11g/diag/rdbms/webdb/webdb/trace/webdb_ora_8589.trc

Trace file/u01/app/ora11g/diag/rdbms/webdb/webdb/trace/webdb_ora_8589.trc

Oracle Database 11g Enterprise EditionRelease 11.2.0.3.0 - 64bit Production

With the Partitioning, Automatic StorageManagement, OLAP, Data Mining

and Real Application Testing options

ORACLE_HOME =/u01/app/ora11g/product/11.2.0/db_1

System name:    Linux

Node name:      webdb1

Release:        2.6.32-200.13.1.el5uek

Version:        #1 SMP Wed Jul 27 21:02:33 EDT 2011

Machine:        x86_64

Instance name: webdb

Redo thread mounted by this instance: 1

Oracle process number: 176

Unix process pid: 8589, image:oracle@webdb1

*** 2014-10-14 13:19:18.860

*** SESSION ID:(21.12621) 2014-10-1413:19:18.860

*** CLIENT ID:() 2014-10-14 13:19:18.860

*** SERVICE NAME:(SYS$USERS) 2014-10-1413:19:18.860

*** MODULE NAME:(emagent@webdb1 (TNSV1-V3)) 2014-10-14 13:19:18.860

*** ACTION NAME:() 2014-10-14 13:19:18.860

Error in executing triggers on connectinternal

*** 2014-10-14 13:19:18.861

dbkedDefDump(): Starting a non-incidentdiagnostic dump (flags=0x0, level=0, mask=0x0)

----- Error Stack Dump -----

ORA-00604: 递归 SQL
级别 1 出现错误

ORA-20154: TNS: 监听程序当前无法识别连接描写叙述符中请求的服务

ORA-06512: 在 line 28

Trace file/u01/app/ora11g/diag/rdbms/webdb/webdb/trace/webdb_ora_8589.trc

Oracle Database 11g Enterprise EditionRelease 11.2.0.3.0 - 64bit Production

With the Partitioning, Automatic StorageManagement, OLAP, Data Mining

and Real Application Testing options

ORACLE_HOME =/u01/app/ora11g/product/11.2.0/db_1

System name:    Linux

Node name:      webdb1

Release:        2.6.32-200.13.1.el5uek

Version:        #1 SMP Wed Jul 27 21:02:33 EDT 2011

Machine:        x86_64

Instance name: webdb

Redo thread mounted by this instance: 1

Oracle process number: 163

Unix process pid: 8589, image:oracle@webdb1

备库trace:

[oracle@webdb2 trace]$ more/u01/app/ora11g/diag/rdbms/webdb2/webdb2/trace/webdb2_ora_29791.trc

Trace file/u01/app/ora11g/diag/rdbms/webdb2/webdb2/trace/webdb2_ora_29791.trc

Oracle Database 11g Enterprise EditionRelease 11.2.0.3.0 - 64bit Production

With the Partitioning, Automatic StorageManagement, OLAP, Data Mining

and Real Application Testing options

ORACLE_HOME =/u01/app/ora11g/product/11.2.0/db_1

System name:    Linux

Node name:      webdb2

Release:        2.6.32-200.13.1.el5uek

Version:        #1 SMP Wed Jul 27 21:02:33 EDT 2011

Machine:        x86_64

Instance name: webdb2

Redo thread mounted by this instance: 1

Oracle process number: 22

Unix process pid: 29791, image:oracle@webdb2

*** 2014-10-23 11:30:21.649

*** SESSION ID:(854.10603) 2014-10-2311:30:21.649

*** CLIENT ID:() 2014-10-23 11:30:21.649

*** SERVICE NAME:(SYS$USERS) 2014-10-2311:30:21.649

*** MODULE NAME:(emagent@webdb2 (TNSV1-V3)) 2014-10-23 11:30:21.649

*** ACTION NAME:() 2014-10-23 11:30:21.649

Error in executing triggers on connectinternal

*** 2014-10-23 11:30:21.649

dbkedDefDump(): Starting a non-incidentdiagnostic dump (flags=0x0, level=0, mask=0x0)

----- Error Stack Dump -----

ORA-00604: 递归 SQL 级别 1 出现错误

ORA-20154: TNS: 监听程序当前无法识别连接描写叙述符中请求的服务

ORA-06512: 在 line 29

Error in executing triggers on connectinternal

*** 2014-10-23 11:30:21.650

dbkedDefDump(): Starting a non-incidentdiagnostic dump (flags=0x0, level=0, mask=0x0)

----- Error Stack Dump -----

ORA-00604: 递归 SQL 级别 1 出现错误

ORA-16000: 打开数据库以进行仅仅读訪问

ORA-06512: 在 line 3

分析:

能够从看到trace log中看到都与tiger运行有关。于是想到在主库是创建过的两个 logon on database tiger

解决的方法:

--禁用登录tiger

把一个登录IP限制的tiger的禁用后,主库的

ORA-00604: 递归 SQL 级别 1 出现错误

ORA-20154: TNS: 监听程序当前无法识别连接描写叙述符中请求的服务

报错消失。仅仅剩下以下的报错:

Error 604 received logging on to thestandby

PING[ARC2]: Heartbeat failed to connect tostandby'(DESCRIPTION=(ADDRESS=(PROTOCOL=tcp)(HOST=webdb2)(PORT=1521))(CONNECT_DATA=(SERVICE_NAME=webdb2)(SERVER=DEDICATED)))'.Error is 604.

备库依旧报错

--启动备库到mount状态

SQL> shutdown immediate

SQL> startup mount

ORACLE 例程已经启动。

Total System Global Area 1.0456E+10 bytes

Fixed Size                  2237488 bytes

Variable Size            5435821008 bytes

Database Buffers         4999610368 bytes

Redo Buffers               17973248 bytes

数据库装载完成。

SQL> select open_mode from v$database;

OPEN_MODE

--------------------

MOUNTED

--查看日志

主库:

Thu Oct 23 13:45:15 2014

Archived Log entry 2225 added for thread 1sequence 1122 ID 0xc8d579d3 dest 1:

ARC3: Standby redo logfile selected forthread 1 sequence 1122 for destination LOG_ARCHIVE_DEST_2

Thu Oct 23 13:46:46 2014

ARC3: Archive log rejected (thread 1sequence 1120) at host'(DESCRIPTION=(ADDRESS=(PROTOCOL=tcp)(HOST=webdb2)(PORT=1521))(CONNECT_DATA=(SERVICE_NAME=webdb2)(SERVER=DEDICATED)))'

Thu Oct 23 13:46:46 2014

ARC0: Archive log rejected (thread 1sequence 1121) at host'(DESCRIPTION=(ADDRESS=(PROTOCOL=tcp)(HOST=webdb2)(PORT=1521))(CONNECT_DATA=(SERVICE_NAME=webdb2)(SERVER=DEDICATED)))'

FAL[server, ARC3]: FAL archive failed, seetrace file.

ARCH: FAL archive failed. Archivercontinuing

ORACLE Instance webdb - Archival Error.Archiver continuing.

FAL[server, ARC0]: FAL archive failed, seetrace file.

ARCH: FAL archive failed. Archivercontinuing

ORACLE Instance webdb - Archival Error.Archiver continuing.

Thu Oct 23 13:46:49 2014

Destination LOG_ARCHIVE_DEST_2 isSYNCHRONIZED

LGWR: Standby redo logfile selected toarchive thread 1 sequence 1124

LGWR: Standby redo logfile selected forthread 1 sequence 1124 for destination LOG_ARCHIVE_DEST_2

Thread 1 advanced to log sequence 1124(LGWR switch)

Current log# 2 seq# 1124 mem# 0:+DATA/webdb/onlinelog/group_2.262.819826783

Current log# 2 seq# 1124 mem# 1:+FRA/webdb/onlinelog/group_2.258.819826785

Archived Log entry 2244 added for thread 1sequence 1123 ID 0xc8d579d3 dest 1

备库:

Using STANDBY_ARCHIVE_DEST parameterdefault value as USE_DB_RECOVERY_FILE_DEST

Thu Oct 23 13:45:15 2014

RFS[1]: Assigned to RFS process 17293

RFS[1]: Opened log for thread 1 sequence1102 dbid -925543465 branch 819826777

Thu Oct 23 13:45:15 2014

Primary database is in MAXIMUM AVAILABILITYmode

Standby controlfile consistent with primary

Standby controlfile consistent with primary

RFS[2]: Assigned to RFS process 17297

RFS[2]: Selected log 7 for thread 1sequence 1123 dbid -925543465 branch 819826777

Deleted Oracle managed file+FRA/webdb2/archivelog/2014_10_13/thread_1_seq_1049.350.860808821

Archived Log entry 1104 added for thread 1sequence 1102 rlc 819826777 ID 0xc8d579d3 dest 2:

能够看到主备库恢复心跳。备库能恢复应用日志

打开备库操作:

SQL> alter database open;

数据库已更改。

SQL> select open_mode from v$database;

OPEN_MODE

--------------------

READ ONLY

SQL> ALTER DATABASE RECOVER MANAGEDSTANDBY DATABASE USING CURRENT LOGFILE DISCONNECT;

ALTER DATABASE RECOVER MANAGED STANDBYDATABASE USING CURRENT LOGFILE DISCONNECT

*

第 1 行出现错误:

ORA-01153: 激活了不兼容的介质恢复

SQL> select open_mode from v$database;

OPEN_MODE

--------------------

READ ONLY WITH APPLY

--主库切换日志

SQL> alter system switch logfile;

系统已更改。

--查看日志

主库:

Thu Oct 23 14:19:52 2014

LGWR: Standby redo logfile selected toarchive thread 1 sequence 1125

LGWR: Standby redo logfile selected forthread 1 sequence 1125 for destination LOG_ARCHIVE_DEST_2

Thread 1 advanced to log sequence 1125(LGWR switch)

Current log# 3 seq# 1125 mem# 0:+DATA/webdb/onlinelog/group_3.263.819826787

Current log# 3 seq# 1125 mem# 1:+FRA/webdb/onlinelog/group_3.259.819826789

Thu Oct 23 14:19:53 2014

Archived Log entry 2246 added for thread 1sequence 1124 ID 0xc8d579d3 dest 1:

备库:

Completed: ALTER DATABASE RECOVER MANAGEDSTANDBY DATABASE  THROUGH ALL SWITCHOVERDISCONNECT  USING CURRENT LOGFILE

Thu Oct 23 14:15:51 2014

ALTER DATABASE RECOVER MANAGED STANDBYDATABASE USING CURRENT LOGFILE DISCONNECT

ORA-1153 signalled during: ALTER DATABASERECOVER MANAGED STANDBY DATABASE USING CURRENT LOGFILE DISCONNECT...

Thu Oct 23 14:19:52 2014

Standby controlfile consistent with primary

RFS[2]: Selected log 7 for thread 1sequence 1125 dbid -925543465 branch 819826777

Thu Oct 23 14:19:52 2014

Archived Log entry 1123 added for thread 1sequence 1124 ID 0xc8d579d3 dest 1:

Thu Oct 23 14:19:52 2014

Media Recovery Waiting for thread 1sequence 1125 (in transit)

Recovery of Online Redo Log: Thread 1 Group7 Seq 1125 Reading mem 0

Mem# 0: +DATA/webdb2/onlinelog/group_7.282.819884421

Mem# 1: +FRA/webdb2/onlinelog/group_7.278.819884423

能够看到在仅仅读应用状态open备库后。日志应用仍然正常

--查看DataGuard状态

[oracle@webdb1 trace]$ dgmgrl sys/oracle

DGMGRL for Linux: Version 11.2.0.3.0 -64bit Production

Copyright (c) 2000, 2009, Oracle. Allrights reserved.

欢迎使用 DGMGRL, 要获取有关信息请键入 "help"。

已连接。

DGMGRL> show configuration

配置 - webdb

保护模式:        MaxAvailability

数据库:

webdb  - 主数据库

webdb2 - 物理备用数据库

高速启动故障转移: DISABLED

配置状态:

SUCCESS

总结:

通过报错分析看到,主备不同步跟CPU补丁升级没有直接关系,跟创建的logon on database 触发器有关。

假设在主数据创建一个logon on database tiger。可能会引起主备库不能同步传输日志的问题,

这时。我们要做是把备库又一次mount,然后再open到仅仅读应用状态(READ ONLY WITH APPLY)

由于当备库重新启动后,备库直接启动到仅仅读应用状态(READ ONLY WITH APPLY)。就会出现上面的问题。

參考:

http://www.cnblogs.com/Spiritual-journey/archive/2012/10/21/2732806.html

Logon database Tiger引起DataGuard不同步问题的更多相关文章

  1. 使用Oracle 11g新特性 Active Database Duplication 搭建Dataguard环境

    Duplication Database 介绍 Duplicate database可以按照用途分为2种: duplicate database(复制出一个数据库) duplicate standby ...

  2. dataguard不同步问题ora-16191解决

    公司的11g的dataguard主备不同步,检查步骤如下: Primary:查询主库的最大日志 SQL> select max(sequence#) from v$archived_log;SQ ...

  3. Oracle Database 12c Using duplicate standby database from active database Created Active DataGuard

    primary database db_name=zwc, db_unique_name=zwc standby database db_name=zwc, db_unique_name=standb ...

  4. 11g数据库查看dataguard是否同步

    一.环境      主库:       ip地址:192.168.122.203       oracle根目录:/data/db/oracle       SID:qyq       数据文件路径/ ...

  5. Oracle 10g DataGuard手记之基础配置

    DataGuard为企业数据的高可用性,数据安全以及灾难恢复提供支持,一般由一个primary db与几个物理或逻辑standby db组成一个DataGuard配置. 系统环境 操作系统为windo ...

  6. Oracle 11.2.0.4.0 Dataguard部署和日常维护(2)-Datauard部署篇

    1. primary库设置dataguard相关参数   1.1. 强制primay库在任何状态下必须记录日志 SYS@userdata>select FORCE_LOGGING from v$ ...

  7. 12.2 中的Data Guard Standby 密码文件自动同步 (Doc ID 2307365.1)

    Data Guard Standby Automatic Password file Synchronization in 12.2 (Doc ID 2307365.1) APPLIES TO: Or ...

  8. Oracle DataGuard主库丢失归档日志后备库的RMAN增量恢复一例

    第一部分  问题描述和环境状态确认 ----1. 问题场景 Oracle DataGuard主库丢失archivelog,如何不重建备库完成同步? 在Oracle DataGuard主从同步过程中可能 ...

  9. DG_Oracle DataGuard作用和概念(概念)

    2014-06-03 Created By BaoXinjian  

随机推荐

  1. Java变量和运算符

    1.变量 变量概述 什么是变量?变量是一个内存中的小盒子(小容器),容器是什么?生活中也有很多容器,例如水杯是容器,用来装载水:你家里的大衣柜是容器,用来装载衣裤:饭盒是容器,用来装载饭菜.那么变量是 ...

  2. MySQL笔记(五)之表的连接

    MySql数据库中表的连接一共有如下几种 INNER JOIN 内连接 语法: SELECT column_name(s) FROM table_name1 INNER JOIN table_name ...

  3. 「SCOI2014」方伯伯的商场之旅

    「SCOI2014」方伯伯的商场之旅 题目描述 方伯伯有一天去参加一个商场举办的游戏.商场派了一些工作人员排成一行.每个人面前有几堆石子.说来也巧,位置在 \(i\) 的人面前的第 \(j\) 堆的石 ...

  4. [P3759][TJOI2017]不勤劳的图书管理员(分块+树状数组)

    题目描述 加里敦大学有个帝国图书馆,小豆是图书馆阅览室的一个书籍管理员.他的任务是把书排成有序的,所以无序的书让他产生厌烦,两本乱序的书会让小豆产生 这两本书页数的和的厌烦度.现在有n本被打乱顺序的书 ...

  5. 【DLX算法】hdu3498 whosyourdaddy

    题意:给你一个01矩阵,让你选择尽可能少的行数,使得这些行的并集能够覆盖到所有列. DLX算法求解重复覆盖问题模板,使用估价函数进行剪枝. #include<cstdio> #includ ...

  6. 【lct】poj2763 Housewife Wind

    题意:给你一棵树,边带权,支持两种操作:修改某条边的权值:查询两点之间的最短路. lct主要实现单点修改和路径和. 修改x结点的值只需将x Splay到其所在辅助树的根,然后修改其值,再maintai ...

  7. Block修改变量容易被忽略的方法

    C语言里面的 静态变量 静态全局变量 全局变量 其中静态变量和普通变量的截取模式是一样的,只是因为他赋值不被丢弃,所以能修改成功 code: #import <Foundation/Founda ...

  8. liblinear参数及使用方法(原创)

    开发语言:JAVA 开发工具:eclipse (下载地址 http://www.eclipse.org/downloads/) liblinear版本:liblinear-1.94.jar (下载地址 ...

  9. MySql - GROUP BY 和 HAVING关键字

    本文主要针对GROUP BY 和 HAVING两个关键字进行分析 使用测试表如下: 测试前,只知道GROUP BY 这个关键字的作用是根据一个字段进行分组,去重.HAVING对分组设置条件. 具体分组 ...

  10. ThinkPHP -- 基础入门

      ThinkPHP文件结构说明: |——ThinkPHP.php    框架入口文件    |——Common            框架公共文件目录    |——Conf              ...