GoldenGate Lag For Huge Insert
前些天客户的ogg延迟到达8小时左右。于是我当时用logdump追踪了一下：
看进程状态：
send extsa staus
EXTRACT ZBDBA (PID 2269368)
Current status: Recovery complete: Processing data with empty data queue Current read positions:
Redo thread #: 1
Sequence #: 36694
RBA: 35831764
Timestamp: 2014-10-17 16:18:28.000000
SCN: 3044.3022023259
Redo thread #: 2
Sequence #: 34709
RBA: 403776
Timestamp: 2014-10-17 16:18:28.000000
SCN: 3044.3022023265
Current write position:
Sequence #: 5160
RBA: 168381460
Timestamp: 2014-10-17 17:07:07.339050
Extract Trail: ./dirdat/sa
使用logdump
Logdump 254 >open /goldengate/dirdat/sa005160
Current LogTrail is /goldengate/dirdat/sa005160
Logdump 255 >ghdr on
Logdump 256 >detail on
Logdump 257 >detail data
Logdump 258 >usertoken on
Logdump 259 >pos 168381460
Reading forward from RBA 168381460
Logdump 260 >n
___________________________________________________________________
Hdr-Ind : E (x45) Partition : . (x04)
UndoFlag : . (x00) BeforeAfter: A (x41)
RecLength : 226 (x00e2) IO Time : 2014/10/17 16:18:28.000.000
IOType : 5 (x05) OrigNode : 255 (xff)
TransInd : . (x03) FormatType : R (x52)
SyskeyLen : 0 (x00) Incomplete : . (x00)
AuditRBA : 34709 AuditPos : 369920
Continued : N (x00) RecCount : 1 (x01) 2014/10/17 16:18:28.000.000 Insert Len 226 RBA 168381460
Name: MW_APP.MWT_UD_KW_SJBGJL
After Image: Partition 4 G s
0000 002c 0000 3641 4431 4545 4239 2d32 3830 382d | ...,..6AD1EEB9-2808-
3437 3030 2d42 4335 322d 4342 3936 4132 4130 4234 | 4700-BC52-CB96A2A0B4
3638 2d30 3537 3137 0001 002c 0000 3641 4431 4545 | 68-05717...,..6AD1EE
4239 2d32 3830 382d 3437 3030 2d42 4335 322d 4342 | B9-2808-4700-BC52-CB
3936 4132 4130 4234 3638 2d30 3537 3132 0002 0028 | 96A2A0B468-05712...(
0000 0024 3436 3930 3238 3835 2d39 3745 462d 3444 | ...$46902885-97EF-4D
3644 2d39 4446 322d 4536 3837 4637 3938 3039 3334 | 6D-9DF2-E687F7980934
Column 0 (x0000), Len 44 (x002c)
0000 3641 4431 4545 4239 2d32 3830 382d 3437 3030 | ..6AD1EEB9-2808-4700
2d42 4335 322d 4342 3936 4132 4130 4234 3638 2d30 | -BC52-CB96A2A0B468-0
3537 3137 | 5717
Column 1 (x0001), Len 44 (x002c)
0000 3641 4431 4545 4239 2d32 3830 382d 3437 3030 | ..6AD1EEB9-2808-4700
2d42 4335 322d 4342 3936 4132 4130 4234 3638 2d30 | -BC52-CB96A2A0B468-0
3537 3132 | 5712
Column 2 (x0002), Len 40 (x0028)
0000 0024 3436 3930 3238 3835 2d39 3745 462d 3444 | ...$46902885-97EF-4D
3644 2d39 4446 322d 4536 3837 4637 3938 3039 3334 | 6D-9DF2-E687F7980934
Column 3 (x0003), Len 31 (x001f)
0000 3230 3134 2d31 302d 3137 3a31 363a 3138 3a32 | ..2014-10-17:16:18:2
382e 3631 3335 3436 3030 30 | 8.613546000
Column 4 (x0004), Len 5 (x0005)
0000 0001 30 | ....0
Column 5 (x0005), Len 13 (x000d)
0000 0009 3438 3330 3730 3539 38 | ....483070598
Column 6 (x0006), Len 5 (x0005)
0000 0001 43 | ....C
Column 7 (x0007), Len 4 (x0004)
ffff 0000 | ....
Column 8 (x0008), Len 4 (x0004)
ffff 0000 | .... Logdump 261 >
查看表：
SQL> select count(1) from MW_APP.MWT_UD_KW_SJBGJL; COUNT(1)
----------
1217825 SQL> select count(1) from MW_APP.MWT_UD_KW_SJBGJL; COUNT(1)
----------
1218487 SQL> select count(1) from MW_APP.MWT_UD_KW_SJBGJL; COUNT(1)
----------
1219335
EXTRACT ZBDBA (PID 2269368)
Current status: Recovery complete: Processing data with empty data queue Current read positions:
Redo thread #: 1
Sequence #: 36695
RBA: 36154920
Timestamp: 2014-10-17 16:24:31.000000
SCN: 3044.3022349713
Redo thread #: 2
Sequence #: 34712
RBA: 940508
Timestamp: 2014-10-17 16:24:31.000000
SCN: 3044.3022349707
Current write position:
Sequence #: 5161
RBA: 79119190
Timestamp: 2014-10-17 17:15:30.448658
Extract Trail: ./dirdat/sa Logdump 261 >open /goldengate/dirdat/sa005161
Current LogTrail is /goldengate/dirdat/sa005161
Logdump 262 >ghdr on
Logdump 263 >detail on
Logdump 264 >detail data
Logdump 265 >usertoken on
Logdump 266 >pos
Current position is RBA 0 Forward
Logdump 267 >pos 79119190
Reading forward from RBA 79119190
Logdump 268 >n
___________________________________________________________________
Hdr-Ind : E (x45) Partition : . (x04)
UndoFlag : . (x00) BeforeAfter: A (x41)
RecLength : 124 (x007c) IO Time : 2014/10/17 16:24:31.000.000
IOType : 5 (x05) OrigNode : 255 (xff)
TransInd : . (x03) FormatType : R (x52)
SyskeyLen : 0 (x00) Incomplete : . (x00)
AuditRBA : 34712 AuditPos : 942196
Continued : N (x00) RecCount : 1 (x01) 2014/10/17 16:24:31.000.000 Insert Len 124 RBA 79119190
Name: MW_APP.MWT_CBM_ZTLBGGL
After Image: Partition 4 G s
0000 002e 0000 002a 3538 3846 3634 4231 2d37 3938 | .......*588F64B1-798
452d 3444 3131 2d41 3930 332d 3546 3446 4130 4632 | E-4D11-A903-5F4FA0F2
3236 3033 2d33 3634 3938 0001 000d 0000 0009 3438 | 2603-36498........48
3331 3238 3538 3300 0200 04ff ff00 0000 0300 04ff | 3128583.............
ff00 0000 0400 04ff ff00 0000 0500 15ff ff31 3930 | .................190
302d 3031 2d30 313a 3030 3a30 303a 3030 0006 0004 | 0-01-01:00:00:00....
ffff 0000 | ....
Column 0 (x0000), Len 46 (x002e)
0000 002a 3538 3846 3634 4231 2d37 3938 452d 3444 | ...*588F64B1-798E-4D
3131 2d41 3930 332d 3546 3446 4130 4632 3236 3033 | 11-A903-5F4FA0F22603
2d33 3634 3938 | -36498
Column 1 (x0001), Len 13 (x000d)
0000 0009 3438 3331 3238 3538 33 | ....483128583
Column 2 (x0002), Len 4 (x0004)
ffff 0000 | ....
Column 3 (x0003), Len 4 (x0004)
ffff 0000 | ....
Column 4 (x0004), Len 4 (x0004)
ffff 0000 | ....
Column 5 (x0005), Len 21 (x0015)
ffff 3139 3030 2d30 312d 3031 3a30 303a 3030 3a30 | ..1900-01-01:00:00:0
30 | 0
Column 6 (x0006), Len 4 (x0004)
ffff 0000 SQL> SQL> select count(1) from MW_APP.MWT_UD_KW_SJBGJL; COUNT(1)
----------
1220223 GGSCI (pmsnxdb1) 97> !
send ZBDBA status Sending STATUS request to EXTRACT ZBDBA ... EXTRACT ZBDBA (PID 2269368)
Current status: Recovery complete: Processing data Current read positions:
Redo thread #: 1
Sequence #: 36700
RBA: 4528776
Timestamp: 2014-10-17 17:18:05.000000
SCN: 3044.3023151974
Redo thread #: 2
Sequence #: 34724
RBA: 87547776
Timestamp: 2014-10-17 17:18:06.000000
SCN: 3044.3023152070
Current write position:
Sequence #: 5165
RBA: 109446515
Timestamp: 2014-10-17 17:29:26.994375
Extract Trail: ./dirdat/sa Logdump 269 >open /goldengate/dirdat/sa005165
Current LogTrail is /goldengate/dirdat/sa005165
Logdump 270 >ghdr on
Logdump 271 >detail on
Logdump 272 >detail data
Logdump 273 >usertoken on
Logdump 274 >pos 109446515
Reading forward from RBA 109446515
Logdump 275 >n
___________________________________________________________________
Hdr-Ind : E (x45) Partition : . (x04)
UndoFlag : . (x00) BeforeAfter: A (x41)
RecLength : 176 (x00b0) IO Time : 2014/10/17 17:12:19.000.000
IOType : 15 (x0f) OrigNode : 255 (xff)
TransInd : . (x03) FormatType : R (x52)
SyskeyLen : 0 (x00) Incomplete : . (x00)
AuditRBA : 34724 AuditPos : 1235984
Continued : N (x00) RecCount : 1 (x01) 2014/10/17 17:12:19.000.000 FieldComp Len 176 RBA 109446515
Name: MW_SYS.MWT_AM_HISMENU
After Image: Partition 4 G s
0000 0026 0000 4245 4642 4246 3243 2d45 3532 342d | ...&..BEFBBF2C-E524-
3441 3641 2d39 3738 412d 3233 3545 3343 3431 3744 | 4A6A-978A-235E3C417D
4439 0001 0026 0000 4436 4539 3631 4545 2d36 4331 | D9...&..D6E961EE-6C1
362d 3437 3138 2d41 4135 342d 3245 3146 3738 4531 | 6-4718-AA54-2E1F78E1
4441 4145 0002 0007 0000 0003 3238 3200 0300 1f00 | DAAE........282.....
0032 3031 312d 3034 2d31 313a 3038 3a35 303a 3239 | .2011-04-11:08:50:29
2e32 3637 3030 3030 3030 0004 0003 0000 4300 0500 | .267000000......C...
Column 0 (x0000), Len 38 (x0026)
0000 4245 4642 4246 3243 2d45 3532 342d 3441 3641 | ..BEFBBF2C-E524-4A6A
2d39 3738 412d 3233 3545 3343 3431 3744 4439 | -978A-235E3C417DD9
Column 1 (x0001), Len 38 (x0026)
0000 4436 4539 3631 4545 2d36 4331 362d 3437 3138 | ..D6E961EE-6C16-4718
2d41 4135 342d 3245 3146 3738 4531 4441 4145 | -AA54-2E1F78E1DAAE
Column 2 (x0002), Len 7 (x0007)
0000 0003 3238 32 | ....282
Column 3 (x0003), Len 31 (x001f)
0000 3230 3131 2d30 342d 3131 3a30 383a 3530 3a32 | ..2011-04-11:08:50:2
392e 3236 3730 3030 3030 30 | 9.267000000
Column 4 (x0004), Len 3 (x0003)
0000 43 | ..C
Column 5 (x0005), Len 14 (x000e)
0000 000a b9a4 d7f7 c6b1 b9dc c0ed | ..............
Column 6 (x0006), Len 4 (x0004)
ffff 0000 | ....
Column 7 (x0007), Len 9 (x0009)
0000 0005 3939 3434 32 | ....99442
MW_APP用户下的MWT_UD_KW_SJBGJL做大量插入操作没有提交。当日志重用迫使事物提交
所以经过多次切换日志，延迟减小。 GGSCI (pmsnxdb1) 100> info all Program Status Group Lag at Chkpt Time Since Chkpt MANAGER RUNNING
EXTRACT RUNNING ZBCXY 00:00:00 00:00:03
EXTRACT RUNNING ZBDBA 00:03:46 00:00:09
GoldenGate Lag For Huge Insert的更多相关文章
- kettle用mysql创建资源库执行sql代码报错
一.原因: sql语句里边使用 'Y' 'N' 给boolean类型的赋值产生sql失败 二.解决方法:将insert语句中‘Y’或‘N’ 改成TRUE或FALSE即可,共两张表3个地方 ...
- 学习笔记：Rick's RoTs -- Rules of Thumb for MySQL
Table of Contents SELECTs -- do's and don'tsINDEXingENGINE DifferencesOptimizations, and notPARTITIO ...
- Rick's RoTs -- Rules of Thumb for MySQL--转载
原文地址:http://mysql.rjweb.org/doc.php/ricksrots Brought to you by Rick James Here are 160+ tips, trick ...
- 省市区三级-sql脚本：
/*Navicat MySQL Data Transfer Source Server : moiraiSource Server Version : 50631Source Host : 192.1 ...
- 76 道 Oracle Goldengate 面试问题
基础 12c新特性 性能 Troubleshoot 其它 1. Oracle Goldengate 支持部署到哪些拓扑? GoldenGate supports the following topol ...
- Track 造成Goldengate abended的那条record
Email收到了这样的报错: 2016-12-07 02:52:22 WARNING OGG-01004 Aborted grouped transaction on 'MSP.USER_ACTI ...
- 搭建GoldenGate的单向复制环境
配置环境: 建议在相同版本OGG(即Oracle GoldenGate)之间进行复制,我在这里之所以选择不同版本的OGG,便于后续的比较学习. 一.准备OGG的运行用户 在这里,我直接使用oracle ...
- GOLDENGATE 配置文档，各类参数--转发
1 GoldenGate简要说明 GoldenGate现在是业内成熟的数据容灾与复制产品,经过多年的发展与完善,现在已经成为业内事实上的标准之一. GoldenGate软件是一种基于日志的 ...
- 关于Oracle GoldenGate中Extract的checkpoint的理解 转载
什么是checkpoint? 在Oracle 数据库中checkpoint的意思是将内存中的脏数据强制写入到磁盘的事件,其作用是保持内存中的数据与磁盘上的数据一致.SCN是用来描述该事件发生的准确的时 ...
随机推荐
- [BZOJ4537][Hnoi2016]最小公倍数 奇怪的分块+可撤销并查集
4537: [Hnoi2016]最小公倍数 Time Limit: 40 Sec Memory Limit: 512 MBSubmit: 1474 Solved: 521[Submit][Stat ...
- 内部网络出口防火墙导致TCP类扫描异常
测试过程中确认,由于内部网络出口防火墙存在连接数等策略限制,会导致TCP类扫描出现异常,表现为大量误报. Nessus.nmap.synscan均存在此现象.
- （二）centos7安装zabbix agentd端
关闭防火墙和selinux systemctl stop firewalld systemctl disable firewalld sed -ri '/^SELINUX=/cSELINUX=disa ...
- Spring创建对象的原理
当容器启动时,首先会加载给定的配置文件,将配置文件逐行解析.当解析到bean标签时,根据class属性的值,通过反射调用创建对象. 将创建好的对象存储到Spring自身维护的Map当中.map中的ke ...
- Unity中Instantiate物体失效问题
才开始学Unity,开始总是这样用Instantiate函数: GameObject temp = (GameObject)Instantiate(bulletSource, transform.po ...
- Django+ openpyxl 导出文件，设置表头／内容格式
之前使用xlrd.xlrt处理文件的导入导出,这两个主要用于excel2003格式的文件的读写,并且xlrt最多可以写入256行,大于256行会报错 找了新插件openpyxl,对它找到针对某一行设置 ...
- 二维偏序+树状数组【P3431】[POI2005]AUT-The Bus
Description Byte City 的街道形成了一个标准的棋盘网络 – 他们要么是北南走向要么就是西东走向. 北南走向的路口从 1 到 n编号, 西东走向的路从1 到 m编号. 每个路口用两个 ...
- Oracle 后台进程
一.基本后台进程 1.数据库写入进程(DBWn): 数据库写入程序讲数据库告诉缓存区中的修改块写入数据文件.对于多数系统来说,一个数据库写入程序(DBW0)就已经足够,但是对于 ...
- Spring MVC的工作机制
1. Spring MVC请所有的请求都提交给DispatcherServlet,它会委托应用系统的其他模块负责负责对请求进行真正的处理工作. 2. DispatcherServlet查询一个或多个H ...
- 【博弈论】【SG函数】poj2311 Cutting Game
由于异或运算满足结合律,我们把当前状态的SG函数定义为 它所能切割成的所有纸片对的两两异或和之外的最小非负整数. #include<cstdio> #include<set> ...