数据库rac启动时报错,日志例如以下,后来使用
Sat Jun  7 06:02:11 2014
GATHER_STATS_JOB encountered errors.  Check the trace file.
Sat Jun  7 06:02:11 2014
Errors in file /oracle/product/admin/dqb/bdump/dqb2_j001_13352.trc:
ORA-08103: object no longer exists
Sat Jun  7 06:02:51 2014
Thread 2 advanced to log sequence 13292 (LGWR switch)
  Current log# 4 seq# 13292 mem# 0: +DG/dqb/onlinelog/group_4.266.803845083
Sat Jun  7 06:32:10 2014
Trace dumping is performing id=[cdmp_20140607063209]
Sat Jun  7 07:01:33 2014
Errors in file /oracle/product/admin/dqb/bdump/dqb2_j000_6797.trc:
ORA-00600: internal error code, arguments: [6749], [3], [12662723], [109], [], [], [], []
Sat Jun  7 07:01:35 2014
Trace dumping is performing id=[cdmp_20140607070135]
Sat Jun  7 07:39:01 2014
Errors in file /oracle/product/admin/dqb/udump/dqb2_ora_24893.trc:
ORA-00600: internal error code, arguments: [kdsgrp1], [], [], [], [], [], [], []
Sat Jun  7 07:39:04 2014
Trace dumping is performing id=[cdmp_20140607073904]
Sat Jun  7 08:00:42 2014
Trace dumping is performing id=[cdmp_20140607080042]
Sat Jun  7 08:30:13 2014
Trace dumping is performing id=[cdmp_20140607083013]
Sat Jun  7 09:00:43 2014
Trace dumping is performing id=[cdmp_20140607090043]
Sat Jun  7 09:36:24 2014
Trace dumping is performing id=[cdmp_20140607093623]
Sat Jun  7 10:00:46 2014
Trace dumping is performing id=[cdmp_20140607100046]
Sat Jun  7 10:38:31 2014
Trace dumping is performing id=[cdmp_20140607103831]
Sat Jun  7 11:00:52 2014
Trace dumping is performing id=[cdmp_20140607110051]
Sat Jun  7 11:37:40 2014
Errors in file /oracle/product/admin/dqb/udump/dqb2_ora_18978.trc:
ORA-00600: internal error code, arguments: [kdsgrp1], [], [], [], [], [], [], []
Sat Jun  7 11:37:43 2014
Trace dumping is performing id=[cdmp_20140607113743]
Sat Jun  7 12:00:51 2014
Trace dumping is performing id=[cdmp_20140607120050]
Sat Jun  7 12:38:58 2014
Trace dumping is performing id=[cdmp_20140607123858]
Sat Jun  7 13:00:56 2014
Trace dumping is performing id=[cdmp_20140607130056]
Sat Jun  7 13:39:25 2014
Errors in file /oracle/product/admin/dqb/udump/dqb2_ora_31749.trc:
ORA-00600: internal error code, arguments: [kdsgrp1], [], [], [], [], [], [], []
Sat Jun  7 13:39:28 2014
Trace dumping is performing id=[cdmp_20140607133928]
Sat Jun  7 13:44:08 2014
Thread 2 advanced to log sequence 13293 (LGWR switch)
  Current log# 3 seq# 13293 mem# 0: +DG/dqb/onlinelog/group_3.268.803845083
Sat Jun  7 14:00:59 2014
Trace dumping is performing id=[cdmp_20140607140058]
Sat Jun  7 14:38:47 2014
Errors in file /oracle/product/admin/dqb/udump/dqb2_ora_5659.trc:
ORA-00600: internal error code, arguments: [kdsgrp1], [], [], [], [], [], [], []
Sat Jun  7 14:38:48 2014
Trace dumping is performing id=[cdmp_20140607143848]
Sat Jun  7 15:00:44 2014
Trace dumping is performing id=[cdmp_20140607150043]
Sat Jun  7 15:34:03 2014
Errors in file /oracle/product/admin/dqb/udump/dqb2_ora_12186.trc:
ORA-00600: internal error code, arguments: [kdsgrp1], [], [], [], [], [], [], []
Sat Jun  7 15:34:05 2014
Trace dumping is performing id=[cdmp_20140607153405]
Sat Jun  7 15:43:52 2014
Thread 2 advanced to log sequence 13294 (LGWR switch)
  Current log# 4 seq# 13294 mem# 0: +DG/dqb/onlinelog/group_4.266.803845083
Sat Jun  7 16:02:14 2014
Errors in file /oracle/product/admin/dqb/bdump/dqb2_j001_13352.trc:
ORA-00600: internal error code, arguments: [6749], [3], [12662723], [109], [], [], [], []
Sat Jun  7 16:02:19 2014
Trace dumping is performing id=[cdmp_20140607160219]
Sat Jun  7 16:03:35 2014
Thread 2 advanced to log sequence 13295 (LGWR switch)
  Current log# 3 seq# 13295 mem# 0: +DG/dqb/onlinelog/group_3.268.803845083
Sat Jun  7 16:40:00 2014
Trace dumping is performing id=[cdmp_20140607164000]
Sat Jun  7 17:01:30 2014
Errors in file /oracle/product/admin/dqb/bdump/dqb2_j001_13352.trc:
ORA-00600: internal error code, arguments: [6749], [3], [12662723], [109], [], [], [], []
Sat Jun  7 17:01:33 2014
Trace dumping is performing id=[cdmp_20140607170133]
Sat Jun  7 17:32:37 2014
Trace dumping is performing id=[cdmp_20140607173236]
Sat Jun  7 18:01:51 2014
Errors in file /oracle/product/admin/dqb/bdump/dqb2_j001_13352.trc:
ORA-00600: internal error code, arguments: [6749], [3], [12662723], [109], [], [], [], []
Sat Jun  7 18:01:53 2014
Trace dumping is performing id=[cdmp_20140607180153]
Sat Jun  7 18:29:15 2014
Thread 2 advanced to log sequence 13296 (LGWR switch)
  Current log# 4 seq# 13296 mem# 0: +DG/dqb/onlinelog/group_4.266.803845083
Sat Jun  7 18:30:52 2014
Errors in file /oracle/product/admin/dqb/udump/dqb2_ora_19302.trc:
Sat Jun  7 18:30:54 2014
Trace dumping is performing id=[cdmp_20140607183054]
Sat Jun  7 18:30:58 2014
Errors in file /oracle/product/admin/dqb/udump/dqb2_ora_19300.trc:
Sat Jun  7 18:31:05 2014
Errors in file /oracle/product/admin/dqb/udump/dqb2_ora_19300.trc:
Sat Jun  7 18:42:14 2014
Errors in file /oracle/product/admin/dqb/udump/dqb2_ora_31207.trc:
ORA-00600: internal error code, arguments: [kdsgrp1], [], [], [], [], [], [], []
Sat Jun  7 18:42:20 2014
Trace dumping is performing id=[cdmp_20140607184220]
Sat Jun  7 19:00:04 2014
Trace dumping is performing id=[cdmp_20140607190003]
Sat Jun  7 19:31:17 2014
Errors in file /oracle/product/admin/dqb/udump/dqb2_ora_4965.trc:
ORA-00600: internal error code, arguments: [kdsgrp1], [], [], [], [], [], [], []
Sat Jun  7 19:31:18 2014
Trace dumping is performing id=[cdmp_20140607193118]
Sat Jun  7 20:00:42 2014
Trace dumping is performing id=[cdmp_20140607200042]
Sat Jun  7 20:31:30 2014
Errors in file /oracle/product/admin/dqb/udump/dqb2_ora_11315.trc:
ORA-00600: internal error code, arguments: [kdsgrp1], [], [], [], [], [], [], []
Sat Jun  7 20:31:32 2014
Trace dumping is performing id=[cdmp_20140607203132]
Sat Jun  7 21:33:02 2014
Trace dumping is performing id=[cdmp_20140607213302]
Sat Jun  7 22:02:16 2014
Errors in file /oracle/product/admin/dqb/bdump/dqb2_j000_6797.trc:
ORA-00600: internal error code, arguments: [6749], [3], [12662723], [109], [], [], [], []
Sat Jun  7 22:17:00 2014
Thread 2 advanced to log sequence 13297 (LGWR switch)
  Current log# 3 seq# 13297 mem# 0: +DG/dqb/onlinelog/group_3.268.803845083
Sat Jun  7 22:30:38 2014
Trace dumping is performing id=[cdmp_20140607223037]
Sat Jun  7 23:01:21 2014
Errors in file /oracle/product/admin/dqb/bdump/dqb2_j001_13352.trc:
ORA-00600: internal error code, arguments: [6749], [3], [12662723], [109], [], [], [], []
Sat Jun  7 23:01:25 2014
Trace dumping is performing id=[cdmp_20140607230125]
Sat Jun  7 23:30:33 2014
Trace dumping is performing id=[cdmp_20140607233032]
Sun Jun  8 00:00:38 2014
Trace dumping is performing id=[cdmp_20140608000038]
Sun Jun  8 00:39:30 2014
Trace dumping is performing id=[cdmp_20140608003930]
Sun Jun  8 01:00:36 2014
Trace dumping is performing id=[cdmp_20140608010036]
Sun Jun  8 01:45:14 2014
Trace dumping is performing id=[cdmp_20140608014514]
Sun Jun  8 02:00:41 2014
Trace dumping is performing id=[cdmp_20140608020041]
Sun Jun  8 02:36:03 2014
Trace dumping is performing id=[cdmp_20140608023603]
Sun Jun  8 03:31:51 2014
Errors in file /oracle/product/admin/dqb/udump/dqb2_ora_24887.trc:
ORA-00600: internal error code, arguments: [kdsgrp1], [], [], [], [], [], [], []
Sun Jun  8 03:31:54 2014
Trace dumping is performing id=[cdmp_20140608033154]
Sun Jun  8 04:05:37 2014
>>> WAITED TOO LONG FOR A ROW CACHE ENQUEUE LOCK! pid=54
System State dumped to trace file /oracle/product/admin/dqb/bdump/dqb2_mmon_1398.trc
Sun Jun  8 04:47:15 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 04:47:15 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 04:47:15 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 04:47:15 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 04:47:15 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 04:47:15 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 04:47:15 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 04:47:15 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 04:47:15 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 04:47:15 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 04:47:15 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 04:47:15 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 04:47:15 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 04:47:15 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 04:47:15 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 04:47:15 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 04:47:15 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 04:47:15 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 04:47:15 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 04:47:15 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 04:47:15 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 04:47:15 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 04:47:15 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 04:47:15 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 04:47:15 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 04:47:15 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 04:47:15 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 04:47:15 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 04:47:15 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 04:47:15 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 04:47:15 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 04:47:15 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 04:47:15 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 04:47:15 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 04:47:15 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 04:47:15 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 04:47:15 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 04:47:15 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 04:47:15 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 04:47:15 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 04:47:15 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 04:47:15 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 04:47:15 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 04:47:15 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 04:47:15 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 04:47:15 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 04:47:15 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 04:47:15 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 04:47:15 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 04:47:15 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 04:47:15 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 04:47:15 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 04:47:15 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 04:47:15 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 04:47:15 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 04:47:15 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 04:47:15 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 04:47:15 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 04:47:15 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 04:47:15 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 04:47:15 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 04:47:15 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 04:47:15 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 04:47:15 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 04:47:15 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 04:47:15 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 04:47:15 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 04:47:15 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 04:47:15 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 04:47:15 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 04:47:15 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 04:47:15 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 04:47:15 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 04:47:15 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 04:47:15 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 04:47:15 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 04:47:15 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 04:47:15 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 04:47:15 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 04:47:15 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 04:47:15 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 04:47:15 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 04:47:15 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 04:47:15 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 04:47:15 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 04:47:15 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 04:47:15 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 04:47:15 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 04:47:15 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 04:47:15 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 04:47:15 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 04:47:15 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 04:47:15 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 04:47:15 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 04:47:15 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 04:47:15 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 04:47:15 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 04:47:15 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 04:47:15 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 04:47:15 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 04:47:15 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 04:47:15 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 04:47:15 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 04:47:15 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 04:47:15 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 04:47:15 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 04:47:15 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 04:47:15 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 04:47:15 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 04:47:15 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 04:47:15 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 04:47:15 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 04:47:15 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 04:47:15 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 04:47:15 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 04:47:15 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 04:47:15 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 04:47:15 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 04:47:15 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 04:47:15 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 04:47:15 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 04:47:15 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 04:47:15 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 04:47:15 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 04:47:15 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 04:47:15 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 04:47:15 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 04:47:15 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 04:47:15 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 04:47:15 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 04:47:15 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 04:47:15 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 04:47:15 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 04:47:15 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 04:47:15 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 04:47:15 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 04:47:15 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 04:47:15 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 04:47:15 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 04:47:15 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 04:47:15 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 04:47:15 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 04:47:15 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 04:47:15 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 04:47:15 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 04:47:15 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 04:47:15 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 04:47:15 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 04:47:15 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 04:47:15 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 04:47:15 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 04:47:15 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 04:47:15 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 04:47:15 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 04:47:15 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 04:47:15 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 04:47:15 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 04:47:15 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 04:47:15 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 04:47:15 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 04:47:15 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 04:47:15 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 04:47:20 2014
Trace dumping is performing id=[cdmp_20140608044719]
Sun Jun  8 05:00:22 2014
Trace dumping is performing id=[cdmp_20140608050022]
Sun Jun  8 05:39:23 2014
Trace dumping is performing id=[cdmp_20140608053922]
Sun Jun  8 06:00:28 2014
Trace dumping is performing id=[cdmp_20140608060027]
Sun Jun  8 06:32:45 2014
Trace dumping is performing id=[cdmp_20140608063245]
Sun Jun  8 07:00:30 2014
Trace dumping is performing id=[cdmp_20140608070030]
Sun Jun  8 07:11:17 2014
Thread 2 advanced to log sequence 13298 (LGWR switch)
  Current log# 4 seq# 13298 mem# 0: +DG/dqb/onlinelog/group_4.266.803845083
Sun Jun  8 07:30:12 2014
Errors in file /oracle/product/admin/dqb/udump/dqb2_ora_6955.trc:
ORA-00600: internal error code, arguments: [kdsgrp1], [], [], [], [], [], [], []
Sun Jun  8 07:30:15 2014
Trace dumping is performing id=[cdmp_20140608073015]
Sun Jun  8 08:00:32 2014
Trace dumping is performing id=[cdmp_20140608080031]
Sun Jun  8 08:30:04 2014
Trace dumping is performing id=[cdmp_20140608083004]
Sun Jun  8 09:36:04 2014
Trace dumping is performing id=[cdmp_20140608093604]
Sun Jun  8 10:00:27 2014
Trace dumping is performing id=[cdmp_20140608100026]
Sun Jun  8 10:35:29 2014
Trace dumping is performing id=[cdmp_20140608103528]
Sun Jun  8 11:00:32 2014
Trace dumping is performing id=[cdmp_20140608110031]
Sun Jun  8 11:31:07 2014
Errors in file /oracle/product/admin/dqb/udump/dqb2_ora_32192.trc:
ORA-00600: internal error code, arguments: [kdsgrp1], [], [], [], [], [], [], []
Sun Jun  8 11:31:13 2014
Trace dumping is performing id=[cdmp_20140608113113]
Sun Jun  8 12:39:37 2014
Errors in file /oracle/product/admin/dqb/udump/dqb2_ora_5862.trc:
ORA-00600: internal error code, arguments: [kdsgrp1], [], [], [], [], [], [], []
Sun Jun  8 12:39:38 2014
Trace dumping is performing id=[cdmp_20140608123938]
Sun Jun  8 13:00:20 2014
Trace dumping is performing id=[cdmp_20140608130020]
Sun Jun  8 13:40:14 2014
Trace dumping is performing id=[cdmp_20140608134014]
Sun Jun  8 14:00:21 2014
Trace dumping is performing id=[cdmp_20140608140020]
Sun Jun  8 14:35:35 2014
Trace dumping is performing id=[cdmp_20140608143534]
Sun Jun  8 15:34:51 2014
>>> WAITED TOO LONG FOR A ROW CACHE ENQUEUE LOCK! pid=54
System State dumped to trace file /oracle/product/admin/dqb/bdump/dqb2_mmon_1398.trc
Sun Jun  8 15:37:47 2014
Errors in file /oracle/product/admin/dqb/udump/dqb2_ora_25433.trc:
ORA-00600: internal error code, arguments: [kdsgrp1], [], [], [], [], [], [], []
Sun Jun  8 15:37:50 2014
Trace dumping is performing id=[cdmp_20140608153750]
Sun Jun  8 16:13:50 2014
>>> WAITED TOO LONG FOR A ROW CACHE ENQUEUE LOCK! pid=121
System State dumped to trace file /oracle/product/admin/dqb/udump/dqb2_ora_11844.trc
Sun Jun  8 16:58:04 2014
>>> WAITED TOO LONG FOR A ROW CACHE ENQUEUE LOCK! pid=136
System State dumped to trace file /oracle/product/admin/dqb/udump/dqb2_ora_25750.trc
Sun Jun  8 21:36:19 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 21:36:19 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 21:36:19 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 21:36:19 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 21:36:19 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 21:36:19 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 21:36:19 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 21:36:19 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 21:36:19 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 21:36:19 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 21:36:19 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 21:36:19 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 21:36:19 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 21:36:19 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 21:36:19 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 21:36:19 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 21:36:19 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 21:36:19 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 21:36:19 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 21:36:19 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 21:36:19 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 21:36:19 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 21:36:19 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 21:36:19 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 21:36:19 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 21:36:19 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 21:36:19 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 21:36:19 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 21:36:19 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 21:36:19 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 21:36:19 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 21:36:19 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 21:36:19 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 21:36:19 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 21:36:19 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 21:36:19 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 21:36:19 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 21:36:19 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 21:36:19 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 21:36:19 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 21:36:19 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 21:36:19 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 21:36:19 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 21:36:19 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 21:36:19 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 21:36:19 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 21:36:19 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 21:36:19 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 21:36:19 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 21:36:19 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 21:36:19 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 21:36:19 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 21:36:19 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 21:36:19 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 21:36:19 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 21:36:19 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 21:36:19 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 21:36:19 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 21:36:19 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 21:36:19 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 21:36:19 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 21:36:19 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 21:36:19 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 21:36:19 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 21:36:19 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 21:36:19 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 21:36:19 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 21:36:19 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 21:36:19 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 21:36:19 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 21:36:19 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 21:36:19 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 21:36:19 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 21:36:19 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 21:36:19 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 21:36:19 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 21:36:19 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 21:36:19 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 21:36:19 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 21:36:19 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 21:36:19 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 21:36:19 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 21:36:19 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 21:36:19 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 21:36:19 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 21:36:19 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 21:36:19 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 21:36:19 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 21:36:19 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 21:36:19 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 21:36:19 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 21:36:19 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 21:36:19 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 21:36:19 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 21:36:19 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 21:36:19 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 21:36:19 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 21:36:19 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 21:36:19 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 21:36:19 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 21:36:19 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 21:36:19 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 21:36:19 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 21:36:19 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 21:36:19 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 21:36:19 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 21:36:19 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 21:36:19 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 21:36:19 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 21:36:19 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 21:36:19 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 21:36:19 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 21:36:19 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 21:36:19 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 21:36:19 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 21:36:19 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 21:36:19 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 21:36:19 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 21:36:19 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 21:36:19 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 21:36:19 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 21:36:19 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 21:36:19 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 21:36:19 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 21:36:19 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 21:36:19 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 21:36:19 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 21:36:19 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 21:36:19 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 21:36:19 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 21:36:19 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 21:36:19 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 21:36:19 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 21:36:19 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 21:36:19 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 21:36:19 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 21:36:19 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 21:36:19 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 21:36:19 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 21:36:19 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 21:36:19 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 21:36:19 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 21:36:19 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 21:36:19 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 21:36:19 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 21:36:19 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 21:36:19 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 21:36:19 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 21:36:19 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 21:36:19 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 21:36:19 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 21:36:19 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 21:36:19 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 21:36:19 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 21:36:19 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 21:36:19 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 21:36:19 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 21:36:19 2014
WARNING: inbound connection timed out (ORA-3136)
Sun Jun  8 21:36:21 2014
Trace dumping is performing id=[cdmp_20140608213621]
Sun Jun  8 21:36:22 2014
Thread 2 advanced to log sequence 13299 (LGWR switch)
  Current log# 3 seq# 13299 mem# 0: +DG/dqb/onlinelog/group_3.268.803845083
Sun Jun  8 22:00:15 2014
Trace dumping is performing id=[cdmp_20140608220015]
Sun Jun  8 22:40:03 2014
Errors in file /oracle/product/admin/dqb/udump/dqb2_ora_22234.trc:
ORA-00600: internal error code, arguments: [kdsgrp1], [], [], [], [], [], [], []
Sun Jun  8 22:40:06 2014
Trace dumping is performing id=[cdmp_20140608224006]
Sun Jun  8 23:00:18 2014
Trace dumping is performing id=[cdmp_20140608230018]
Sun Jun  8 23:29:52 2014
Errors in file /oracle/product/admin/dqb/udump/dqb2_ora_27653.trc:
ORA-00600: internal error code, arguments: [kdsgrp1], [], [], [], [], [], [], []
Sun Jun  8 23:29:53 2014
Trace dumping is performing id=[cdmp_20140608232953]
Mon Jun  9 00:44:11 2014
Errors in file /oracle/product/admin/dqb/udump/dqb2_ora_30862.trc:
ORA-00600: internal error code, arguments: [kdsgrp1], [], [], [], [], [], [], []
Mon Jun  9 00:44:15 2014
Trace dumping is performing id=[cdmp_20140609004415]
Mon Jun  9 01:24:41 2014
>>> WAITED TOO LONG FOR A ROW CACHE ENQUEUE LOCK! pid=174
System State dumped to trace file /oracle/product/admin/dqb/udump/dqb2_ora_13953.trc
Mon Jun  9 05:56:22 2014
WARNING: inbound connection timed out (ORA-3136)
Mon Jun  9 05:56:22 2014
WARNING: inbound connection timed out (ORA-3136)
Mon Jun  9 05:56:22 2014
WARNING: inbound connection timed out (ORA-3136)
Mon Jun  9 05:56:22 2014
WARNING: inbound connection timed out (ORA-3136)
Mon Jun  9 05:56:22 2014
WARNING: inbound connection timed out (ORA-3136)
Mon Jun  9 05:56:22 2014
WARNING: inbound connection timed out (ORA-3136)
Mon Jun  9 05:56:22 2014
WARNING: inbound connection timed out (ORA-3136)
Mon Jun  9 05:56:22 2014
WARNING: inbound connection timed out (ORA-3136)
Mon Jun  9 05:56:22 2014
WARNING: inbound connection timed out (ORA-3136)
Mon Jun  9 05:56:22 2014
WARNING: inbound connection timed out (ORA-3136)
Mon Jun  9 05:56:22 2014
WARNING: inbound connection timed out (ORA-3136)
Mon Jun  9 05:56:22 2014
WARNING: inbound connection timed out (ORA-3136)
Mon Jun  9 05:56:22 2014
WARNING: inbound connection timed out (ORA-3136)
Mon Jun  9 05:56:22 2014
WARNING: inbound connection timed out (ORA-3136)
Mon Jun  9 05:56:22 2014
WARNING: inbound connection timed out (ORA-3136)
Mon Jun  9 05:56:22 2014
WARNING: inbound connection timed out (ORA-3136)
Mon Jun  9 05:56:22 2014
WARNING: inbound connection timed out (ORA-3136)
Mon Jun  9 05:56:22 2014
WARNING: inbound connection timed out (ORA-3136)
Mon Jun  9 05:56:22 2014
WARNING: inbound connection timed out (ORA-3136)
Mon Jun  9 05:56:22 2014
WARNING: inbound connection timed out (ORA-3136)
Mon Jun  9 05:56:22 2014
WARNING: inbound connection timed out (ORA-3136)
Mon Jun  9 05:56:22 2014
WARNING: inbound connection timed out (ORA-3136)
Mon Jun  9 05:56:22 2014
WARNING: inbound connection timed out (ORA-3136)
Mon Jun  9 05:56:22 2014
WARNING: inbound connection timed out (ORA-3136)
Mon Jun  9 05:56:22 2014
WARNING: inbound connection timed out (ORA-3136)
Mon Jun  9 05:56:22 2014
WARNING: inbound connection timed out (ORA-3136)
Mon Jun  9 05:56:22 2014
WARNING: inbound connection timed out (ORA-3136)
Mon Jun  9 05:56:22 2014
WARNING: inbound connection timed out (ORA-3136)
Mon Jun  9 05:56:22 2014
WARNING: inbound connection timed out (ORA-3136)
Mon Jun  9 05:56:22 2014
WARNING: inbound connection timed out (ORA-3136)
Mon Jun  9 05:56:22 2014
WARNING: inbound connection timed out (ORA-3136)
Mon Jun  9 05:56:22 2014
WARNING: inbound connection timed out (ORA-3136)
Mon Jun  9 05:56:22 2014
WARNING: inbound connection timed out (ORA-3136)
Mon Jun  9 05:56:22 2014
WARNING: inbound connection timed out (ORA-3136)
Mon Jun  9 05:56:22 2014
WARNING: inbound connection timed out (ORA-3136)
Mon Jun  9 05:56:22 2014
WARNING: inbound connection timed out (ORA-3136)
Mon Jun  9 05:56:22 2014
WARNING: inbound connection timed out (ORA-3136)
Mon Jun  9 05:56:22 2014
WARNING: inbound connection timed out (ORA-3136)
Mon Jun  9 05:56:22 2014
WARNING: inbound connection timed out (ORA-3136)
Mon Jun  9 05:56:22 2014
WARNING: inbound connection timed out (ORA-3136)
Mon Jun  9 05:56:22 2014
WARNING: inbound connection timed out (ORA-3136)
Mon Jun  9 05:56:22 2014
WARNING: inbound connection timed out (ORA-3136)
Mon Jun  9 05:56:22 2014
WARNING: inbound connection timed out (ORA-3136)
Mon Jun  9 05:56:22 2014
WARNING: inbound connection timed out (ORA-3136)
Mon Jun  9 05:56:22 2014
WARNING: inbound connection timed out (ORA-3136)
Mon Jun  9 05:56:22 2014
WARNING: inbound connection timed out (ORA-3136)
Mon Jun  9 05:56:22 2014
WARNING: inbound connection timed out (ORA-3136)
Mon Jun  9 05:56:22 2014
WARNING: inbound connection timed out (ORA-3136)
Mon Jun  9 05:56:22 2014
WARNING: inbound connection timed out (ORA-3136)
Mon Jun  9 05:56:22 2014
WARNING: inbound connection timed out (ORA-3136)
Mon Jun  9 05:56:22 2014
WARNING: inbound connection timed out (ORA-3136)
Mon Jun  9 05:56:22 2014
WARNING: inbound connection timed out (ORA-3136)
Mon Jun  9 05:56:22 2014
WARNING: inbound connection timed out (ORA-3136)
Mon Jun  9 05:56:22 2014
WARNING: inbound connection timed out (ORA-3136)
Mon Jun  9 05:56:22 2014
WARNING: inbound connection timed out (ORA-3136)
Mon Jun  9 05:56:22 2014
WARNING: inbound connection timed out (ORA-3136)
Mon Jun  9 05:56:22 2014
WARNING: inbound connection timed out (ORA-3136)
Mon Jun  9 05:56:22 2014
WARNING: inbound connection timed out (ORA-3136)
Mon Jun  9 05:56:22 2014
WARNING: inbound connection timed out (ORA-3136)
Mon Jun  9 05:56:22 2014
WARNING: inbound connection timed out (ORA-3136)
Mon Jun  9 05:56:22 2014
WARNING: inbound connection timed out (ORA-3136)
Mon Jun  9 05:56:22 2014
WARNING: inbound connection timed out (ORA-3136)
Mon Jun  9 05:56:22 2014
WARNING: inbound connection timed out (ORA-3136)
Mon Jun  9 05:56:22 2014
WARNING: inbound connection timed out (ORA-3136)
Mon Jun  9 05:56:22 2014
WARNING: inbound connection timed out (ORA-3136)
Mon Jun  9 05:56:22 2014
WARNING: inbound connection timed out (ORA-3136)
Mon Jun  9 05:56:22 2014
WARNING: inbound connection timed out (ORA-3136)
Mon Jun  9 05:56:22 2014
WARNING: inbound connection timed out (ORA-3136)
Mon Jun  9 05:56:22 2014
WARNING: inbound connection timed out (ORA-3136)
Mon Jun  9 05:56:22 2014
WARNING: inbound connection timed out (ORA-3136)
Mon Jun  9 05:56:22 2014
WARNING: inbound connection timed out (ORA-3136)
Mon Jun  9 05:56:22 2014
WARNING: inbound connection timed out (ORA-3136)
Mon Jun  9 05:56:22 2014
WARNING: inbound connection timed out (ORA-3136)
Mon Jun  9 05:56:22 2014
WARNING: inbound connection timed out (ORA-3136)
Mon Jun  9 05:56:22 2014
WARNING: inbound connection timed out (ORA-3136)
Mon Jun  9 05:56:22 2014
WARNING: inbound connection timed out (ORA-3136)
Mon Jun  9 05:56:22 2014
WARNING: inbound connection timed out (ORA-3136)
Mon Jun  9 05:56:22 2014
WARNING: inbound connection timed out (ORA-3136)
Mon Jun  9 05:56:22 2014
WARNING: inbound connection timed out (ORA-3136)
Mon Jun  9 05:56:22 2014
WARNING: inbound connection timed out (ORA-3136)
Mon Jun  9 05:56:22 2014
WARNING: inbound connection timed out (ORA-3136)
Mon Jun  9 05:56:22 2014
WARNING: inbound connection timed out (ORA-3136)
Mon Jun  9 05:56:22 2014
WARNING: inbound connection timed out (ORA-3136)
Mon Jun  9 05:56:22 2014
WARNING: inbound connection timed out (ORA-3136)
Mon Jun  9 05:56:22 2014
WARNING: inbound connection timed out (ORA-3136)
Mon Jun  9 05:56:22 2014
WARNING: inbound connection timed out (ORA-3136)
Mon Jun  9 05:56:22 2014
WARNING: inbound connection timed out (ORA-3136)
Mon Jun  9 05:56:22 2014
WARNING: inbound connection timed out (ORA-3136)
Mon Jun  9 05:56:22 2014
WARNING: inbound connection timed out (ORA-3136)
Mon Jun  9 05:56:22 2014
WARNING: inbound connection timed out (ORA-3136)
Mon Jun  9 05:56:22 2014
WARNING: inbound connection timed out (ORA-3136)
Mon Jun  9 05:56:22 2014
WARNING: inbound connection timed out (ORA-3136)
Mon Jun  9 05:56:22 2014
WARNING: inbound connection timed out (ORA-3136)
Mon Jun  9 05:56:22 2014
WARNING: inbound connection timed out (ORA-3136)
Mon Jun  9 05:56:22 2014
WARNING: inbound connection timed out (ORA-3136)
Mon Jun  9 05:56:22 2014
WARNING: inbound connection timed out (ORA-3136)
Mon Jun  9 05:56:22 2014
WARNING: inbound connection timed out (ORA-3136)
Mon Jun  9 05:56:22 2014
WARNING: inbound connection timed out (ORA-3136)
Mon Jun  9 05:56:22 2014
WARNING: inbound connection timed out (ORA-3136)
Mon Jun  9 05:56:22 2014
WARNING: inbound connection timed out (ORA-3136)
Mon Jun  9 05:56:22 2014
WARNING: inbound connection timed out (ORA-3136)
Mon Jun  9 05:56:22 2014
WARNING: inbound connection timed out (ORA-3136)
Mon Jun  9 05:56:22 2014
WARNING: inbound connection timed out (ORA-3136)
Mon Jun  9 05:56:22 2014
WARNING: inbound connection timed out (ORA-3136)
Mon Jun  9 05:56:22 2014
WARNING: inbound connection timed out (ORA-3136)
Mon Jun  9 05:56:22 2014
WARNING: inbound connection timed out (ORA-3136)
Mon Jun  9 05:56:22 2014
WARNING: inbound connection timed out (ORA-3136)
Mon Jun  9 05:56:22 2014
WARNING: inbound connection timed out (ORA-3136)
Mon Jun  9 05:56:22 2014
WARNING: inbound connection timed out (ORA-3136)
Mon Jun  9 05:56:22 2014
WARNING: inbound connection timed out (ORA-3136)
Mon Jun  9 05:56:22 2014
WARNING: inbound connection timed out (ORA-3136)
Mon Jun  9 05:56:22 2014
WARNING: inbound connection timed out (ORA-3136)
Mon Jun  9 05:56:22 2014
WARNING: inbound connection timed out (ORA-3136)
Mon Jun  9 05:56:22 2014
WARNING: inbound connection timed out (ORA-3136)
Mon Jun  9 05:56:22 2014
WARNING: inbound connection timed out (ORA-3136)
Mon Jun  9 05:56:22 2014
WARNING: inbound connection timed out (ORA-3136)
Mon Jun  9 05:56:22 2014
WARNING: inbound connection timed out (ORA-3136)
Mon Jun  9 05:56:22 2014
WARNING: inbound connection timed out (ORA-3136)
Mon Jun  9 05:56:22 2014
WARNING: inbound connection timed out (ORA-3136)
Mon Jun  9 05:56:22 2014
WARNING: inbound connection timed out (ORA-3136)
Mon Jun  9 05:56:22 2014
WARNING: inbound connection timed out (ORA-3136)
Mon Jun  9 05:56:22 2014
WARNING: inbound connection timed out (ORA-3136)
Mon Jun  9 05:56:22 2014
WARNING: inbound connection timed out (ORA-3136)
Mon Jun  9 05:56:22 2014
WARNING: inbound connection timed out (ORA-3136)
Mon Jun  9 05:56:22 2014
WARNING: inbound connection timed out (ORA-3136)
Mon Jun  9 05:56:22 2014
WARNING: inbound connection timed out (ORA-3136)
Mon Jun  9 05:56:22 2014
WARNING: inbound connection timed out (ORA-3136)
Mon Jun  9 05:56:22 2014
WARNING: inbound connection timed out (ORA-3136)
Mon Jun  9 05:56:22 2014
WARNING: inbound connection timed out (ORA-3136)
Mon Jun  9 05:56:22 2014
WARNING: inbound connection timed out (ORA-3136)
Mon Jun  9 05:56:22 2014
WARNING: inbound connection timed out (ORA-3136)
Mon Jun  9 05:56:22 2014
WARNING: inbound connection timed out (ORA-3136)
Mon Jun  9 05:56:22 2014
WARNING: inbound connection timed out (ORA-3136)
Mon Jun  9 05:56:22 2014
WARNING: inbound connection timed out (ORA-3136)
Mon Jun  9 05:56:22 2014
WARNING: inbound connection timed out (ORA-3136)
Mon Jun  9 05:56:22 2014
WARNING: inbound connection timed out (ORA-3136)
Mon Jun  9 05:56:22 2014
WARNING: inbound connection timed out (ORA-3136)
Mon Jun  9 05:56:22 2014
WARNING: inbound connection timed out (ORA-3136)
Mon Jun  9 05:56:22 2014
WARNING: inbound connection timed out (ORA-3136)
Mon Jun  9 05:56:22 2014
WARNING: inbound connection timed out (ORA-3136)
Mon Jun  9 05:56:22 2014
WARNING: inbound connection timed out (ORA-3136)
Mon Jun  9 05:56:22 2014
WARNING: inbound connection timed out (ORA-3136)
Mon Jun  9 05:56:22 2014
WARNING: inbound connection timed out (ORA-3136)
Mon Jun  9 05:56:22 2014
WARNING: inbound connection timed out (ORA-3136)
Mon Jun  9 05:56:22 2014
WARNING: inbound connection timed out (ORA-3136)
Mon Jun  9 05:56:22 2014
WARNING: inbound connection timed out (ORA-3136)
Mon Jun  9 05:56:22 2014
WARNING: inbound connection timed out (ORA-3136)
Mon Jun  9 05:56:22 2014
WARNING: inbound connection timed out (ORA-3136)
Mon Jun  9 05:56:22 2014
WARNING: inbound connection timed out (ORA-3136)
Mon Jun  9 05:56:22 2014
WARNING: inbound connection timed out (ORA-3136)
Mon Jun  9 05:56:22 2014
WARNING: inbound connection timed out (ORA-3136)
Mon Jun  9 05:56:22 2014
WARNING: inbound connection timed out (ORA-3136)
Mon Jun  9 05:56:22 2014
WARNING: inbound connection timed out (ORA-3136)
Mon Jun  9 05:56:22 2014
WARNING: inbound connection timed out (ORA-3136)
Mon Jun  9 05:56:22 2014
WARNING: inbound connection timed out (ORA-3136)
Mon Jun  9 05:56:22 2014
WARNING: inbound connection timed out (ORA-3136)
Mon Jun  9 05:56:22 2014
WARNING: inbound connection timed out (ORA-3136)
Mon Jun  9 05:56:22 2014
WARNING: inbound connection timed out (ORA-3136)
Mon Jun  9 05:56:24 2014
Trace dumping is performing id=[cdmp_20140609055624]
Mon Jun  9 05:57:37 2014
Thread 2 advanced to log sequence 13300 (LGWR switch)
  Current log# 4 seq# 13300 mem# 0: +DG/dqb/onlinelog/group_4.266.803845083
Mon Jun  9 06:07:55 2014
Errors in file /oracle/product/admin/dqb/bdump/dqb2_j006_15568.trc:
ORA-12012: error on auto execute of job 524
ORA-06502: PL/SQL: numeric or value error: character string buffer too small
ORA-06512: at "ZDDX_NEW.PKG_BB_LKZHFJTJ_W", line 537
ORA-06512: at "ZDDX_NEW.PKG_BB_LKZHFJTJ_W", line 9
ORA-06512: at "ZDDX_NEW.PKG_BB_TOOL_W", line 309
ORA-06512: at line 1
Mon Jun  9 06:41:35 2014
Thread 2 advanced to log sequence 13301 (LGWR switch)
  Current log# 3 seq# 13301 mem# 0: +DG/dqb/onlinelog/group_3.268.803845083
Mon Jun  9 06:57:53 2014
>>> WAITED TOO LONG FOR A ROW CACHE ENQUEUE LOCK! pid=54
System State dumped to trace file /oracle/product/admin/dqb/bdump/dqb2_mmon_1398.trc
Mon Jun  9 07:24:19 2014
>>> WAITED TOO LONG FOR A ROW CACHE ENQUEUE LOCK! pid=174
System State dumped to trace file /oracle/product/admin/dqb/udump/dqb2_ora_1963.trc
Mon Jun  9 09:45:09 2014
Trace dumping is performing id=[cdmp_20140609094508]
Mon Jun  9 09:45:36 2014
Errors in file /oracle/product/admin/dqb/bdump/dqb2_asmb_1428.trc:
ORA-15064: communication failure with ASM instance
ORA-03113: end-of-file on communication channel
Mon Jun  9 09:45:36 2014
ASMB: terminating instance due to error 15064
Mon Jun  9 09:45:36 2014
Errors in file /oracle/product/admin/dqb/bdump/dqb2_lmon_1337.trc:
ORA-15064: communication failure with ASM instance
Mon Jun  9 09:45:36 2014
Errors in file /oracle/product/admin/dqb/bdump/dqb2_pmon_1331.trc:
ORA-15064: communication failure with ASM instance
Mon Jun  9 09:45:36 2014
Errors in file /oracle/product/admin/dqb/bdump/dqb2_lms5_1361.trc:
ORA-15064: communication failure with ASM instance
Mon Jun  9 09:45:36 2014
Errors in file /oracle/product/admin/dqb/bdump/dqb2_lms1_1345.trc:
ORA-15064: communication failure with ASM instance
Mon Jun  9 09:45:36 2014
Errors in file /oracle/product/admin/dqb/bdump/dqb2_arc1_1545.trc:
ORA-00600: internal error code, arguments: [kfnDisconnect], [not connected], [], [], [], [], [], []
ORA-15055: unable to connect to ASM instance
ORA-01092: ORACLE instance terminated. Disconnection forced
ORA-03113: end-of-file on communication channel
Mon Jun  9 09:45:36 2014
Errors in file /oracle/product/admin/dqb/bdump/dqb2_lms2_1349.trc:
ORA-15064: communication failure with ASM instance
Mon Jun  9 09:45:36 2014
Errors in file /oracle/product/admin/dqb/bdump/dqb2_lms6_1365.trc:
ORA-15064: communication failure with ASM instance
Mon Jun  9 09:45:36 2014
Errors in file /oracle/product/admin/dqb/bdump/dqb2_lms0_1341.trc:
ORA-15064: communication failure with ASM instance
Mon Jun  9 09:45:36 2014
Errors in file /oracle/product/admin/dqb/bdump/dqb2_lms7_1369.trc:
ORA-15064: communication failure with ASM instance
Mon Jun  9 09:45:36 2014
Errors in file /oracle/product/admin/dqb/bdump/dqb2_lms3_1353.trc:
ORA-15064: communication failure with ASM instance
Mon Jun  9 09:45:36 2014
Errors in file /oracle/product/admin/dqb/bdump/dqb2_lms4_1357.trc:
ORA-15064: communication failure with ASM instance
Mon Jun  9 09:45:36 2014
Errors in file /oracle/product/admin/dqb/bdump/dqb2_lmd0_1339.trc:
ORA-15064: communication failure with ASM instance
Mon Jun  9 09:45:37 2014
Errors in file /oracle/product/admin/dqb/bdump/dqb2_arc1_1545.trc:
ORA-00600: internal error code, arguments: [kfnDisconnect], [not connected], [], [], [], [], [], []
ORA-15055: unable to connect to ASM instance
ORA-01092: ORACLE instance terminated. Disconnection forced
ORA-03113: end-of-file on communication channel
Mon Jun  9 09:45:37 2014
Errors in file /oracle/product/admin/dqb/bdump/dqb2_arc1_1545.trc:
ORA-00600: internal error code, arguments: [kfnDisconnect], [not connected], [], [], [], [], [], []
ORA-15055: unable to connect to ASM instance
ORA-01092: ORACLE instance terminated. Disconnection forced
ORA-03113: end-of-file on communication channel
Mon Jun  9 09:45:37 2014
Errors in file /oracle/product/admin/dqb/bdump/dqb2_arc1_1545.trc:
ORA-00600: internal error code, arguments: [kfnDisconnect], [not connected], [], [], [], [], [], []
ORA-15055: unable to connect to ASM instance
ORA-01092: ORACLE instance terminated. Disconnection forced
ORA-03113: end-of-file on communication channel
Mon Jun  9 09:45:37 2014
Errors in file /oracle/product/admin/dqb/bdump/dqb2_arc1_1545.trc:
ORA-00600: internal error code, arguments: [kfnDisconnect], [not connected], [], [], [], [], [], []
ORA-15055: unable to connect to ASM instance
ORA-01092: ORACLE instance terminated. Disconnection forced
ORA-03113: end-of-file on communication channel
Mon Jun  9 09:45:37 2014
Errors in file /oracle/product/admin/dqb/bdump/dqb2_arc1_1545.trc:
ORA-00600: internal error code, arguments: [kfnDisconnect], [not connected], [], [], [], [], [], []
ORA-15055: unable to connect to ASM instance
ORA-01092: ORACLE instance terminated. Disconnection forced
ORA-03113: end-of-file on communication channel
Mon Jun  9 09:45:37 2014
Errors in file /oracle/product/admin/dqb/bdump/dqb2_arc1_1545.trc:
ORA-00600: internal error code, arguments: [kfnDisconnect], [not connected], [], [], [], [], [], []
ORA-15055: unable to connect to ASM instance
ORA-01092: ORACLE instance terminated. Disconnection forced
ORA-03113: end-of-file on communication channel
Mon Jun  9 09:45:38 2014
Errors in file /oracle/product/admin/dqb/bdump/dqb2_rbal_1432.trc:
ORA-15064: communication failure with ASM instance
Mon Jun  9 09:45:39 2014
Trace dumping is performing id=[cdmp_20140609094539]
Mon Jun  9 09:45:47 2014
Instance terminated by ASMB, pid = 1428
Mon Jun  9 09:53:01 2014
Starting ORACLE instance (normal)
LICENSE_MAX_SESSION = 0
LICENSE_SESSIONS_WARNING = 0
Interface type 1 eth1 192.168.1.0 configured from OCR for use as a cluster interconnect
Interface type 1 eth0 10.177.1.0 configured from OCR for use as  a public interface
Picked latch-free SCN scheme 3
Autotune of undo retention is turned on.
LICENSE_MAX_USERS = 0
SYS auditing is disabled
ksdpec: called for event 13740 prior to event group initialization
Starting up ORACLE RDBMS Version: 10.2.0.4.0.
System parameters with non-default values:
  processes                = 300
  sessions                 = 335
  __shared_pool_size       = 452984832
  __large_pool_size        = 16777216
  __java_pool_size         = 16777216
  __streams_pool_size      = 0
  spfile                   = +DG/dqb/spfiledqb.ora
  sga_target               = 1610612736
  control_files            = +DG/dqb/controlfile/current.272.803844991
  control_file_record_keep_time= 8
  db_block_size            = 8192
  __db_cache_size          = 1107296256
  compatible               = 10.2.0.3.0
  log_archive_dest_1       = LOCATION=+dg/dqb/arch/arch1
  db_file_multiblock_read_count= 16
  cluster_database         = TRUE
  cluster_database_instances= 2
  db_create_file_dest      = +DG
  db_recovery_file_dest_size= 10737418240
  thread                   = 2
  instance_number          = 2
  undo_management          = AUTO
  undo_tablespace          = UNDOTBS4
  remote_login_passwordfile= EXCLUSIVE
  db_domain                =
  dispatchers              = (PROTOCOL=TCP) (SERVICE=dqbXDB)
  remote_listener          = LISTENERS_DQB
  job_queue_processes      = 10
  background_dump_dest     = /oracle/product/admin/dqb/bdump
  user_dump_dest           = /oracle/product/admin/dqb/udump
  core_dump_dest           = /oracle/product/admin/dqb/cdump
  audit_file_dest          = /oracle/product/admin/dqb/adump
  db_name                  = dqb
  open_cursors             = 300
  pga_aggregate_target     = 3363831808
Cluster communication is configured to use the following interface(s) for this instance
  192.168.1.2
Mon Jun  9 09:53:01 2014
cluster interconnect IPC version:Oracle UDP/IP (generic)
IPC Vendor 1 proto 2
PMON started with pid=4, OS id=13866
DIAG started with pid=8, OS id=13868
PSP0 started with pid=12, OS id=13870
LMON started with pid=16, OS id=13872
LMD0 started with pid=2, OS id=13874
LMS0 started with pid=6, OS id=13876
LMS1 started with pid=3, OS id=13880
LMS2 started with pid=20, OS id=13884
LMS3 started with pid=5, OS id=13888
LMS4 started with pid=10, OS id=13892
LMS5 started with pid=7, OS id=13896
LMS6 started with pid=24, OS id=13900
LMS7 started with pid=9, OS id=13904
MMAN started with pid=28, OS id=13908
DBW0 started with pid=14, OS id=13910
DBW1 started with pid=11, OS id=13912
DBW2 started with pid=32, OS id=13914
DBW3 started with pid=13, OS id=13916
LGWR started with pid=15, OS id=13918
CKPT started with pid=36, OS id=13920
SMON started with pid=40, OS id=13922
RECO started with pid=44, OS id=13924
CJQ0 started with pid=18, OS id=13926
MMON started with pid=48, OS id=13928
Mon Jun  9 09:53:02 2014
starting up 1 dispatcher(s) for network address '(ADDRESS=(PARTIAL=YES)(PROTOCOL=TCP))'...
MMNL started with pid=52, OS id=13936
Mon Jun  9 09:53:02 2014
starting up 1 shared server(s) ...
Mon Jun  9 09:53:02 2014
lmon registered with NM - instance id 2 (internal mem no 1)
Mon Jun  9 09:53:02 2014
Reconfiguration started (old inc 0, new inc 2)
List of nodes:
 1
 Global Resource Directory frozen
* allocate domain 0, invalid = TRUE
 Communication channels reestablished
 Master broadcasted resource hash value bitmaps
 Non-local Process blocks cleaned out
Mon Jun  9 09:53:02 2014
 LMS 2: 0 GCS shadows cancelled, 0 closed
Mon Jun  9 09:53:02 2014
 LMS 0: 0 GCS shadows cancelled, 0 closed
Mon Jun  9 09:53:02 2014
 LMS 3: 0 GCS shadows cancelled, 0 closed
Mon Jun  9 09:53:02 2014
 LMS 1: 0 GCS shadows cancelled, 0 closed
Mon Jun  9 09:53:02 2014
 LMS 6: 0 GCS shadows cancelled, 0 closed
Mon Jun  9 09:53:02 2014
 LMS 7: 0 GCS shadows cancelled, 0 closed
Mon Jun  9 09:53:02 2014
 LMS 5: 0 GCS shadows cancelled, 0 closed
Mon Jun  9 09:53:02 2014
 LMS 4: 0 GCS shadows cancelled, 0 closed
 Set master node info
 Submitted all remote-enqueue requests
 Dwn-cvts replayed, VALBLKs dubious
 All grantable enqueues granted
 Post SMON to start 1st pass IR
Mon Jun  9 09:53:02 2014
 LMS 2: 0 GCS shadows traversed, 0 replayed
Mon Jun  9 09:53:02 2014
 LMS 3: 0 GCS shadows traversed, 0 replayed
Mon Jun  9 09:53:02 2014
 LMS 7: 0 GCS shadows traversed, 0 replayed
Mon Jun  9 09:53:02 2014
 LMS 1: 0 GCS shadows traversed, 0 replayed
Mon Jun  9 09:53:02 2014
 LMS 0: 0 GCS shadows traversed, 0 replayed
Mon Jun  9 09:53:02 2014
 LMS 5: 0 GCS shadows traversed, 0 replayed
Mon Jun  9 09:53:02 2014
 LMS 4: 0 GCS shadows traversed, 0 replayed
Mon Jun  9 09:53:02 2014
 LMS 6: 0 GCS shadows traversed, 0 replayed
Mon Jun  9 09:53:02 2014
 Submitted all GCS remote-cache requests
 Fix write in gcs resources
Reconfiguration complete
LCK0 started with pid=30, OS id=13942
Mon Jun  9 09:53:03 2014
ALTER DATABASE   MOUNT
Mon Jun  9 09:53:03 2014
This instance was first to mount
Mon Jun  9 09:53:03 2014
Starting background process ASMB
ASMB started with pid=56, OS id=13953
Starting background process RBAL
RBAL started with pid=60, OS id=13957
Mon Jun  9 09:53:06 2014
SUCCESS: diskgroup DG was mounted
Mon Jun  9 09:53:10 2014
Setting recovery target incarnation to 2
Mon Jun  9 09:53:11 2014
Successful mount of redo thread 2, with mount id 4128760447
Mon Jun  9 09:53:11 2014
Database mounted in Shared Mode (CLUSTER_DATABASE=TRUE)
Completed: ALTER DATABASE   MOUNT
Mon Jun  9 09:53:11 2014
ALTER DATABASE OPEN
This instance was first to open
Mon Jun  9 09:53:12 2014
Beginning crash recovery of 2 threads
 parallel recovery started with 16 processes
Mon Jun  9 09:53:14 2014
Started redo scan
Mon Jun  9 09:53:14 2014
Completed redo scan
 26 redo blocks read, 8 data blocks need recovery
Mon Jun  9 09:53:14 2014
Started redo application at
 Thread 1: logseq 16276, block 199337, scn 13914083540861
 Thread 2: logseq 13301, block 55078
Mon Jun  9 09:53:14 2014
Recovery of Online Redo Log: Thread 1 Group 2 Seq 16276 Reading mem 0
  Mem# 0: +DG/dqb/onlinelog/group_2.275.803844993
Mon Jun  9 09:53:14 2014
Recovery of Online Redo Log: Thread 2 Group 3 Seq 13301 Reading mem 0
  Mem# 0: +DG/dqb/onlinelog/group_3.268.803845083
Mon Jun  9 09:53:14 2014
Completed redo application
Mon Jun  9 09:53:14 2014
Completed crash recovery at
 Thread 1: logseq 16276, block 199337, scn 13914083560862
 Thread 2: logseq 13301, block 55104, scn 13914083661134
 8 data blocks read, 8 data blocks written, 26 redo blocks read
Attempt to switch log for thread 1 failed. reason: 3
Picked broadcast on commit scheme to generate SCNs
Mon Jun  9 09:53:14 2014
LGWR: STARTING ARCH PROCESSES
ARC0 started with pid=58, OS id=14055
Mon Jun  9 09:53:14 2014
ARC0: Archival started
ARC1: Archival started
LGWR: STARTING ARCH PROCESSES COMPLETE
ARC1 started with pid=35, OS id=14062
ARC1: Becoming the 'no FAL' ARCH
ARC1: Becoming the 'no SRL' ARCH
Mon Jun  9 09:53:14 2014
ARC0: Becoming the heartbeat ARCH
Mon Jun  9 09:53:17 2014
Thread 2 advanced to log sequence 13302 (thread open)
Thread 2 opened at log sequence 13302
  Current log# 4 seq# 13302 mem# 0: +DG/dqb/onlinelog/group_4.266.803845083
Successful open of redo thread 2
Mon Jun  9 09:53:17 2014
MTTR advisory is disabled because FAST_START_MTTR_TARGET is not set
Mon Jun  9 09:53:17 2014
SMON: enabling cache recovery
Mon Jun  9 09:53:18 2014
ARC0: Switch failed
Mon Jun  9 09:53:18 2014
Successfully onlined Undo Tablespace 35.
Mon Jun  9 09:53:18 2014
SMON: enabling tx recovery
Mon Jun  9 09:53:18 2014
Database Characterset is ZHS16GBK
Opening with internal Resource Manager plan
where NUMA PG = 4, CPUs = 20
replication_dependency_tracking turned off (no async multimaster replication found)
Starting background process QMNC
QMNC started with pid=62, OS id=14171
Mon Jun  9 09:53:19 2014
Thread 1 advanced to log sequence 16277 (archiver wakeup)
Mon Jun  9 09:53:22 2014
Completed: ALTER DATABASE OPEN
Mon Jun  9 09:53:26 2014
ALTER SYSTEM SET service_names='rac' SCOPE=MEMORY SID='dqb2';
Mon Jun  9 10:01:02 2014
Errors in file /oracle/product/admin/dqb/bdump/dqb2_j001_14197.trc:
ORA-00600: internal error code, arguments: [6749], [3], [12662723], [109], [], [], [], []
Mon Jun  9 10:01:06 2014
Trace dumping is performing id=[cdmp_20140609100106]
Mon Jun  9 10:03:24 2014
ALTER SYSTEM SET service_names='rac','dqb' SCOPE=MEMORY SID='dqb2';
叫同事手工启动ASM实例。一步步看报错信息
export ORACLE_SID=+ASM1
sqlplus / as sysdba
sql>startup;
提示ora-29701。
客户报oracle数据库出现了ora-29701错误,查看oracle的 error message
ORA-29701: unable to connect to Cluster Manager
Cause: Connect to CM failed or timed out.
Action: Verify that the CM was started. If the CM was not started, start it and then retry the database startup.
           If the CM died or is not responding, check the Oracle and CM trace files for errors.
       当时以为肯定是cluster出问题了,可是客户说查询都能够运行,就是运行create table语句就出现这个错误,怪了! 后来通过查看数  据库的告警日志的过程中发现原来是$ORACLE_HOME的空间满了,通过删除没有的trace文件。数据库一切正常!

汗, 后来让同事尝试使用手工启动ASM实例,提示Ora-29701,汗,原来是磁盘空间满

oracle数据库启动报错,不能启动ASM实例的更多相关文章

  1. 4、Oracle 数据库 startup 报错:ORA-27102: out of memory

    1.数据库启动报错: ORA-: out of memory SQL> startup pfile='/db/oracle/init.ora'; ORA-: out of memory Linu ...

  2. 修改oracle数据库内存报错

    今天修改oracle数据库内存时, alter system set memory_max_target=10240M scope=spfile;语句正确修改:但重启时却报错 : SQL> al ...

  3. Weblogic页面应用查询oracle数据库后台报错或页面日期格式显示错误

    问题:在生产环境中有两台WEB服务器,分别为227和228,部署的应用代码都是每日同步的,两边完全一致,但是某些页面查询数据时,227无结果,并且后台报java数组越界的错误,而228一切正常.经开发 ...

  4. 处理 oracle 数据库导入报错“IMP-00058: 遇到 ORACLE 错误 942”

    在导入数据文件的时候出现了下图错误: 经过多次百度搜索问题.得知问题错误方向: 仔细的查询了被导入数据的数据库的版本: 而 被导入的数据包 dmp 文件是从 oracle11g r2的版本导出的. 所 ...

  5. Myeclise下tomcat启动报错,启动超时

    错误截图如下: 大概说的是tomcat7在本地不能在45秒内启动,如果项目需要更多的时间,试着去更改server配置 解决方法: 找到项目工作空间目录下 workspace\.metadata\.pl ...

  6. C#连接Oracle数据库解决报错(需要安装Oracle客户端软件8.1.7)的问题

    1.通过nuget安装  ManagedDataAccess 2.引用 using Oracle.ManagedDataAccess.Client; 注:最低framework4.0 测试连接: // ...

  7. Hibernate 操作 oracle数据库,报错总结

    1.ORA-00957: 重复的列名 错误信息如下: Hibernate: insert into T_RESOURCE (NAME, NUM, PARENT_FLAG, PARENT_ID, id, ...

  8. selenium启动报错“ incorrect JSON status mapping for 'unknown error' (500 expected)”

    前面讲了工程启动报错“selenium启动报错Unable to read VR Path Registry from C:\Users\clinva\AppData\Local\openvr\ope ...

  9. gitblit在windows10上的安装及服务启动报错处理

    折腾一下午算是装好了,心情不错决定分享一下.安装步骤大同小异网上都有,主要是Failed creating java 这个报错,百度出来的没有一个能给我解决的,摸索半天找出一个自己的方式.为报错而来的 ...

  10. undo丢失恢复异常恢复,运维DBA反映Oracle数据库无法启动报错ORA-01157 ORA-01110,分析原因为Oracle数据库坏块导致

    本文转自 惜纷飞 大师. 模拟基表事务未提交数据库crash,undo丢失恢复异常恢复,运维DBA反映Oracle数据库无法启动报错ORA-01157 ORA-01110,分析原因为Oracle数据库 ...

随机推荐

  1. IdentityServer4

    序言 IdentityServer4能做什么 Identity Server 4(以下简称ID4)是一个基于oauth2和OpenID的身份认证组件,基于这个组件可以快速开发自己的身份认证网站,支持单 ...

  2. 【javascript】生成二维码

    1 <!DOCTYPE html> 2 <html> 3 <head> 4 <meta charset="UTF-8"> 5 < ...

  3. 计算器work_day05

    day_work_05 ------Python是一个优雅的大姐姐 作业计算器 设计思路 按照运算优先级和正则先算括号内的值,提出来判断符号问题,然后依次计算. 分析题目设计了四个函数,分别为a)去括 ...

  4. ASP.NET实现文件断点续传

    IE的自带下载功能中没有断点续传功能,要实现断点续传功能,需要用到HTTP协议中鲜为人知的几个响应头和请求头. 一. 两个必要响应头Accept-Ranges.ETag 客户端每次提交下载请求时,服务 ...

  5. CodeForces 1100F Ivan and Burgers

    CodeForces题面 Time limit 3000 ms Memory limit 262144 kB Source Codeforces Round #532 (Div. 2) Tags da ...

  6. No 'Configuration' method was found in class 'WebApp.Startup

    The following errors occurred while attempting to load the app.- No 'Configuration' method was found ...

  7. Mybatis学习笔记之---多表查询(2)

    Mybatis多表查询(2) (一)举例 用户和角色 一个用户可以有多个角色,一个角色可以赋予多个用户 (二)步骤 1.建立两张表:用户表,角色表,让用户表和角色表具有多对多的关系.需要使用中间表,中 ...

  8. logstash搭建

    logstash就是一个具备实时数据传输能力的管道,负责将数据信息从管道的输入端传输到管道的输出端:与此同时这根管道还可以让你根据自己的需求在中间加上滤网,Logstash提供里很多功能强大的滤网以满 ...

  9. 地图服务 纬度、经度对应坐标轴x,y

    记下,供自己参考,中国地区的经纬度,经度大,纬度小 如上海经纬度为:(经度, 纬度)(y, x)(lon, lat) 121.48 31.22 纬度---lat----x轴 经度---lon---y轴

  10. Mac securecrt 破解版安装

    破解一 1.先链接:https://pan.baidu.com/s/1-1nu4eRf7BmuLg5MtlCRvw  密码:30pq    默认下载到了当前用户的”下载”目录中 在”Finder”中 ...