项目中用到了Quartz,也算是Quartz的一个示例。

源库创建数据同步表SYNC_DATA:

  1. CREATE TABLE SYNC_DATA(
  2. ID VARCHAR2(36) NOT NULL,
  3. TABLE_NAME VARCHAR2(50) NOT NULL,
  4. COMMAND VARCHAR2(10) NOT NULL,
  5. TABLE_KEY VARCHAR2(50) NOT NULL,
  6. DATA_ID VARCHAR2(50) NOT NULL,
  7. FAIL_COUNT INT NOT NULL,
  8. CREATE_TIME DATE NOT NULL,
  9. UPDATE_TIME DATE ,
  10. CONSTRAINT sync_data_PK PRIMARY KEY (ID)
  11. )
  12. ;
  13.  
  14. COMMENT ON TABLE SYNC_DATA IS '业务数据同步表'
  15. ;
  16. COMMENT ON COLUMN SYNC_DATA.ID IS '主键'
  17. ;
  18. COMMENT ON COLUMN SYNC_DATA.TABLE_NAME IS '表名'
  19. ;
  20. COMMENT ON COLUMN SYNC_DATA.COMMAND IS '命令'
  21. ;
  22. COMMENT ON COLUMN SYNC_DATA.TABLE_KEY IS '表主键'
  23. ;
  24. COMMENT ON COLUMN SYNC_DATA.DATA_ID IS '数据ID'
  25. ;
  26. COMMENT ON COLUMN SYNC_DATA.FAIL_COUNT IS '失败次数'
  27. ;
  28. COMMENT ON COLUMN SYNC_DATA.CREATE_TIME IS '创建时间'
  29. ;
  30. COMMENT ON COLUMN SYNC_DATA.UPDATE_TIME IS '更新时间'
  31. ;

新增修改删除触发器示例(oracle版):

  1. CREATE OR REPLACE TRIGGER "T_PT_CAMERA_INFO_I"
  2. AFTER INSERT ON "SHINY"."PT_CAMERA_INFO" FOR EACH ROW
  3. BEGIN
  4. INSERT INTO sync_data(ID, TABLE_NAME, COMMAND, TABLE_KEY, DATA_ID, FAIL_COUNT, CREATE_TIME)
  5. VALUES(sys_guid(), 'PT_CAMERA_INFO', 'INSERT', 'ID', :new.ID || '', 0, sysdate);
  6. END;
  7.  
  8. CREATE OR REPLACE TRIGGER "T_PT_CAMERA_INFO_U"
  9. AFTER UPDATE ON "SHINY"."PT_CAMERA_INFO" FOR EACH ROW
  10. BEGIN
  11. IF (NVL(to_char(:new.ID), 'X') != NVL(to_char(:old.ID), 'X'))
  12. OR (NVL(to_char(:new.ASSET_ID), 'X') != NVL(to_char(:old.ASSET_ID), 'X'))
  13. OR (NVL(to_char(:new.CAMERA_NO), 'X') != NVL(to_char(:old.CAMERA_NO), 'X'))
  14. OR (NVL(to_char(:new.POSITION_CODE), 'X') != NVL(to_char(:old.POSITION_CODE), 'X'))
  15. OR (NVL(to_char(:new.POSITION_ID), 'X') != NVL(to_char(:old.POSITION_ID), 'X'))
  16. OR (NVL(to_char(:new.CAMERA_NAME), 'X') != NVL(to_char(:old.CAMERA_NAME), 'X'))
  17. OR (NVL(to_char(:new.ORG_ID), 'X') != NVL(to_char(:old.ORG_ID), 'X'))
  18. OR (NVL(to_char(:new.ADDRESS), 'X') != NVL(to_char(:old.ADDRESS), 'X'))
  19. OR (NVL(to_char(:new.CAMERA_IP), 'X') != NVL(to_char(:old.CAMERA_IP), 'X'))
  20. OR (NVL(to_char(:new.LONGITUDE), 'X') != NVL(to_char(:old.LONGITUDE), 'X'))
  21. OR (NVL(to_char(:new.LATITUDE), 'X') != NVL(to_char(:old.LATITUDE), 'X'))
  22. OR (NVL(to_char(:new.SN), 'X') != NVL(to_char(:old.SN), 'X'))
  23. OR (NVL(to_char(:new.CAMERA_MODEL), 'X') != NVL(to_char(:old.CAMERA_MODEL), 'X'))
  24. OR (NVL(to_char(:new.MANUFACTURER), 'X') != NVL(to_char(:old.MANUFACTURER), 'X'))
  25. OR (NVL(to_char(:new.SUPPLIER), 'X') != NVL(to_char(:old.SUPPLIER), 'X'))
  26. OR (NVL(to_char(:new.ADD_ID), 'X') != NVL(to_char(:old.ADD_ID), 'X'))
  27. OR (NVL(to_char(:new.ADD_TIME, 'yyyy-mm-dd hh24:mi:ss'),'X') != NVL(to_char(:old.ADD_TIME, 'yyyy-mm-dd hh24:mi:ss'),'X'))
  28. OR (NVL(to_char(:new.MODIFY_ID), 'X') != NVL(to_char(:old.MODIFY_ID), 'X'))
  29. OR (NVL(to_char(:new.MODIFY_TIME, 'yyyy-mm-dd hh24:mi:ss'),'X') != NVL(to_char(:old.MODIFY_TIME, 'yyyy-mm-dd hh24:mi:ss'),'X'))
  30. OR (NVL(to_char(:new.USER_NAME), 'X') != NVL(to_char(:old.USER_NAME), 'X'))
  31. OR (NVL(to_char(:new.PASS_WORD), 'X') != NVL(to_char(:old.PASS_WORD), 'X'))
  32. OR (NVL(to_char(:new.CASE_INSTALL_TYPE), 'X') != NVL(to_char(:old.CASE_INSTALL_TYPE), 'X'))
  33. OR (NVL(to_char(:new.AREA_CODE), 'X') != NVL(to_char(:old.AREA_CODE), 'X'))
  34. OR (NVL(to_char(:new.MONITOR_TYPE), 'X') != NVL(to_char(:old.MONITOR_TYPE), 'X'))
  35. OR (NVL(to_char(:new.POINT_NAME), 'X') != NVL(to_char(:old.POINT_NAME), 'X'))
  36. OR (NVL(to_char(:new.CAMERA_IP6), 'X') != NVL(to_char(:old.CAMERA_IP6), 'X'))
  37. OR (NVL(to_char(:new.SUBNET_MASK), 'X') != NVL(to_char(:old.SUBNET_MASK), 'X'))
  38. OR (NVL(to_char(:new.GATEWAY), 'X') != NVL(to_char(:old.GATEWAY), 'X'))
  39. OR (NVL(to_char(:new.MAC_ADDRESS), 'X') != NVL(to_char(:old.MAC_ADDRESS), 'X'))
  40. OR (NVL(to_char(:new.ONU_SN), 'X') != NVL(to_char(:old.ONU_SN), 'X'))
  41. OR (NVL(to_char(:new.CAMERA_TYPE), 'X') != NVL(to_char(:old.CAMERA_TYPE), 'X'))
  42. OR (NVL(to_char(:new.CAMERA_FUN_TYPE), 'X') != NVL(to_char(:old.CAMERA_FUN_TYPE), 'X'))
  43. OR (NVL(to_char(:new.FILL_LIGTH_ATTR), 'X') != NVL(to_char(:old.FILL_LIGTH_ATTR), 'X'))
  44. OR (NVL(to_char(:new.CAMERA_ENCODE_TYPE), 'X') != NVL(to_char(:old.CAMERA_ENCODE_TYPE), 'X'))
  45. OR (NVL(to_char(:new.POWER_TAKE_TYPE), 'X') != NVL(to_char(:old.POWER_TAKE_TYPE), 'X'))
  46. OR (NVL(to_char(:new.POWER_TAKE_LENGTH), 'X') != NVL(to_char(:old.POWER_TAKE_LENGTH), 'X'))
  47. OR (NVL(to_char(:new.SOUND_ALARM), 'X') != NVL(to_char(:old.SOUND_ALARM), 'X'))
  48. OR (NVL(to_char(:new.RESOLUTION), 'X') != NVL(to_char(:old.RESOLUTION), 'X'))
  49. OR (NVL(to_char(:new.SOFT_VERSION), 'X') != NVL(to_char(:old.SOFT_VERSION), 'X'))
  50. OR (NVL(to_char(:new.LENS_PARAM), 'X') != NVL(to_char(:old.LENS_PARAM), 'X'))
  51. OR (NVL(to_char(:new.IS_HAVE_CONSOLE), 'X') != NVL(to_char(:old.IS_HAVE_CONSOLE), 'X'))
  52. OR (NVL(to_char(:new.INSTALL_WAY), 'X') != NVL(to_char(:old.INSTALL_WAY), 'X'))
  53. OR (NVL(to_char(:new.LINEAR_WAY), 'X') != NVL(to_char(:old.LINEAR_WAY), 'X'))
  54. OR (NVL(to_char(:new.RESOURCE_PLACE), 'X') != NVL(to_char(:old.RESOURCE_PLACE), 'X'))
  55. OR (NVL(to_char(:new.IMPORT_WATCH), 'X') != NVL(to_char(:old.IMPORT_WATCH), 'X'))
  56. OR (NVL(to_char(:new.POSITION_TYPE), 'X') != NVL(to_char(:old.POSITION_TYPE), 'X'))
  57. OR (NVL(to_char(:new.COMMUNITY), 'X') != NVL(to_char(:old.COMMUNITY), 'X'))
  58. OR (NVL(to_char(:new.STREET), 'X') != NVL(to_char(:old.STREET), 'X'))
  59. OR (NVL(to_char(:new.WATCH_SPEC_LOCATION), 'X') != NVL(to_char(:old.WATCH_SPEC_LOCATION), 'X'))
  60. OR (NVL(to_char(:new.ROAD_DIRECTION), 'X') != NVL(to_char(:old.ROAD_DIRECTION), 'X'))
  61. OR (NVL(to_char(:new.FOUL_LINE), 'X') != NVL(to_char(:old.FOUL_LINE), 'X'))
  62. OR (NVL(to_char(:new.FEN_JU), 'X') != NVL(to_char(:old.FEN_JU), 'X'))
  63. OR (NVL(to_char(:new.POLICE_STATION), 'X') != NVL(to_char(:old.POLICE_STATION), 'X'))
  64. OR (NVL(to_char(:new.CAMERA_DIRECTION), 'X') != NVL(to_char(:old.CAMERA_DIRECTION), 'X'))
  65. OR (NVL(to_char(:new.INSTALL_HEIGHT), 'X') != NVL(to_char(:old.INSTALL_HEIGHT), 'X'))
  66. OR (NVL(to_char(:new.CROSS_ARM1), 'X') != NVL(to_char(:old.CROSS_ARM1), 'X'))
  67. OR (NVL(to_char(:new.CROSS_ARM2), 'X') != NVL(to_char(:old.CROSS_ARM2), 'X'))
  68. OR (NVL(to_char(:new.INDOOR_OR_NOT), 'X') != NVL(to_char(:old.INDOOR_OR_NOT), 'X'))
  69. OR (NVL(to_char(:new.SPECIAL_PHOTO_PATH), 'X') != NVL(to_char(:old.SPECIAL_PHOTO_PATH), 'X'))
  70. OR (NVL(to_char(:new.LOCATION_PHOTO_PATH), 'X') != NVL(to_char(:old.LOCATION_PHOTO_PATH), 'X'))
  71. OR (NVL(to_char(:new.REAL_PHOTO_PATH), 'X') != NVL(to_char(:old.REAL_PHOTO_PATH), 'X'))
  72. OR (NVL(to_char(:new.NETWORK_PROPERTIES), 'X') != NVL(to_char(:old.NETWORK_PROPERTIES), 'X'))
  73. OR (NVL(to_char(:new.POLICE_AREA_CODE), 'X') != NVL(to_char(:old.POLICE_AREA_CODE), 'X'))
  74. OR (NVL(to_char(:new.INSTALL_PERSION), 'X') != NVL(to_char(:old.INSTALL_PERSION), 'X'))
  75. OR (NVL(to_char(:new.INSTALL_TIME, 'yyyy-mm-dd hh24:mi:ss'),'X') != NVL(to_char(:old.INSTALL_TIME, 'yyyy-mm-dd hh24:mi:ss'),'X'))
  76. OR (NVL(to_char(:new.BUILD_PERIOD), 'X') != NVL(to_char(:old.BUILD_PERIOD), 'X'))
  77. OR (NVL(to_char(:new.PROJECT_NAME), 'X') != NVL(to_char(:old.PROJECT_NAME), 'X'))
  78. OR (NVL(to_char(:new.MANAGER_UNIT), 'X') != NVL(to_char(:old.MANAGER_UNIT), 'X'))
  79. OR (NVL(to_char(:new.MANAGER_UNIT_TEL), 'X') != NVL(to_char(:old.MANAGER_UNIT_TEL), 'X'))
  80. OR (NVL(to_char(:new.MAINTAIN_UNIT), 'X') != NVL(to_char(:old.MAINTAIN_UNIT), 'X'))
  81. OR (NVL(to_char(:new.MAINTAIN_UNIT_TEL), 'X') != NVL(to_char(:old.MAINTAIN_UNIT_TEL), 'X'))
  82. OR (NVL(to_char(:new.RECODE_SAVE_TYPE), 'X') != NVL(to_char(:old.RECODE_SAVE_TYPE), 'X'))
  83. OR (NVL(to_char(:new.DEVICE_STATE), 'X') != NVL(to_char(:old.DEVICE_STATE), 'X'))
  84. OR (NVL(to_char(:new.INDUSTRY_OWN), 'X') != NVL(to_char(:old.INDUSTRY_OWN), 'X'))
  85. OR (NVL(to_char(:new.IS_REGISTER_IMOS), 'X') != NVL(to_char(:old.IS_REGISTER_IMOS), 'X'))
  86. OR (NVL(to_char(:new.IS_WIFI), 'X') != NVL(to_char(:old.IS_WIFI), 'X'))
  87. OR (NVL(to_char(:new.IS_FLASH), 'X') != NVL(to_char(:old.IS_FLASH), 'X'))
  88. OR (NVL(to_char(:new.CAMERA_NO_STR), 'X') != NVL(to_char(:old.CAMERA_NO_STR), 'X'))
  89. OR (NVL(to_char(:new.CAMERA_VCN_CODE), 'X') != NVL(to_char(:old.CAMERA_VCN_CODE), 'X'))
  90. OR (NVL(to_char(:new.FIELD_NO), 'X') != NVL(to_char(:old.FIELD_NO), 'X'))
  91. OR (NVL(to_char(:new.KEY_UNIT), 'X') != NVL(to_char(:old.KEY_UNIT), 'X'))
  92. OR (NVL(to_char(:new.UNIT_TYPE), 'X') != NVL(to_char(:old.UNIT_TYPE), 'X'))
  93. OR (NVL(to_char(:new.SHOW_LEVEL), 'X') != NVL(to_char(:old.SHOW_LEVEL), 'X'))
  94. OR (NVL(to_char(:new.PROTOCOL_TYPE), 'X') != NVL(to_char(:old.PROTOCOL_TYPE), 'X'))
  95. OR (NVL(to_char(:new.CAMERA_PORT), 'X') != NVL(to_char(:old.CAMERA_PORT), 'X'))
  96. OR (NVL(to_char(:new.INTERFACE_TYPE), 'X') != NVL(to_char(:old.INTERFACE_TYPE), 'X'))
  97. OR (NVL(to_char(:new.CHANNEL), 'X') != NVL(to_char(:old.CHANNEL), 'X'))
  98. OR (NVL(to_char(:new.USER_OBJECT), 'X') != NVL(to_char(:old.USER_OBJECT), 'X'))
  99. OR (NVL(to_char(:new.IMG_PATH), 'X') != NVL(to_char(:old.IMG_PATH), 'X'))
  100. OR (NVL(to_char(:new.CAMERA_DESC), 'X') != NVL(to_char(:old.CAMERA_DESC), 'X'))
  101. OR (NVL(to_char(:new.IS_REGISTER_VCN), 'X') != NVL(to_char(:old.IS_REGISTER_VCN), 'X'))
  102. OR (NVL(to_char(:new.IS_DEL), 'X') != NVL(to_char(:old.IS_DEL), 'X'))
  103. OR (NVL(to_char(:new.ORDER_VALUE), 'X') != NVL(to_char(:old.ORDER_VALUE), 'X'))
  104. OR (NVL(to_char(:new.POLLING_RESULT), 'X') != NVL(to_char(:old.POLLING_RESULT), 'X'))
  105. OR (NVL(to_char(:new.SERVER_ID), 'X') != NVL(to_char(:old.SERVER_ID), 'X'))
  106. OR (NVL(to_char(:new.SHORT_MSG), 'X') != NVL(to_char(:old.SHORT_MSG), 'X'))
  107. OR (NVL(to_char(:new.CAMERA_BELONGS_ID), 'X') != NVL(to_char(:old.CAMERA_BELONGS_ID), 'X'))
  108. OR (NVL(to_char(:new.RELATED_CUSTOMS), 'X') != NVL(to_char(:old.RELATED_CUSTOMS), 'X'))
  109. OR (NVL(to_char(:new.ADDED_TO_SDE), 'X') != NVL(to_char(:old.ADDED_TO_SDE), 'X'))
  110. OR (NVL(to_char(:new.CAMERA_BAK), 'X') != NVL(to_char(:old.CAMERA_BAK), 'X'))
  111. OR (NVL(to_char(:new.CAMERA_BELONGS_PK), 'X') != NVL(to_char(:old.CAMERA_BELONGS_PK), 'X'))
  112. OR (NVL(to_char(:new.MEMBERBAR_CODE), 'X') != NVL(to_char(:old.MEMBERBAR_CODE), 'X'))
  113. OR (NVL(to_char(:new.IS_BRANCH), 'X') != NVL(to_char(:old.IS_BRANCH), 'X'))
  114. OR (NVL(to_char(:new.IS_WATCHPOS), 'X') != NVL(to_char(:old.IS_WATCHPOS), 'X'))
  115. OR (NVL(to_char(:new.CAMERA_ANGLE), 'X') != NVL(to_char(:old.CAMERA_ANGLE), 'X'))
  116. OR (NVL(to_char(:new.CROSS_ARM3), 'X') != NVL(to_char(:old.CROSS_ARM3), 'X'))
  117. OR (NVL(to_char(:new.IS_SYS), 'X') != NVL(to_char(:old.IS_SYS), 'X'))
  118. OR (NVL(to_char(:new.RECORD_TIME), 'X') != NVL(to_char(:old.RECORD_TIME), 'X'))
  119. OR (NVL(to_char(:new.ANALYSIS_NO), 'X') != NVL(to_char(:old.ANALYSIS_NO), 'X'))
  120. OR (NVL(to_char(:new.WIFI_STATE), 'X') != NVL(to_char(:old.WIFI_STATE), 'X'))
  121. OR (NVL(to_char(:new.FACE_TASK_STATUS), 'X') != NVL(to_char(:old.FACE_TASK_STATUS), 'X'))
  122. OR (NVL(to_char(:new.VIDEO_TASK_STATUS), 'X') != NVL(to_char(:old.VIDEO_TASK_STATUS), 'X'))
  123. OR (NVL(to_char(:new.BAYONET_TASK_STATUS), 'X') != NVL(to_char(:old.BAYONET_TASK_STATUS), 'X'))
  124. OR (NVL(to_char(:new.VQD_URL), 'X') != NVL(to_char(:old.VQD_URL), 'X'))
  125. OR (NVL(to_char(:new.SYS_TYPE), 'X') != NVL(to_char(:old.SYS_TYPE), 'X'))
  126. OR (NVL(to_char(:new.IS_HAVE_CAPTURE), 'X') != NVL(to_char(:old.IS_HAVE_CAPTURE), 'X'))
  127.  
  128. THEN
  129. INSERT INTO sync_data(ID, TABLE_NAME, COMMAND, TABLE_KEY, DATA_ID, FAIL_COUNT, CREATE_TIME)
  130. VALUES(sys_guid(), 'PT_CAMERA_INFO', 'UPDATE', 'ID', :new.ID || '', 0, sysdate);
  131. END IF;
  132. END;
  133.  
  134. CREATE OR REPLACE TRIGGER "T_PT_CAMERA_INFO_D"
  135. BEFORE DELETE ON "SHINY"."PT_CAMERA_INFO" FOR EACH ROW
  136. BEGIN
  137. INSERT INTO sync_data(ID, TABLE_NAME, COMMAND, TABLE_KEY, DATA_ID, FAIL_COUNT, CREATE_TIME)
  138. VALUES(sys_guid(), 'PT_CAMERA_INFO', 'DELETE', 'ID', :old.ID || '', 0, sysdate);
  139. END;
  140.  
  141. CREATE OR REPLACE TRIGGER "T_VIDEO_VIDEOSOURCE_I"
  142. AFTER INSERT ON "SHINY"."VIPF_VIDEO_VIDEOSOURCE" FOR EACH ROW
  143. BEGIN
  144. INSERT INTO sync_data(ID, TABLE_NAME, COMMAND, TABLE_KEY, DATA_ID, FAIL_COUNT, CREATE_TIME)
  145. VALUES(sys_guid(), 'VIPF_VIDEO_VIDEOSOURCE', 'INSERT', 'CAMERA_ID', :new.CAMERA_ID || '', 0, sysdate);
  146. END;
  147.  
  148. CREATE OR REPLACE TRIGGER "T_VIDEO_VIDEOSOURCE_U"
  149. AFTER UPDATE ON "SHINY"."VIPF_VIDEO_VIDEOSOURCE" FOR EACH ROW
  150. BEGIN
  151. INSERT INTO sync_data(ID, TABLE_NAME, COMMAND, TABLE_KEY, DATA_ID, FAIL_COUNT, CREATE_TIME)
  152. VALUES(sys_guid(), 'VIPF_VIDEO_VIDEOSOURCE', 'UPDATE', 'CAMERA_ID', :new.CAMERA_ID || '', 0, sysdate);
  153. END;
  154.  
  155. CREATE OR REPLACE TRIGGER "T_VIDEO_VIDEOSOURCE_D"
  156. BEFORE DELETE ON "SHINY"."VIPF_VIDEO_VIDEOSOURCE" FOR EACH ROW
  157. BEGIN
  158. INSERT INTO sync_data(ID, TABLE_NAME, COMMAND, TABLE_KEY, DATA_ID, FAIL_COUNT, CREATE_TIME)
  159. VALUES(sys_guid(), 'VIPF_VIDEO_VIDEOSOURCE', 'DELETE', 'CAMERA_ID', :old.CAMERA_ID || '', 0, sysdate);
  160. END;

启动数据同步任务C#代码:

  1. using DataSync.DAL;
  2. using DataSync.Utils;
  3. using Utils;
  4. using System;
  5. using System.Collections.Generic;
  6. using System.ComponentModel;
  7. using System.Configuration;
  8. using System.Data;
  9. using System.Diagnostics;
  10. using System.Linq;
  11. using System.ServiceProcess;
  12. using System.Text;
  13. using System.Threading;
  14. using System.Threading.Tasks;
  15. using System.Timers;
  16. using System.Windows.Forms;
  17. using Quartz.Impl;
  18. using Quartz;
  19. using DataSync.Jobs;
  20. using Models;
  21.  
  22. namespace DataSync
  23. {
  24. /// <summary>
  25. /// 数据同步服务
  26. /// by suxiang
  27. /// </summary>
  28. partial class DataSyncService : ServiceBase
  29. {
  30. #region 变量
  31.  
  32. #endregion
  33.  
  34. #region 构造函数
  35. public DataSyncService()
  36. {
  37. InitializeComponent();
  38. }
  39. #endregion
  40.  
  41. #region OnStart 启动服务
  42. protected override void OnStart(string[] args)
  43. {
  44. startScheduler();
  45.  
  46. LogUtil.Log("服务启动成功");
  47. }
  48. #endregion
  49.  
  50. #region OnStop 停止服务
  51. protected override void OnStop()
  52. {
  53. LogUtil.Log("服务停止成功");
  54.  
  55. Thread.Sleep(100); //等待一会,待日志写入文件
  56. }
  57. #endregion
  58.  
  59. #region Start 启动服务
  60. public void Start()
  61. {
  62. OnStart(null);
  63. }
  64. #endregion
  65.  
  66. #region scheduleJob
  67. private async void startScheduler()
  68. {
  69. TaskSchedulerEx taskEx = new TaskSchedulerEx(8, 64);
  70. StdSchedulerFactory schedulerFactory = new StdSchedulerFactory();
  71. IScheduler scheduler = await schedulerFactory.GetScheduler();
  72. await scheduler.Start();
  73. await LogUtil.Log("任务调度器已启动");
  74.  
  75. if (ConfigUtil.SyncParam == 1) //部署在政务网侧
  76. {
  77. scheduleJob(scheduler, "政务网中间库->政务网平台库", ConfigUtil.ZWW_Middle, ConfigUtil.ZWW_PT, taskEx);
  78. scheduleJob(scheduler, "政务网平台库->政务网中间库", ConfigUtil.ZWW_PT, ConfigUtil.ZWW_Middle, taskEx);
  79. }
  80.  
  81. if (ConfigUtil.SyncParam == 2) //部署在视频网侧
  82. {
  83. scheduleJob(scheduler, "视频网平台库->视频网中间库", ConfigUtil.SPW_PT, ConfigUtil.SPW_Middle, taskEx);
  84. }
  85. }
  86.  
  87. private async void scheduleJob(IScheduler scheduler, string taskName, string dbSourceConnectionString, string dbTargetConnectionString, TaskSchedulerEx taskEx)
  88. {
  89. string cronString = "0/5 * * * * ?";
  90. IJobDetail jobDetail = JobBuilder.Create<SyncJob>().Build();
  91. ITrigger trigger = TriggerBuilder.Create().WithCronSchedule(cronString).Build();
  92. SpeedInfo speedInfo = new SpeedInfo();
  93. jobDetail.JobDataMap.Put("taskName", taskName);
  94. jobDetail.JobDataMap.Put("dbSourceConnectionString", dbSourceConnectionString);
  95. jobDetail.JobDataMap.Put("dbTargetConnectionString", dbTargetConnectionString);
  96. jobDetail.JobDataMap.Put("speedInfo", speedInfo);
  97. jobDetail.JobDataMap.Put("taskEx", taskEx);
  98. await scheduler.ScheduleJob(jobDetail, trigger);
  99.  
  100. await scheduleCalcSpeedJob(scheduler, taskName, speedInfo);
  101. }
  102.  
  103. private async Task scheduleCalcSpeedJob(IScheduler scheduler, string taskName, SpeedInfo speedInfo)
  104. {
  105. int timeRange = 10;
  106. string cronString = "0/" + timeRange + " * * * * ?";
  107. IJobDetail jobDetail = JobBuilder.Create<CalcSpeedJob>().Build();
  108. ITrigger trigger = TriggerBuilder.Create().WithCronSchedule(cronString).Build();
  109. jobDetail.JobDataMap.Put("taskName", taskName);
  110. jobDetail.JobDataMap.Put("timeRange", timeRange);
  111. jobDetail.JobDataMap.Put("speedInfo", speedInfo);
  112. await scheduler.ScheduleJob(jobDetail, trigger);
  113. }
  114. #endregion
  115.  
  116. }
  117. }

数据同步任务C#代码:

  1. using DataSync.DAL;
  2. using DataSync.Models;
  3. using DataSync.Utils;
  4. using Models;
  5. using Oracle.ManagedDataAccess.Client;
  6. using Quartz;
  7. using System;
  8. using System.Collections;
  9. using System.Collections.Generic;
  10. using System.Data;
  11. using System.Linq;
  12. using System.Text;
  13. using System.Threading.Tasks;
  14. using Utils;
  15.  
  16. namespace DataSync.Jobs
  17. {
  18. /// <summary>
  19. /// 数据同步任务
  20. /// </summary>
  21. [DisallowConcurrentExecution]
  22. public class SyncJob : IJob
  23. {
  24. #region 变量属性
  25. private readonly string INSERT = "INSERT";
  26. private readonly string UPDATE = "UPDATE";
  27. private readonly string DELETE = "DELETE";
  28. #endregion
  29.  
  30. #region 数据库操作类
  31. private OracleHelper _dbSource = null;
  32. private OracleHelper _dbTarget = null;
  33. #endregion
  34.  
  35. #region 任务参数
  36. private string _taskName = null;
  37. private string _dbSourceConnectionString = null;
  38. private string _dbTargetConnectionString = null;
  39. private SpeedInfo _speedInfo = null;
  40. private TaskSchedulerEx _task = null;
  41. #endregion
  42.  
  43. public Task Execute(IJobExecutionContext context)
  44. {
  45. return Task.Run(() =>
  46. {
  47. try
  48. {
  49. _taskName = context.JobDetail.JobDataMap["taskName"].ToString();
  50. _dbSourceConnectionString = context.JobDetail.JobDataMap["dbSourceConnectionString"].ToString();
  51. _dbTargetConnectionString = context.JobDetail.JobDataMap["dbTargetConnectionString"].ToString();
  52. _speedInfo = (SpeedInfo)context.JobDetail.JobDataMap["speedInfo"];
  53. _task = (TaskSchedulerEx)context.JobDetail.JobDataMap["taskEx"];
  54.  
  55. _dbSource = new OracleHelper(_dbSourceConnectionString);
  56. _dbTarget = new OracleHelper(_dbTargetConnectionString);
  57.  
  58. List<SYNC_DATA> list = ServiceHelper.Get<SyncDataDal>().GetList(_dbSourceConnectionString);
  59. int oldCount = list.Count;
  60. list = DictinctSyncData(list);
  61. if (oldCount > 0 && oldCount != list.Count) LogUtil.Log(string.Format("SYNC_DATA集合去重前数量:{0} 去重后数量:{1}", oldCount, list.Count));
  62. Dictionary<string, List<SYNC_DATA>> dict = list.ToLookup(a => a.TABLE_NAME).ToDictionary(a => a.Key, a => a.ToList()); //按表分组,对于单张表,必须用单线程,保证处理顺序
  63.  
  64. int syncCount = 0;
  65. object lockObj = new object();
  66. List<Task> taskList = new List<Task>();
  67. foreach (string key in dict.Keys)
  68. {
  69. foreach (SYNC_DATA item in dict[key])
  70. {
  71. Task task = _task.Run((obj) =>
  72. {
  73. SYNC_DATA syncData = obj as SYNC_DATA;
  74. string targetTableName = syncData.TABLE_NAME;
  75.  
  76. //表名不一至的特殊情况
  77. if (ConfigUtil.SyncParam == 1) //部署在政务网侧
  78. {
  79. if (syncData.TABLE_NAME == "VIPF_VIDEO_VIDEOSOURCE") targetTableName = "ZZ_VIDEO_VIDEOSOURCE1";
  80. }
  81.  
  82. //查询并缓存目标数据库表字段信息集合
  83. List<DbColumnInfo> columnList = MemoryCacheUtil.TryGetValue<List<DbColumnInfo>>(_dbSourceConnectionString + targetTableName, () => _dbTarget.GetAllColumns(targetTableName));
  84.  
  85. int row;
  86. SyncOneData(_dbSourceConnectionString, (SYNC_DATA)syncData, targetTableName, _dbSource, _dbTarget, columnList, out row);
  87. lock (lockObj) { syncCount += row; }
  88.  
  89. _speedInfo.addCount();
  90. }, item);
  91. taskList.Add(task);
  92. }
  93. }
  94. Task.WaitAll(taskList.ToArray());
  95. if (syncCount > 0) LogUtil.Log(string.Format("本次成功同步 {0} 条数据", syncCount));
  96. }
  97. catch (Exception ex)
  98. {
  99. LogUtil.Error(ex, "数据同步任务 出错");
  100. }
  101. });
  102. }
  103.  
  104. #region 同步一条数据
  105. /// <summary>
  106. /// 同步一条数据
  107. /// </summary>
  108. private void SyncOneData(string connStr, SYNC_DATA item, string targetTableName, OracleHelper dbSource, OracleHelper dbTarget, List<DbColumnInfo> columnList, out int row)
  109. {
  110. bool isFault = false;
  111. DateTime dt = DateTime.Now;
  112. row = 0;
  113.  
  114. try
  115. {
  116. #region 通过表名查询字段集合
  117. string columns = string.Join(",", columnList.ConvertAll<string>(a => a.columns_name));
  118. string columnsForInsert = string.Join(",", columnList.ConvertAll<string>(a => ":" + a.columns_name));
  119. string columnsForUpdate = string.Join(",", columnList.ConvertAll<string>(a => a.columns_name + "=:" + a.columns_name));
  120. #endregion
  121.  
  122. if (item.COMMAND == INSERT || item.COMMAND == UPDATE)
  123. {
  124. //数据查询
  125. DataTable sourceData = dbSource.Query(string.Format(@"select * from {0} where {1}", item.TABLE_NAME, CreateWhere(item.TABLE_KEY, item.DATA_ID)));
  126. DataTable targetData = dbTarget.Query(string.Format(@"select * from {0} where {1}", targetTableName, CreateWhere(item.TABLE_KEY, item.DATA_ID)));
  127.  
  128. //判断摄像机表是否需要同步
  129. if (item.TABLE_NAME == "PT_CAMERA_INFO")
  130. {
  131. if (!needSync(sourceData, targetData))
  132. {
  133. ServiceHelper.Get<SyncDataDal>().DeleteById(connStr, item.ID);
  134. return;
  135. }
  136. }
  137.  
  138. if (sourceData != null && sourceData.Rows.Count > 0)
  139. {
  140. bool exists = targetData != null && targetData.Rows.Count > 0;
  141.  
  142. if ((item.COMMAND == INSERT && !exists) || (item.COMMAND == UPDATE && !exists))
  143. {
  144. #region 插入数据
  145. string insertSql = string.Format("insert into {0}({1}) values({2})", targetTableName, columns, columnsForInsert);
  146.  
  147. #region 字段赋值
  148. OracleParameter[] paramArr = new OracleParameter[columnList.Count];
  149.  
  150. for (int i = 0; i < columnList.Count; i++)
  151. {
  152. DbColumnInfo columnInfo = columnList[i];
  153.  
  154. paramArr[i] = new OracleParameter(columnInfo.columns_name, GetColumnData(sourceData, columnInfo.columns_name));
  155. }
  156. #endregion
  157.  
  158. row = dbTarget.ExecuteSql(insertSql, paramArr);
  159.  
  160. if (row > 0) LogUtil.Log(string.Format("{0} 表 {1} 插入一条数据,{2}", _taskName, targetTableName, CreateWhereLog(item.TABLE_KEY, item.DATA_ID)));
  161. #endregion
  162. }
  163.  
  164. if ((item.COMMAND == INSERT && exists) || (item.COMMAND == UPDATE && exists))
  165. {
  166. #region 更新数据
  167. string updateSql = string.Format("update {0} set {1} where {2}", targetTableName, columnsForUpdate, CreateWhere(item.TABLE_KEY, item.DATA_ID));
  168.  
  169. #region 字段赋值
  170. List<OracleParameter> paramList = new List<OracleParameter>();
  171.  
  172. foreach (DbColumnInfo columnInfo in columnList)
  173. {
  174. paramList.Add(new OracleParameter(columnInfo.columns_name, GetColumnData(sourceData, columnInfo.columns_name)));
  175. }
  176. #endregion
  177.  
  178. row = dbTarget.ExecuteSql(updateSql, paramList.ToArray());
  179.  
  180. if (row > 0) LogUtil.Log(string.Format("{0} 表 {1} 更新一条数据,{2}", _taskName, targetTableName, CreateWhereLog(item.TABLE_KEY, item.DATA_ID)));
  181. #endregion
  182. }
  183. }
  184. }
  185.  
  186. if (item.COMMAND == DELETE)
  187. {
  188. #region 删除数据
  189. string deleteSql = string.Format("delete from {0} where {1}", targetTableName, CreateWhere(item.TABLE_KEY, item.DATA_ID));
  190.  
  191. row = dbTarget.ExecuteSql(deleteSql);
  192.  
  193. if (row > 0) LogUtil.Log(string.Format("{0} 表 {1} 删除一条数据,{2}", _taskName, targetTableName, CreateWhereLog(item.TABLE_KEY, item.DATA_ID)));
  194. #endregion
  195. }
  196.  
  197. ServiceHelper.Get<SyncDataDal>().DeleteById(connStr, item.ID);
  198.  
  199. }
  200. catch (Exception ex)
  201. {
  202. isFault = true;
  203. LogUtil.Error(ex, "同步数据失败,表名:" + item.TABLE_NAME.ToUpper() + " 命令:" + item.COMMAND + " 数据ID:" + item.DATA_ID);
  204. }
  205.  
  206. try
  207. {
  208. if (isFault)
  209. {
  210. SYNC_DATA sysSyncBs = ServiceHelper.Get<SyncDataDal>().GetById(connStr, item.ID);
  211. sysSyncBs.FAIL_COUNT++;
  212. ServiceHelper.Get<SyncDataDal>().Update(connStr, sysSyncBs);
  213. LogUtil.Debug("更新业务数据同步表SYNC_DATA,ID:" + item.ID);
  214. }
  215. }
  216. catch (Exception ex)
  217. {
  218. LogUtil.Error(ex, "更新业务数据同步表SYNC_DATA出错");
  219. }
  220. }
  221. #endregion
  222.  
  223. #region 判断是否是主键
  224. /// <summary>
  225. /// 判断是否是主键
  226. /// </summary>
  227. private bool IsIdField(string columnName, string idField)
  228. {
  229. if (idField.IndexOf(',') >= 0)
  230. {
  231. string[] idFieldArr = idField.Split(',');
  232. return idFieldArr.ToList().Exists(a => a == columnName);
  233. }
  234. else
  235. {
  236. return columnName == idField;
  237. }
  238. }
  239. #endregion
  240.  
  241. #region 根据主键生成Where条件语句
  242. /// <summary>
  243. /// 根据主键生成Where条件语句
  244. /// </summary>
  245. private string CreateWhere(string idField, string idData)
  246. {
  247. if (idField.IndexOf(',') >= 0)
  248. {
  249. StringBuilder sb = new StringBuilder(" 1=1 ");
  250. string[] idFieldArr = idField.Split(',');
  251. string[] idDataArr = idData.Split(',');
  252. for (int i = 0; i < idFieldArr.Length; i++)
  253. {
  254. sb.AppendFormat(" and {0}='{1}' ", idFieldArr[i], idDataArr[i]);
  255. }
  256. return sb.ToString();
  257. }
  258. else
  259. {
  260. return string.Format("{0}='{1}'", idField, idData);
  261. }
  262. }
  263. #endregion
  264.  
  265. #region 根据字段名从DataTable中获取数据
  266. /// <summary>
  267. /// 根据字段名从DataTable中获取数据
  268. /// </summary>
  269. private object GetColumnData(DataTable data, string columnName)
  270. {
  271. for (int i = 0; i < data.Columns.Count; i++)
  272. {
  273. if (data.Columns[i].ColumnName == columnName)
  274. {
  275. return data.Rows[0][data.Columns[i]];
  276. }
  277. }
  278. return DBNull.Value;
  279. }
  280. #endregion
  281.  
  282. #region 根据主键生成Where条件语句日志信息
  283. /// <summary>
  284. /// 根据主键生成Where条件语句日志信息
  285. /// </summary>
  286. private string CreateWhereLog(string idField, string idData)
  287. {
  288. if (idField.IndexOf(',') >= 0)
  289. {
  290. List<string> list = new List<string>();
  291. string[] idFieldArr = idField.Split(',');
  292. string[] idDataArr = idData.Split(',');
  293. for (int i = 0; i < idFieldArr.Length; i++)
  294. {
  295. list.Add(string.Format("{0}:{1}", idFieldArr[i], idDataArr[i]));
  296. }
  297. return string.Join(",", list.ToArray());
  298. }
  299. else
  300. {
  301. return string.Format("{0}:{1}", idField, idData);
  302. }
  303. }
  304. #endregion
  305.  
  306. #region 判断是否需要同步
  307. private bool needSync(DataTable sourceTable, DataTable targetTable)
  308. {
  309. HashSet<string> hashSet = new HashSet<string>() { "POLLING_TIME", "CAMERA_STATE" };
  310.  
  311. if (targetTable == null || targetTable.Rows.Count == 0) return true;
  312.  
  313. if (sourceTable != null && sourceTable.Rows.Count > 0 && targetTable != null && targetTable.Rows.Count > 0)
  314. {
  315. foreach (DataColumn column in sourceTable.Columns)
  316. {
  317. if (targetTable.Columns.Contains(column.ColumnName))
  318. {
  319. if (sourceTable.Rows[0][column.ColumnName] != null && !sourceTable.Rows[0][column].Equals(targetTable.Rows[0][column.ColumnName]))
  320. {
  321. if (!hashSet.Contains(column.ColumnName))
  322. {
  323. return true;
  324. }
  325. }
  326. }
  327. }
  328. }
  329. return false;
  330. }
  331. #endregion
  332.  
  333. #region SYNC_DATA集合去重,对于按条件相同的数据,按顺序保留最后一条
  334. /// <summary>
  335. /// SYNC_DATA集合去重,对于按条件相同的数据,按顺序保留最后一条
  336. /// </summary>
  337. private List<SYNC_DATA> DictinctSyncData(List<SYNC_DATA> list)
  338. {
  339. List<SYNC_DATA> result = new List<SYNC_DATA>();
  340.  
  341. for (int i = 0; i < list.Count; i++)
  342. {
  343. SYNC_DATA dataI = list[i];
  344.  
  345. bool exists = false;
  346. for (int j = i + 1; j < list.Count; j++)
  347. {
  348. SYNC_DATA dataJ = list[j];
  349.  
  350. if (dataI.TABLE_NAME == dataJ.TABLE_NAME
  351. && dataI.TABLE_KEY == dataJ.TABLE_KEY
  352. && dataI.DATA_ID == dataJ.DATA_ID)
  353. {
  354. exists = true;
  355. }
  356. }
  357.  
  358. if (!exists)
  359. {
  360. result.Add(dataI);
  361. }
  362. }
  363.  
  364. return result;
  365. }
  366. #endregion
  367.  
  368. }
  369.  
  370. }

使用触发器和C#程序实现数据同步的更多相关文章

  1. redis作为mysql的缓存服务器(读写分离,通过mysql触发器实现数据同步)

    一.redis简介Redis是一个key-value存储系统.和Memcached类似,为了保证效率,数据都是缓存在内存中.区别的是redis会周期性的把更新的数据写入磁盘或者把修改操作写入追加的记录 ...

  2. Oracle 数据同步系列--触发器

    现在随着项目集成的越来越深入,异构的数据多起来,数据同步的场景也用的多起来,我甚至在考虑是否忽悠用户上Oracle GoldenGate了,这样就可以不用考虑采用哪种同步方案了. 简单的介绍一下我们数 ...

  3. 【转】mysql 触发器实现两个表的数据同步

    mysql通过触发器实现两个表的同步 目前,在本地测试成功. 假设本地的两个数据库a和b,a下有表table1(id, val) b下有表table2(id, val) 假设希望当table1中数据更 ...

  4. 两张table数据同步--使用触发器

    数据同步, 如果每天同步一次的话可以使用SSIS,跑JOB等,可以同步不同的DB的数据: 实时的可以使用触发器,在同一个DB中(或者DB Link): USE [test] GO IF EXISTS( ...

  5. SQLServer与Oracle的数据同步(触发器trigger)

    说到同步,其实是靠"作业"定时调度存储过程来操作数据,增,删,改,全在里面,结合触发器,游标来实现,关于作业调度,使用了5秒运行一次来实行"秒级作业",这样基本 ...

  6. HBase数据同步ElasticSearch该程序

    ElasticSearch的River机械 ElasticSearch本身就提供了River机械,对于同步数据. 在这里,现在能找到的官方推荐River: http://www.elasticsear ...

  7. oracle 触发器,当一个表更新或插入时将数据同步至另个库中的某个表中

    有两个表分别是 A用户下的 T_SRC_WEATHER_TSPG字段如图, B用户下的t_src_weather 表,如图: 要求,当A用户下的T_SRC_WEATHER_TSPG表有插入或者更新数据 ...

  8. 小程序批量获取input的输入值,监听输入框,数据同步

    在使用小程序时,跟vue的数据绑定不一样,没有v-model这个属性了,官网也只是给了一些事件监听. 但是我们如果有多个表单时,需要写多个事件来同步数据.这样做很麻烦.下面的方法可以解决,只需要一个方 ...

  9. kettle利用触发器实现数据同步

    2016年8月17日 一.目的 通过触发器实现数据同步二.思路 1.在数据库需要同步的源表中建立一个insert触发器,当有新数据插入时,会自动将新插入数据的主键记录到临时表temp中.(当然也可以记 ...

  10. SQLSEVER 不同服务器下两个结构相似的表实现数据同步(触发器)

    1.建立链接服务器 在ServerA 中创建指向ServerB的链接服务器,并做好账号映射.addlinkedserver存储过程创建一个链接服务器,参数详情参见官方文档. 第1个参数LNK_Serv ...

随机推荐

  1. 背包DP全类型

    AcWing 2. 01背包问题 #include <iostream> #include <algorithm> using namespace std; const int ...

  2. RLHF · PBRL | B-Pref:生成多样非理性 preference,建立 PBRL benchmark

    论文题目:B-Pref: Benchmarking Preference-Based Reinforcement Learning,2021 NeurIPS Track Datasets and Be ...

  3. 我的PyCharm为什么在linux下打不开?

    PyCharm打不开解决方案 本文基于Xrdp远程连接桌面环境,Unbutu Linux OS,解决办法仅供参考.应以实际情况为准. 问题产生的原因,Xrdp下GUI绘制依赖于Xrdp的渲染,当Xrd ...

  4. [GDOIpj221B] 数列游戏

    第二题 数列游戏 提交文件: sequence.cpp 输入文件: sequence.in 输出文件: sequence.out 时间空间限制: 1 秒, 256 MB 有一个长度为 \(n\) 的序 ...

  5. 使用CEF(七)详解macOS下基于CEF的多进程应用程序CMake项目搭建

    由于macOS下的应用程序结构导致了CEF这样的多进程架构程序在项目结构.运行架构上有很多细节需要关注,这一块的内容比起Windows要复杂的多,所以本文将会聚焦macOS下基于CEF的多进程应用架构 ...

  6. Spring Framework系统架构

  7. 后端程序员必会的前端知识-02:JavaScript

    第二章. Javascript 它是一种脚本语言,可以用来更改页面内容,控制多媒体,制作图像.动画等等 例子 修改页面内容 js 代码位置 <script> // js 代码 </s ...

  8. 【fmjava】 面试题突击训练-Java基础语法篇01

    JDK 和 JRE 有什么区别? JDK:Java Development Kit 的简称, Java 开发工具包, 提供了 Java 的开发环境和运行环境. JRE:Java Runtime Env ...

  9. CentOS 7上使用Python 3和虚拟环境

    在CentOS 7上使用Python 3和虚拟环境,请按照以下步骤操作: 首先,确保您的系统已安装Python 3.您可以使用以下命令检查Python 3是否已安装: python3 --versio ...

  10. freemarker实现自定义标签

    freemarker实现自定义标签 freemarker实现自定义标签其实并没有什么难度,这个功能我们叫自定义标签,在官网中称为指令,也并不是什么高级技术,只是大家没发现而已,参考下官网文档就能实现: ...