数据库同步规则

February 26, 2024About 59 min

数据库同步规则

SDK类名:/active/SyncRule

同步规则 - 列表

SDK方法名:listSyncRules

URL

/sync_rule

Method

GET

Request

名称类型必选简介Mock初始值Mock规则
pageNumber偏移数1
limitNumber最多多少行10
search_fieldString搜索域rule_name
search_valueString搜索值
group_uuidString查询业务组
where_argsObject
  rule_uuidString@guid
  statusString状态
  src_db_nameString数据源
  tgt_db_nameString目标端
  db_ipString数据库ip
  node_ipString机器节点ip
  usernameString用户名
  rule_nameString(其余同步规则)规则名
  src_db_typeString源端数据库类型
  tgt_db_typeString备端数据库类型

Response

名称类型必选简介Mock初始值Mock规则
totalNumber20
retNumber200
msgString
dataObject
  codeNumber0
  messageString[0] 操作成功。
  info_listArray10
    usernameStringadmin
    user_uuidString1BCFCAA3-E3C8-3E28-BDC5-BE36FDC2B5DC
    rule_uuidString['6ECF19A1-3754-1490-C6A3-52AFB4D7F497', '6ECF19A1-3754-1490-C6A3-52AFB4D7F496']
    src_db_uuidStringAF16E01E-6988-D0FA-3A7F-DEE04C4D3B4A
    tgt_db_uuidString72855161-CD57-6FB5-C195-B19F466AB2C0
    rule_typeNumber0
    rule_nameString123123
    node_uuidString
    create_timeNumber1593511163
    has_bk_takeoverString是否有对应接管规则
    has_reverseString是否有对应反向同步规则
    bk_takeover_uuidString对应接管规则uuid
    reverse_uuidString对应反向同步uuid
  totalNumber11

同步规则 - 新建

SDK方法名:createSyncRule; 创建同步规则

URL

/sync_rule

Method

POST

Request

名称类型必选简介Mock初始值Mock规则
rule_nameString规则名称ctt->ctt
commentString备注
src_db_uuidString源端数据库uuid6C4AEF37-6496-6DCD-E085-DD640001E4EC
src_db_auth_uuidString源端用户认证uuid
tgt_db_uuidString备端数据库uuid1C5F3C4B-7333-9518-7349-9712BC9ED664
tgt_db_auth_uuidString备端用户认证uuid
map_type_listArray映射方式
base_settingsObject基本设置
  dbmap_topicString备端kafka整库映射topic
  json_templateStringjson模板
  binary_codeString二进制数据编码方式(hex、base64)
  kafka_message_encodingString消息字符集(UTF-8、GBK)
  kafka_time_outNumberProducer超时时间(毫秒)
  part_load_balanceString分区均衡策略(by_table、by_key)
  row_map_modeString行映射方式
(rowid、where、auto)
  save_json_textBoolean保存为额外json
  message_formatString消息格式(protobuf、json)
  full_sync_modeString全同步方式,逻辑:logic 物理 physics 自动 auto
  lib_nameString日志库名
  jnr_nameString日志名称
  exclude_dbsArray排除库列表
  exclude_dbs_switchString排除库开关,0:关,1:开
  start_rule_nowString立即开始规则,0:关,1:开
user_mapObject用户映射模式
  src_userStringuser1
  tgt_userStringuser2
table_mapArray表映射模式
  keyArray自定义主键key列@last3
  split_dst_tableArray表拆分
    conditionString拆分条件
    dst_tableString备端表名
    dst_userString备端用户
  dst_tableString备端表名a
  dst_userString备端用户b
  src_tableString源端表名c
  src_userString源端用户d
  columnArray
    dst_columnString备端字段e
    src_columnString源端字段f
column_mapObject按列匹配映射,格式为:用户,列1,列2,列3。(用户支持星号)例:
["U1, ID, NAME", "
, CARD"]
  userString原用户
  targetString目标用户或目标topic(kafka)
  columnString列名
full_sync_settingsObject全量设置
  dump_thdNumber1
  clean_user_before_dumpNumber0
  existing_tableStringdrop_to_recycle
  full_syncNumber整库开关0
  start_scnString
  keep_exist_tableNumber0
  keep_tableNumber0
  load_thdNumber1
  ld_dir_optNumber0
  try_split_part_tableNumber0
  concurrent_tableArray["hello.world"]
  full_sync_custom_cfgArray全局自定义配置
    keyString
    valueString
  dump_splitObject单表拆分配置
    enableBoolean是否启用单表拆分false
    least_rowsNumber单表拆分最大行数
    least_bytesNumber单表拆分最大字节数
    expire_secondsNumber拆分过期时间(秒)
inc_sync_settingsObject增量设置
  incre_syncNumber增量同步,0:关闭,1:开启
  dyn_threadNumber增量装载线程数
  redo_read_threadNumber读取日志线程数
  ddl_cvNumber备端对删除的表进行备份,0:关闭,1:开启
  convert_urp_of_keyString转换更新主键操作
  sync_lobNumber同步LOB数据,0:关闭,1:开启
  keep_bad_actNumber保留装载失败事务,0:关闭,1:开启
  fill_lob_columnNumber补全更新操作LOB数据,0:关闭,1:开启
  keep_seq_syncString序列校准
  gen_txnNumber定期在源库产生空事务,0:关闭,1:开启
  merge_trackNumber统一解析,0:关闭,1:开启
  storage_settingsObject存储设置
    src_max_memNumber源端内存缓存上限(MB)
    src_max_diskNumber源端磁盘缓存上限(MB)
    txn_max_memNumber事务最大内存占用(KB)
    tf_max_sizeNumber最大跟踪文件大小(MB)
    max_ld_memNumber增量装载队列内存上限(MB)
    keep_incre_timeNumber备端保留增量导出数据时长
  error_handlingObject错误处理设置
    load_err_setString装载错误处理方式
continue 继续装载
stopld:停止装载
stoptabld:停止此表装载
    drpString删除时未找到记录
ignore :忽略
err:报错
    irpString插入时记录冲突
"irpafterdel" (删除后插入,默认值)
"tourp"(转换为更新)
"err"(报错)
以上为原有值不变,新增以下三个值:
"choose_bigger" (按指定字段更大值插入)
"choose_smaller" (按指定字段更小值插入)
"sp" (执行指定存储过程)
    urpString更新时为找到记录
toirp: 转换为插入
err:报错
    infoString上传dml 错误,0:关闭,1:开启
    report_failed_dmlString指定信息,表示用户指定的字段名或者存储过程名称。
  dml_trackObjectDML操作追踪设置
    change_table_structureBoolean变更同步表结构
    date_time_column_uniqueString操作产生时间字段值主键
    load_date_time_column_uniqueBoolean操作装载时间字段值主键
    op_columnString操作标记字段名
    opv_insertString操作标记字段:插入操作标记值
    opv_updateString操作标记字段:更新操作标记值
    opv_update_keyString操作标记字段:更新主键、唯一键操作标记值
    opv_deleteString操作标记字段:删除操作标记值
    auditBoolean是否启用审计表
    audit_prefixString审计表前辍
    audit_appendixString审计表后辍
    identity_columnString自增列字段
    load_date_columnString操作装载时间字段名称仅日期
    load_time_columnString操作装载时间字段名称仅时间
    load_date_time_columnBoolean操作装载时间字段名称时间和日期
    keep_deleted_rowBoolean是否保留删除列 true
    date_columnString操作日期字段名
    time_columnString操作时间字段名
    date_time_columnString操作日期+时间字段名
full_sync_obj_filterObject全同步对象过滤
  full_sync_obj_dataArray["PROCEDURE","PACKAGE","PACKAGE BODY","DATABASE LINK","OLD JOB","JOB","PRIVS","CONSTRAINT","JAVA RESOURCE","JAVA SOURCE"]
inc_sync_ddl_filterObject增量同步对象ddl过滤
  inc_sync_ddl_dataArray["INDEX","VIEW","FUNCTION"]
other_settingsObject其他设置
  table_delay_loadArray表延迟约束装载设置
  keep_dyn_dataNumber0
  dyn_threadNumber1
  dly_constraint_loadNumber0
  zip_levelNumber0
  ddl_cvNumber备端对删除的表进行备份0
  keep_bad_actNumber0
  keep_usr_pwdNumber备库保留存在用户的密码1
  convert_urp_of_keyNumber0
  ignore_foreign_keyNumber忽略外键依赖0
  run_timeString运行时间"1200:00-13:0040M,300:00-13:0040M"
  table_change_infoNumber表结构变更通知
  jointingObject字段拼接
    tableString
    opString操作
op类型定义
前辍 prefix 后辍 append 常量 const 拼接 join 加 add 减 sub 乘 multiply 除 divide
append
    contentArray目标列+其他两行
  enable_truncate_frequenceNumbertruncate频率限制 0:关 1:开
  tgt_extern_tableString备端外部表存储位置
  bw_limitString宽带设置
  etl_tableArrayetl设置
    oprTypeString
    tableString
    userString
    processString
    addInfoString
  filter_table_settingsObject表过滤设置
    exclude_tableArray表过滤设置
      userString用户名
      tableString表名
    exclude_tab_with_columnString格式为:用户,列1,列2,列3。(用户支持星号)例:
["U1, ID, NAME", "
, CARD"]
    exclude_tab_with_column_switchNumber按列匹配过滤表,0:关闭,1:开启
  table_space_mapObject表空间设置
    tgt_table_spaceString备端表空间存储位置
    table_mapping_wayString
    table_path_mapObject{"ddd":"sss","ddd1":"sss1"}
    table_space_nameObject{"qq":"ss"}
biz_grp_listArray业务组
compress_encrypt_settingsObject压缩加密设置
  compress_switchString压缩开关0:关,1:开
  compress_levelString压缩等级 1-9(算法为snappy固定为0,为lzma时可以选1-22)
  compress_algoString压缩算法:lz4,zip,bzip2,snappy,zstd,lzma
  encrypt_switchString加密开关0:关,1:开
  encryptString加密算法
  compressString压缩级别 1 2 3 4 5 6 7 8 9 0(0为自定义压缩)
policy_settingsObject运行策略
  policy_typeString
  one_timeString
  policiesString
maintenanceNumber维护模式,0:关,1:开
is_duplicateNumber是否被复制规则,0:关,1:开
full_map_switchNumber是否整库映射,0:关,1:开

Response

名称类型必选简介Mock初始值Mock规则
retNumber200
msgString
dataObject
  uuidString@uuid
  codeNumber0
  messageStringsuccess

同步规则 - 批量新建

SDK方法名:createBatchOracleRule;

URL

/sync_rule/batch

Method

POST

Request

名称类型必选简介Mock初始值Mock规则
prefixString前缀
db_listArray
  rule_uuidString
  src_db_uuidString
  src_auth_db_uuidString
  tgt_db_uuidString
  tgt_auth_db_uuidString
commentString备注
start_rule_nowNumber开始规则0
map_type_listArray映射方式
user_mapObject用户映射模式{"CTT":"CTT"}
table_mapArray表映射模式
  keyArray自定义主键key列@last3
  split_dst_tableArray
    conditionString拆分条件
    dst_tableString备端表名
    dst_userString备端用户
  dst_tableString备端表名a
  dst_userString备端用户b
  src_tableString源端表名c
  src_userString源端用户d
  columnArray
    dst_columnString备端字段e
    src_columnString源端字段f
column_mapObject按列匹配设置
  include_tab_with_columnArray格式为:用户,列1,列2,列3。(用户支持星号)例:
["U1, ID, NAME", "
, CARD"]
    userString原用户
    targetString目标用户或目标topic(kafka)
    columnString列名
  include_tab_with_column_switchString按列匹配,0:关闭,1:开启
base_settingsObject基本设置
  dbmap_topicString备端kafka整库映射topic
  json_templateStringjson模板
  binary_codeString二进制数据编码方式(hex、base64)
  kafka_message_encodingString消息字符集(UTF-8、GBK)
  kafka_time_outNumberProducer超时时间(毫秒)
  part_load_balanceString分区均衡策略(by_table、by_key)
  row_map_modeString行映射方式
(rowid、where、auto)
  save_json_textBoolean保存为额外json
  message_formatString消息格式(protobuf、json)
full_sync_settingsObject全同步设置
  dump_thdNumber1
  clean_user_before_dumpNumber0
  existing_tableStringdrop_to_recycle
  sync_modeNumber0
  start_scnString
  keep_exist_tableNumber0
  keep_tableNumber0
  load_thdNumber1
  ld_dir_optNumber0
  his_threadNumber1
  try_split_part_tableNumber0
  concurrent_tableArray["hello.world"]
  full_sync_custom_cfgArray全局自定义配置
    keyString
    valueString
filter_table_settingsObject表过滤设置
  exclude_tableArray表过滤设置
    userString用户名
    tableString表名
  exclude_tab_with_columnArray格式为:用户,列1,列2,列3。(用户支持星号)例:
["U1, ID, NAME", "
, CARD"]
  exclude_tab_with_column_switchNumber0:关闭,1:开启
incre_sync_settingsObject增量设置
  incre_syncNumber增量同步
  dyn_threadNumber增量装载线程数
  convert_urp_of_keyNumber转换更新主键操作
  sync_lobNumber同步LOB数据
  gen_txnNumber定期在源库产生空事务
  merge_trackNumber统一解析
  keep_bad_actNumber保留装载失败事务
full_sync_obj_filterObject全同步对象过滤
  full_sync_obj_dataArray["PROCEDURE","PACKAGE","PACKAGE BODY","DATABASE LINK","OLD JOB","JOB","PRIVS","CONSTRAINT","JAVA RESOURCE","JAVA SOURCE"]
inc_sync_ddl_filterObject增量同步对象ddl过滤
  inc_sync_ddl_dataArray["INDEX","VIEW","FUNCTION"]
etl_settingsObjectetl设置
  etl_tableArray
    oprTypeStringIRP
    tableString
    userString
    processStringSKIP
    addInfoString
other_settingsObject其他设置
  gen_txnString
  table_delay_loadArray["hh.ww"]
  keep_dyn_dataNumber0
  dyn_threadNumber1
  dly_constraint_loadNumber0
  zip_levelNumber0
  ddl_cvNumber备端对删除的表进行备份0
  keep_bad_actNumber0
  keep_usr_pwdNumber1
  convert_urp_of_keyNumber0
  ignore_foreign_keyNumber0
  run_timeString运行时间"1200:00-13:0040M,300:00-13:0040M"
  table_change_infoNumber表结构变更通知
  jointingObject字段拼接
    tableString
    opString操作
op类型定义
前辍 prefix 后辍 append 常量 const 拼接 join 加 add 减 sub 乘 multiply 除 divide
append
    contentArray目标列+其他两行
  encrypt_switchNumber
  encrypt_typeNumber
  enable_truncate_frequenceNumbertruncate频率限制 0:关 1:开
  merge_trackString统一解析
  message_formatStringprotobuf
json
  json_formatStringjson
canaljson
message_format为json时,可传json , canaljson, 其他值传空串
  fill_lob_columnString
  keep_seq_syncString
storage_settingsObject存储设置
  keep_incre_timeString备端保留增量导出数据时长
  src_max_memNumber源端内存缓存上限512
  src_max_diskNumber源端磁盘缓存上限5000
  txn_max_memNumber事务最大内存占用10000
  tf_max_sizeNumber最大跟踪文件大小100
  tgt_extern_tableString
  max_ld_memString
table_space_mapObject表空间映射
  tgt_table_spaceString备端表空间存储位置
  table_mapping_wayStringptop
  table_path_mapObject{"ddd":"sss","ddd1":"sss1"}
  table_space_nameObject{"qq":"ss"}
bw_settingsObject宽带设置
  bw_limitString"1200:00-13:0040M,300:00-13:0040M"
biz_grp_listArray业务组
error_handlingObject错误处理
  load_err_setString装载错误处理方式
continue 继续装载
stopld:停止装载
stoptabld:停止此表装载
continue
  drpString删除时未找到记录
ignore :忽略
err:报错
ignore
  irpString插入时记录冲突
"irpafterdel" (删除后插入,默认值)
"tourp"(转换为更新)
"err"(报错)
以上为原有值不变,新增以下三个值:
"choose_bigger" (按指定字段更大值插入)
"choose_smaller" (按指定字段更小值插入)
"sp" (执行指定存储过程)
irpafterdel
  urpString更新时为找到记录
toirp: 转换为插入
err:报错
toirp
  report_failed_dmlNumber上传dml 错误
0:没选中
1:选中
  infoString任意字符串,表示用户指定的字段名或者存储过程名称。
dml_trackArrayDML操作追踪设置
  change_table_structureBoolean变更同步表结构
  date_time_column_uniqueBoolean操作产生时间字段值主键
  load_date_time_column_uniqueBoolean操作装载时间字段值主键
  op_columnString操作标记字段名
  opv_insertString操作标记字段:插入操作标记值
  opv_updateString操作标记字段:更新操作标记值
  opv_update_keyString操作标记字段:更新主键、唯一键操作标记值
  opv_deleteString操作标记字段:删除操作标记值
  auditBoolean是否启用审计表
  audit_prefixString审计表前辍
  audit_appendixString审计表后辍
  identity_columnString自增列字段AUTO_INCR
  load_date_columnString装载仅日期
  load_time_columnString装载仅时间
  load_date_time_columnString时间和日期
  enableBoolean是否启用 true
  keep_deleted_rowBoolean是否保留删除列 true
  date_columnString操作日期字段名
  time_columnString操作时间字段名
  date_time_columnString操作日期+时间字段名
compress_encrypt_settingsObject压缩加密设置
  compress_switchString压缩开关0:关,1:开
  compress_levelString压缩等级 1-9(算法为snappy固定为0,为lzma时可以选1-22)
  compress_algoString压缩算法:lz4,zip,bzip2,snappy,zstd,lzma
  encrypt_switchString加密开关0:关,1:开
  encryptString加密算法
  compressString压缩级别 1 2 3 4 5 6 7 8 9 0(0为自定义压缩)

Response

名称类型必选简介Mock初始值Mock规则
retNumber200
msgString
dataObject
  uuidString@uuid
  codeNumber0
  messageStringsuccess

同步规则 - 批量修改

SDK方法名:batchModifySyncRule; 批量修改同步规则

URL

/sync_rule/batch

Method

PUT

Request

名称类型必选简介Mock初始值Mock规则
rule_uuidsArray规则uuid数组
batch_base_settingsString批量修改基本设置开关(包含映射部分)
0:关,1:开
batch_full_sync_settingsString批量修改全量设置开关
0:关,1:开
batch_inc_sync_settingsString批量修改增量设置开关
0:关,1:开
batch_full_sync_obj_filterString批量修改全量对象过滤设置开关
0:关,1:开
batch_inc_sync_ddl_filterString批量修改增量DDL过滤设置设置开关
0:关,1:开
batch_other_settingsString批量修改高级设置设置开关
0:关,1:开
batch_compress_encrypt_settingsString批量修改压缩加设置设置开关
0:关,1:开
map_type_listArray映射方式
base_settingsObject基本设置
  dbmap_topicString备端kafka整库映射topic
  json_templateStringjson模板
  binary_codeString二进制数据编码方式(hex、base64)
  kafka_message_encodingString消息字符集(UTF-8、GBK)
  kafka_time_outNumberProducer超时时间(毫秒)
  part_load_balanceString分区均衡策略(by_table、by_key)
  row_map_modeString行映射方式
(rowid、where、auto)
  save_json_textBoolean保存为额外json
  message_formatString消息格式(protobuf、json)
  full_sync_modeString全同步方式,逻辑:logic 物理 physics 自动 auto
  lib_nameString日志库名
  jnr_nameString日志名称
  exclude_dbsArray排除库列表
  exclude_dbs_switchString排除库开关,0:关,1:开
  start_rule_nowString立即开始规则,0:关,1:开
user_mapObject用户映射模式
  src_userStringuser1
  tgt_userStringuser2
table_mapArray表映射模式
  keyArray自定义主键key列@last3
  split_dst_tableArray表拆分
    conditionString拆分条件
    dst_tableString备端表名
    dst_userString备端用户
  dst_tableString备端表名a
  dst_userString备端用户b
  src_tableString源端表名c
  src_userString源端用户d
  columnArray
    dst_columnString备端字段e
    src_columnString源端字段f
column_mapObject按列匹配映射,格式为:用户,列1,列2,列3。(用户支持星号)例:
["U1, ID, NAME", "
, CARD"]
  userString原用户
  targetString目标用户或目标topic(kafka)
  columnString列名
full_sync_settingsObject全量设置
  dump_thdNumber1
  clean_user_before_dumpNumber0
  existing_tableStringdrop_to_recycle
  full_syncNumber整库开关0
  start_scnString
  keep_exist_tableNumber0
  keep_tableNumber0
  load_thdNumber1
  ld_dir_optNumber0
  try_split_part_tableNumber0
  concurrent_tableArray["hello.world"]
  full_sync_custom_cfgArray全局自定义配置
    keyString
    valueString
inc_sync_settingsObject增量设置
  incre_syncNumber增量同步,0:关闭,1:开启
  dyn_threadNumber增量装载线程数
  ddl_cvNumber备端对删除的表进行备份,0:关闭,1:开启
  convert_urp_of_keyString转换更新主键操作
  sync_lobNumber同步LOB数据,0:关闭,1:开启
  keep_bad_actNumber保留装载失败事务,0:关闭,1:开启
  fill_lob_columnNumber补全更新操作LOB数据,0:关闭,1:开启
  keep_seq_syncString序列校准
  gen_txnNumber定期在源库产生空事务,0:关闭,1:开启
  merge_trackNumber统一解析,0:关闭,1:开启
  storage_settingsObject存储设置
    src_max_memNumber源端内存缓存上限(MB)
    src_max_diskNumber源端磁盘缓存上限(MB)
    txn_max_memNumber事务最大内存占用(KB)
    tf_max_sizeNumber最大跟踪文件大小(MB)
    max_ld_memNumber增量装载队列内存上限(MB)
    keep_incre_timeNumber备端保留增量导出数据时长
  error_handlingObject错误处理设置
    load_err_setString装载错误处理方式
continue 继续装载
stopld:停止装载
stoptabld:停止此表装载
    drpString删除时未找到记录
ignore :忽略
err:报错
    irpString插入时记录冲突
"irpafterdel" (删除后插入,默认值)
"tourp"(转换为更新)
"err"(报错)
以上为原有值不变,新增以下三个值:
"choose_bigger" (按指定字段更大值插入)
"choose_smaller" (按指定字段更小值插入)
"sp" (执行指定存储过程)
    urpString更新时为找到记录
toirp: 转换为插入
err:报错
    infoString上传dml 错误,0:关闭,1:开启
    report_failed_dmlString指定信息,表示用户指定的字段名或者存储过程名称。
  dml_trackObjectDML操作追踪设置
    change_table_structureBoolean变更同步表结构
    date_time_column_uniqueString操作产生时间字段值主键
    load_date_time_column_uniqueBoolean操作装载时间字段值主键
    op_columnString操作标记字段名
    opv_insertString操作标记字段:插入操作标记值
    opv_updateString操作标记字段:更新操作标记值
    opv_update_keyString操作标记字段:更新主键、唯一键操作标记值
    opv_deleteString操作标记字段:删除操作标记值
    auditBoolean是否启用审计表
    audit_prefixString审计表前辍
    audit_appendixString审计表后辍
    identity_columnString自增列字段
    load_date_columnString操作装载时间字段名称仅日期
    load_time_columnString操作装载时间字段名称仅时间
    load_date_time_columnBoolean操作装载时间字段名称时间和日期
    keep_deleted_rowBoolean是否保留删除列 true
    date_columnString操作日期字段名
    time_columnString操作时间字段名
    date_time_columnString操作日期+时间字段名
full_sync_obj_filterObject全同步对象过滤
  full_sync_obj_dataArray["PROCEDURE","PACKAGE","PACKAGE BODY","DATABASE LINK","OLD JOB","JOB","PRIVS","CONSTRAINT","JAVA RESOURCE","JAVA SOURCE"]
inc_sync_ddl_filterObject增量同步对象ddl过滤
  inc_sync_ddl_dataArray["INDEX","VIEW","FUNCTION"]
other_settingsObject其他设置
  table_delay_loadArray表延迟约束装载设置
  keep_dyn_dataNumber0
  dyn_threadNumber1
  dly_constraint_loadNumber0
  zip_levelNumber0
  ddl_cvNumber备端对删除的表进行备份0
  keep_bad_actNumber0
  keep_usr_pwdNumber备库保留存在用户的密码1
  convert_urp_of_keyNumber0
  ignore_foreign_keyNumber忽略外键依赖0
  run_timeString运行时间"1200:00-13:0040M,300:00-13:0040M"
  table_change_infoNumber表结构变更通知
  jointingObject字段拼接
    tableString
    opString操作
op类型定义
前辍 prefix 后辍 append 常量 const 拼接 join 加 add 减 sub 乘 multiply 除 divide
append
    contentArray目标列+其他两行
  enable_truncate_frequenceNumbertruncate频率限制 0:关 1:开
  tgt_extern_tableString备端外部表存储位置
  bw_limitString宽带设置
  etl_tableArrayetl设置
    oprTypeString
    tableString
    userString
    processString
    addInfoString
  filter_table_settingsObject表过滤设置
    exclude_tableArray表过滤设置
      userString用户名
      tableString表名
    exclude_tab_with_columnString格式为:用户,列1,列2,列3。(用户支持星号)例:
["U1, ID, NAME", "
, CARD"]
    exclude_tab_with_column_switchNumber按列匹配过滤表,0:关闭,1:开启
  table_space_mapObject表空间设置
    tgt_table_spaceString备端表空间存储位置
    table_mapping_wayString
    table_path_mapObject{"ddd":"sss","ddd1":"sss1"}
    table_space_nameObject{"qq":"ss"}
biz_grp_listArray业务组
compress_encrypt_settingsObject压缩加密设置
  compress_switchString压缩开关0:关,1:开
  compress_levelString压缩等级 1-9(算法为snappy固定为0,为lzma时可以选1-22)
  compress_algoString压缩算法:lz4,zip,bzip2,snappy,zstd,lzma
  encrypt_switchString加密开关0:关,1:开
  encryptString加密算法
  compressString压缩级别 1 2 3 4 5 6 7 8 9 0(0为自定义压缩)
policy_settingsObject运行策略
  policy_typeString
  one_timeString
  policiesString
maintenanceNumber维护模式,0:关,1:开
is_duplicateNumber是否被复制规则,0:关,1:开
full_map_switchNumber是否整库映射,0:关,1:开

Response

名称类型必选简介Mock初始值Mock规则
retNumber200
msgString
dataObject
  uuidString@uuid
  codeNumber0
  messageStringsuccess

同步规则 - 操作

SDK方法名:

继续:resumeOracleRule;

停止:stopOracleRule;

重启:restartOracleRule

开始日志解析:startAnalysisOracleRule;

停止日志解析:stopAnalysisOracleRule;

重新日志解析:resetAnalysisOracleRule;

停止规则并停止日志解析:stopAndStopanalysisOracleRule;

复制:duplicateOracleRule

URL

/sync_rule/operate

Method

POST

Request

名称类型必选简介Mock初始值Mock规则
rule_uuidsArray规则uuid['@guid']10
operateStringresume 继续
stop 停止
restart 重启
start_analysis 启动解析
stop_analysis 停止解析
reset_analysis 重置解析
stop_and_stopanalysis 停止并停止解析
duplicate 复制
reverse_restart 重启反向同步
reverse_stop 停止反向同步
bk_takeover_restart 重新接管
bk_takeover_stop 停止接管
table_fix 表修复
restart
scnString(重置解析)SCN1
allNumber(重置解析)重置源库所有规则
rule_nameString(复制)复制的规则新名称
tabArray(表修复)修复映射关系
  userString用户
  tableString表名
fix_relationNumber(表修复)是否修复关联表,0:关,1:开

Response

名称类型必选简介Mock初始值Mock规则
retNumber200
msgString
dataObject
  messageString
  codeNumber0
  dataObject
    success_listArray5
      codeNumber,0
      messageString
      rule_uuidString
      rule_nameFunction($x)=>{return JSON.stringify(arguments, null, 2);}
      idNumber+1
    fail_listArray5
      codeNumber-1
      messageString
    all_listArray10
      codeNumber@pick(0,-1)
      messageString

同步规则 - 删除

SDK方法名:deleteOracleRule

URL

/sync_rule

Method

DELETE

Request

名称类型必选简介Mock初始值Mock规则
rule_uuidsObject规则数组
forceBoolean

Response

名称类型必选简介Mock初始值Mock规则
msgString
dataObject
  codeNumber1
  messageStringDelete success
  success_listArray
    codeString0
    rule_uuidStringsfasf
    rule_nameStringdddddd
    messageStringdddd
  fail_listArray
    codeNumber-1
    messageStringdfrrr
    rule_uuidStringyrtrshgf
    rule_nameStringgfhfdhfsh
retNumber200

同步规则-获取单个

SDK方法名:describeSyncRules

URL

/sync_rule/:uuid([A-F0-9-]+)

Method

GET

Request

名称类型必选简介Mock初始值Mock规则
uuidStringF530FB0E-0208-9071-66D3-E595AE7D5A4C

Response

名称类型必选简介Mock初始值Mock规则
retNumber200
msgString
dataObject
  messageStringsuccess
  codeNumber0
  info_listObject
    rule_uuidString751A03F5-C97D-645B-82B2-316A5D198528
    src_db_uuidString4CA773F4-36E3-A091-122C-ACDFB2112C21
    tgt_db_uuidString40405FD3-DB86-DC8A-81C9-C137B6FDECE5
    tgt_typeStringkafka
    db_user_mapString{"11":"1122"}
    row_map_modeStringrowid
    map_typeStringuser
    table_mapArray[{src_user: "111", src_table: "222", dst_user: "3", dst_table: "4"}]
    dbmap_topicString
    node_uuidString
    sync_modeNumber0
    start_scnString0
    full_sync_settingsObject
      keep_exist_tableNumber0
      keep_tableNumber0
      load_modeStringdirect
      ld_dir_optNumber0
      his_threadNumber1
      try_split_part_tableNumber0
      concurrent_tableArray["hello.world"]
    rule_nameStringctt->ctt
    inc_sync_ddl_filterObject
      inc_sync_ddl_dataArray["CREATE TABLE","DROP TABLE","ALTER TABLE"]
    filter_table_settingsObject
      exclude_tableArray["hh.ww"]
    etl_settingsObject
      etl_tableArray[{obj_fix_type: "URP", user: "123", table: "123", deal_type: "SKIP", field_condition: "44"}]
    start_rule_nowNumber0
    storage_settingsObject
      src_max_memNumber512
      src_max_diskNumber5000
      txn_max_memNumber10000
      tf_max_sizeNumber100
      tgt_extern_tableString
    error_handlingObject
      load_err_setStringcontinue
      drpStringignore
      irpStringirpafterdel
      urpStringtoirp
    table_space_mapObject
      tgt_table_spaceString
      table_mapping_wayStringptop
      table_path_mapString{"ddd":"sss"}
      table_space_nameString{"qq":"ss"}
    other_settingsObject
      keep_dyn_dataNumber0
      dyn_threadNumber1
      dly_constraint_loadNumber0
      zip_levelNumber0
      ddl_cvNumber0
      keep_bad_actNumber0
      keep_usr_pwdNumber1
      convert_urp_of_keyNumber0
      ignore_foreign_keyNumber0
    bw_settingsObject
      bw_limitString1200:00-13:0040k,300:00-13:0040m
    biz_grp_listArray业务组
    dml_trackObject
      enableNumber1
      urpNumber0
      drpNumber1
      tmcolString
      delcolString
    producer_send_timeString66666
    part_load_balanceStringby_table
    kafka_time_outString132000
    full_sync_obj_filterObject
      full_sync_obj_dataArray["PROCEDURE","PACKAGE","PACKAGE BODY","DATABASE LINK","OLD JOB","JOB","PRIVS","CONSTRAINT","JAVA RESOURCE","JAVA SOURCE"]

同步规则-状态

SDK方法名:listSyncRulesStatus

URL

/sync_rule/status

Method

GET

Request

名称类型必选简介Mock初始值Mock规则
uuidsArray

Response

名称类型必选简介Mock初始值Mock规则
retNumber200
msgString
dataObject
  codeNumber0
  messageString[0] 操作成功。
  has_false_ruleBoolean是否有残留规则false
  info_listArray2
    rule_uuidString同步规则 uuid['6ECF19A1-3754-1490-C6A3-52AFB4D7F497', '6ECF19A1-3754-1490-C6A3-52AFB4D7F496']+1
    work_stateObject导出状态信息
      statusStringACTIVE_RULE_NORMAL : 正常
ACTIVE_RULE_ABNORMAL : 异常
ACTIVE_RULE_TRACK : 增量
ACTIVE_RULE_TRACK_WARNING : 增量
ACTIVE_RULE_PAUSE : 停止
ACTIVE_RULE_STOP : 停止
ACTIVE_RULE_DUMPDICT : 准备
ACTIVE_RULE_DUMP : 全量
ACTIVE_RULE_DONE : 完成
ACTIVE_RULE_FINISH : 完成
ACTIVE_RULE_ERROR : 错误
ACTIVE_RULE_INIT : 未启动
ACTIVE_RULE_FIX : 修复中
ACTIVE_RULE_UNKNOWN : 未知
ACTIVE_RULE_ONLINE : 在线
ACTIVE_RULE_WARN : 警告
ACTIVE_RULE_DOING : 在线
ACTIVE_RULE_ : 未知
ACTIVE_RULE_OFFLINE : 停止
ACTIVE_RULE_RUN : 运行
ACTIVE_RULE_WAIT : 准备
ACTIVE_REVERSE_FINISH : 完成
ACTIVE_REVERSE_ABNORMAL : 异常
ACTIVE_REVERSE_WARN : 警告
ACTIVE_REVERSE_UNKNOWN : 未知
ACTIVE_REVERSE_ : 未知
ACTIVE_REVERSE_FINISH : 完成
ACTIVE_REVERSE_ABNORMAL : 异常
ACTIVE_REVERSE_WARN : 警告
ACTIVE_REVERSE_UNKNOWN : 未知
ACTIVE_REVERSE_ : 未知
REVERSE_DOING : 在线
REVERSE_DONE : 完成
REVERSE_STOP : 停止
REVERSE_PAUSE : 暂停
ACTIVE_RULE_SCHEDULING : [调度中]
ACTIVE_RULE_STOP_SCHEDUL : [停止调度]
OBJ_FIX_DOING : 正在修复
OBJ_FIX_DONE : 修复完成
OBJ_FIX_ERROR : 修复错误
OBJ_FIX_UNKNOWN : 未知
OBJ_FIX_STOP : 停止修复
OBJ_FIX_ABNORMAL : 修复异常
OBJ_FIX_PAUSE : 停止
OBJ_FIX_OFFLINE : 离线
CMP_ABNORMAL : 比较异常
CMP_DOING : 正在比较
CMP_DONE : 比较完成
CMP_ERROR : 比较错误
CMP_UNKNOWN : 未知
CMP_PAUSE : 停止
CMP_STOP : 停止
CMP_WAIT : 等待中
CMP_OFFLINE : 离线
TAKEOVER_UNKNOWN : 未知
TAKEOVER_DOING : 正在接管
TAKEOVER_DONE : 接管完成
TAKEOVER_ERROR : 接管错误
TAKEOVER_STOP : 接管停止
TAKEOVER_ABNORMAL : 接管异常
TAKEOVER_OFFLINE : 离线
ACTIVE_RULE_TRACK
      error_codeNumber-4018
      progressString[98, 66]+1
    back_stateObject装载信息
      statusString同上work_stateACTIVE_RULE_PAUSE
    relay_stateObject中继节点的信息
      statusString同上work_state
      error_codeString
    track_stateObject解析状态信息
      statusString同上work_state['ACTIVE_RULE_PAUSE', 'OFFLINE']+1
    src_stateObject此功能对应数据源的状态,领导要求暂时屏蔽此功能,可不看
      statusStringACTIVE_RULE_UNKNOWN
    dst_stateObject同src_state
      statusStringACTIVE_RULE_UNKNOWN
    extractString解析时间-
    loadString装载时间-
    delayNumber延迟0
    peakNumber峰值0
    has_new_errNumber对应日志报警 1:显示有新的日志
0:没有新日志产生
1
    data_infoObject对应的悬浮框内的信息
      dstObject目标端
        db_ipArray目标端ip["192.168.12.199"]
        node_ipString节点ip192.168.12.199
        node_nameString名称test_c199
        log_read_typeString日志读取方式file
        orclString服务名orcl
      srcObject数据源
        db_ipArray数据库ip["192.168.12.200"]
        node_ipString节点ip192.168.12.200
        node_nameString节点名test_c200
        log_read_typeString读取方式file
        orclString服务名orcl
    stageString对应原先功能总览->同步规则的功能,暂时弃用PAUSE
    stateNumber对应原先功能总览->同步规则的功能,暂时弃用-4018
    progressNull对应原先功能总览->同步规则的功能,暂时弃用
    scheduleStateStringACTIVE_RULE_SCHEDULING:调度中
ACTIVE_RULE_STOP_SCHEDUL:停止调度
ACTIVE_RULE_STOP_SCHEDUL

同步规则-日志(复用旧接口)

SDK方法名:listRuleLog;同规则的日志管理

URL

/active/rule/log

Method

POST

Request

名称类型必选简介Mock初始值Mock规则
offsetNumber0
limitNumber10
date_startString开始时间@date
date_endString开始时间的结束时间@date
typeNumber0:错误 2:消息 -1:全部-1
module_typeNumber0:导出 1:装载 2:解析 3:中继 4:脱敏 -1 全部-1
query_typeNumber最新查询:1 最早查询:2 查询 :01
rule_uuidString规则uuidF530FB0E-0208-9071-66D3-E595AE7D5A4C
search_contentString关键词过滤test

Response

名称类型必选简介Mock初始值Mock规则
msgString
dataObject
  codeNumber0
  messageStringDelete success
  info_listArray5
    create_timeString2019-08-09 17:29:43
    detailStringFull Sync done, elapsed time: 24 sec'
    log_levelString日志级别 0:serious 2
2
    flagNumber0:正常, 1新信息 标红1
    log_typeString模块: 导出,装载,解析装载
    uuidString@uuid
  totalNumber666
retNumber200

同步规则 - 修改维护模式

SDK方法名:switchActiveRuleMaintenance

URL

/sync_rule/maintenance

Method

POST

Request

名称类型必选简介Mock初始值Mock规则
maintenance_switchString
uuidString

Response

名称类型必选简介Mock初始值Mock规则
retNumber0
msgString
dataObject
  codeNumber
  messageString

同步规则-增量失败DML统计

SDK方法名:describeSyncRulesDML

URL

/active/rule/incre_dml_summary

Method

POST

Request

名称类型必选简介Mock初始值Mock规则
offsetNumber偏移位置1
limitString搜索行数10
usrString用户
rule_uuidString规则uuid@guid
sort_orderString排序方式asc
searchString搜索
sortString

Response

名称类型必选简介Mock初始值Mock规则
retNumber200
msgString
dataObject
  codeNumber0
  messageString
  info_listArray
    usrStringusr
    table_nameStringtable200
    irp_error_numberNumber30
    urp_error_numberNumber60
    drp_error_numberNumber90
  totalNumber1

同步规则-已同步的对象具体信息

SDK方法名:describeSyncRulesObjInfo

URL

/active/rule/sync_obj_info

Method

POST

Request

名称类型必选简介Mock初始值Mock规则
offsetNumber0
limitNumber10
rule_uuidString@guid
usrString
sortString'eAll'
'eIRP'
'eURP'
'eDRP'
'nAll'
'nIRP'
'nURP'
'nDRP'
'byteDML'
sort_orderString
searchString

Response

名称类型必选简介Mock初始值Mock规则
retNumber200
msgString
dataObject
  messageString
  codeNumber0
  info_listArray1-5
    nAllNumber
    eAllNumber
    nameStringI2_1
    nRowString112003
    eIRPString0
    eURPString0
    eDRPString1
    nIRPString1
    nURPString1
    nDRPString1
    stateString-
    nDMLString增量总行数1
    byteIRPString插入字节1
    byteURPString更新字节1
    byteDRPString删除字节1
    byteDMLString增量总字节1
    startString开始时间
    endString结束时间
  totalNumber2000

同步规则-已同步的对象具体信息(DML解析)

SDK方法名:describeExtractSyncRulesObjInfo

URL

/active/rule/extract_sync_obj_info

Method

POST

Request

名称类型必选简介Mock初始值Mock规则
offsetNumber0
limitNumber10
rule_uuidString@guid
usrString
sortString'eAll'
'eIRP'
'eURP'
'eDRP'
'nAll'
'nIRP'
'nURP'
'nDRP'
'byteDML'
sort_orderString
searchString

Response

名称类型必选简介Mock初始值Mock规则
retNumber200
msgString
dataObject
  messageString
  codeNumber0
  info_listArray1-5
    nAllNumber
    eAllNumber
    nameStringI2_1
    nRowString112003
    eIRPString0
    eURPString0
    eDRPString1
    nIRPString1
    nURPString1
    nDRPString1
    stateString-
    nDMLString增量总行数1
    byteIRPString插入字节1
    byteURPString更新字节1
    byteDRPString删除字节1
    byteDMLString增量总字节1
    percentNumber
  totalNumber2000

同步规则-已同步的对象具体信息(DML解析)

SDK方法名:describeLoadSyncRulesObjInfo

URL

/active/rule/load_sync_obj_info

Method

POST

Request

名称类型必选简介Mock初始值Mock规则
offsetNumber0
limitNumber10
rule_uuidString@guid
usrString
sortString'eAll'
'eIRP'
'eURP'
'eDRP'
'nAll'
'nIRP'
'nURP'
'nDRP'
'byteDML'
sort_orderString
searchString

Response

名称类型必选简介Mock初始值Mock规则
retNumber200
msgString
dataObject
  messageString
  codeNumber0
  info_listArray1-5
    nAllNumber
    eAllNumber
    nameStringI2_1
    nRowString112003
    eIRPString0
    eURPString0
    eDRPString1
    nIRPString1
    nURPString1
    nDRPString1
    stateString-
    nDMLString增量总行数1
    byteIRPString插入字节1
    byteURPString更新字节1
    byteDRPString删除字节1
    byteDMLString增量总字节1
    percentNumber
  totalNumber2000

同步规则-已同步的对象

SDK方法名:describeSyncRulesHasSync

URL

/active/rule/sync_obj

Method

POST

Request

名称类型必选简介Mock初始值Mock规则
offsetString0
limitNumber10
row_uuidString@guid
searchString

Response

名称类型必选简介Mock初始值Mock规则
retNumber200
msgString
dataObject3
  messageString
  codeNumber0
  info_listArray2
    usrStringI2
    numString18/0
    indexString4/0
    viewString/
    functionString/
    procedureString/
    packageString/
    package_bodyString/
    synonymString/
    triggerString/
    sequenceString/
    java_sourceString/
    java_classString/
    java_resourceString/
    typeString/
    type_bobyString/
    queueString/
    materialized_viewString/
    dblinkString/
  totalNumber总共多少条数据1

同步规则-失败的对象

SDK方法名:describeSyncRulesFailObj

URL

/active/rule/fail_obj

Method

POST

Request

名称类型必选简介Mock初始值Mock规则
offsetNumber0
limitNumber10
rule_uuidString@guid
searchString
typeNumber全部:-1; 按对象类型收集错误对象,支持 0="TABLE", 1="TABLE PARTITION", 2="CONSTRAINT", 3="INDEX", 4="VIEW", 5="FUNCTION", 6="PROCEDURE", 7="PACKAGE", 8="PACKAGE BODY", 9="SYNONYM", 10="TRIGGER", 11="SEQUENCE", 12="JAVA SOURCE", 13="JAVA CLASS", 14="JAVA RESOURCE", 15="TYPE", 16="TYPE BODY", 17="QUEUE", 18="MATERIALIZED VIEW", 19="DATABASE LINK", 20="MATERIALIZED VIEW LOG", 21="JOB", 22="OLD JOB", 23="PRIVS", 24="LIBRARY", 25="INDEXTYPE", 26="USER", 27="TABLESPACE", 28="UDT",
stageNumber所有:-1 全量阶段:0 增量阶段:1

Response

名称类型必选简介Mock初始值Mock规则
retNumber200
msgString
dataObject
  messageString
  codeNumber0
  info_listArray
    usrString222
    nameStringdd
    typeStringTABLE
    stageNumber0 全量 1增量1
  totalNumber1

同步规则-装载信息流量图

SDK方法名:describeSyncRulesLoadInfo;装载信息

URL

/active/rule/load_info

Method

POST

Request

名称类型必选简介Mock初始值Mock规则
rule_uuidString规则uuid

Response

名称类型必选简介Mock初始值Mock规则
retNumber200
msgString
dataObject
  codeNumber0
  messageString
  info_listObject
    backObject备端信息
      full_backupArray2
        lineString01869964734445
        nameStringI2.COMDATALILY.BMSQL_ORDER_LINE12333333
        tunnelString76.7 MB76.7 MB
      load_threadArray2
        numString0
        sizeString0
      loader_infoObject
        actfailString0
        actloadString0
        compress_rateNumber0
        maxdelayString0ms
        scnTimeString1969-12-31 16:00:00
        txndelayString0ms
        scnString
      nameString200-db
      processNumber94.44
      stateStringdump
      uuidString4CFE1f68-B29e-E1b3-EE1c-7E51ebFcDf61
      preprocessObject
        splitString111
        irpString222
        urpString333
        drpString444
        ddlString555
      ldTypeStringkafka
      extLdStObject
        dml_cntObject
          urpString111
          drpString222
          failedString333
          irpString444
        update_timeString2020-03-24 15:24:57
        ddl_cntString666
    workObject工作机信息
      full_backupArray2
        lineString186996473
        nameStringLILY.BMSQL_ORDER_LINE
        tunnelString0 Bytes
      nameString199-db
      processNumber72.22
      stateStringdump
      threadsArray2
        numString0
        timeString2019-07-18 10:47:45
        breakpointString1285.16940
        lwnString1285.16940
        stateNumber0
      txnObject
        drpString19128
        irpString19138
        memString0 Bytes
        mempeakString828 Bytes
        qmiString0
        stateString0
        txnString20222
        urpString0
        delayString1
        maxdelayString1
      uuidString9Dbed7fd-1EEF-eA25-2611-eDBaCeC940FC
    relayObject中继信息
      stateNumber10
      outString111
      speedString5555
      cacheString56666
      memStringmem
      dskStringdsk
      wSeqString111
      rSeqString222

同步规则-增量失败dml

SDK方法名:listRuleIncreDml;增量失败

URL

/active/rule/incre_dml

Method

POST

Request

名称类型必选简介Mock初始值Mock规则
offsetNumber0
limitString10
rule_uuidString@guid

Response

名称类型必选简介Mock初始值Mock规则
retNumber200
msgString
dataObject
  codeNumber0
  messageString
  info_listArray
    create_timeString2019-07-23 12:10:57
    exe_sqlStringALTER TABLE "I2"."LIU" ADD ( "GENGYANQI" VARCHAR2 (100))
    messageStringORA-00942: table or view does not exist
    src_sqlString失败rowid :alter table liu add gengyanqi varchar(100)
    obj_nameStringTEST_DML
    opr_typeStringTABLE ADD
    user_nameStringI2
  totalNumber1

同步规则-已同步表

SDK方法名:listRuleSyncTable;已同步的表

URL

/active/rule/sync_table

Method

POST

Request

名称类型必选简介Mock初始值Mock规则
row_uuidString@guid
limitNumber15
offsetNumber1

Response

名称类型必选简介Mock初始值Mock规则
retNumber200
msgString
dataObject
  messageString
  codeNumber0
  info_listArray20
    doneNumber已同步的表
    dDrpNumber删除
    dIrpNumber插入
    dUrpNumber更新
    eDrpNumber错误删除
    eIrpNumber错误插入0
    eUrpNumber错误更新0
    errNumber出错表
    userNumber用户名0
    nDMLString增量总行数
    byteIRPString插入字节
    byteURPString更新字节
    byteDRPString删除字节
    byteDMLString增量总字节
  totalString5

同步规则-获取数据库表字段

SDK方法名:describeRuleZStructure;获取数据库表字段

URL

/active/rule/z_structure

Method

POST

Request

名称类型必选简介Mock初始值Mock规则
db_uuidString@guid
levelStringroot,user,col(0,1,2)
typeStringtab,user,db
tab_nameString搜索用到其他传空
type_valueStringtype 类型对应的值

Response

名称类型必选简介Mock初始值Mock规则
msgString
dataObject
  codeNumber0
  messageStringDelete success
  info_listArray2
    isParentBoolean没有子集 false,有 truetrue
    nameStringtest@name
retNumber200

同步规则-流量图

SDK方法名:describeSyncRulesMrtg;流量图

URL

/active/rule/mrtg

Method

POST

Request

名称类型必选简介Mock初始值Mock规则
set_timeNumber开始时默认set_time等于 1, 默认值有改动 set_time_ranger*(分,小时,天)

页面自动刷新时 返回值最后一个
1
typeStringtype:traffic,memusg,delay,load_txn,load_action
intervalNumber计算方式: var interval = set_time_range > 15 ? Math.ceil(set_time_range / 3) : 5;

页面根据实际情况返回
时间间隔
set_time_initString上次时间的最后一个值
rule_uuidString

Response

名称类型必选简介Mock初始值Mock规则
retNumber200
msgString
dataObject
  codeNumber0
  maxString
  minString
  lastdateString
  messageString
  info_listArray返回的数据7
    start_timeString2018/11/08 10:40:06
    trafficNumber时间间隔1-100
  info_list_maxArray只有在事务延迟的情况才有值7
    start_timeString2018/11/08 10:40:06
    trafficNumber1-100
  intervalNumber5
  uuidString

同步规则-装载延迟统计报表

SDK方法名:listRuleLoadDelayReport;

URL

/active/rule/load_delay_report

Method

POST

Request

名称类型必选简介Mock初始值Mock规则
typeStringsec
start_timeString
end_timeString
limitNumber10
offsetNumber0
uuidString1d2F6Fed-DAC6-FE94-A6cB-5Ab55415E9fd

Response

名称类型必选简介Mock初始值Mock规则
retNumber200
msgString
dataObject
  codeNumber0
  messageString[0] success
  totalNumber2161
  info_listObject
    2020-02-05 22:28Array3
      0Number9999
      1Number82
      2Number125
      3Number52
      4Number0
      5Number0
      6Number6
      7Number7
      8Number8
      9Number9
      10Number10
      11Number11
      12String12
    2020-02-05 22:29Array
      0Number0
      1Number0
      2Number0
      3Number12
      4Number70
      5Number150
      6Number6
      7Number7
      8Number8
      9Number9
      10Number10
      11Number11
      12Number668
    2020-02-05 22:30Array
      0Number87
      1Number8
      2Number0
      3Number0
      4Number0
      5Number0
      6Number6
      7Number7
      8Number8
      9Number9
      10Number10
      11Number11
      12Number12
    2020-02-05 22:31Array
      0Number0
      1Number12
      2Number78
      3Number89.0
      4Number16.5
      5Number19.0
      6Number10.8
      7Number9.03
      8Number3.09
      9Number1.09
      10Number188
      11Number1.5
      12Number1.2

同步规则-增量失败ddl

SDK方法名:describeSyncRulesIncreDdl;增量失败ddl

URL

/active/rule/incre_ddl

Method

POST

Request

名称类型必选简介Mock初始值Mock规则
offsetNumber0
limitString10
rule_uuidString@guid

Response

名称类型必选简介Mock初始值Mock规则
retNumber200
msgString
dataObject
  codeNumber0
  messageString
  info_listArray
    create_timeString2019-07-23 12:10:57
    exe_sqlStringALTER TABLE "I2"."LIU" ADD ( "GENGYANQI" VARCHAR2 (100))
    messageStringORA-00942: table or view does not exist
    obj_nameNumberLIU
    opr_typeNumberTABLE ADD
    src_sqlStringalter table liu add gengyanqi varchar(100)
    user_nameStringI2
  totalNumber1

同步规则-数据库预检

SDK方法名:describeRuleDbCheck;数据库预检

URL

/active/rule/db_check

Method

POST

Request

名称类型必选简介Mock初始值Mock规则
src_db_uuidString
dst_db_uuidString

Response

名称类型必选简介Mock初始值Mock规则
codeNumber0
retNumber200
msgString
dataObject
  messageString
  codeNumber0
  info_listObject
    verObject
      srcString11.1.0
      dstString11.0.0
      flagStringwarning
      msgStringbackVerNumLow
    langObject
      srcStringAMERICAN_AMERICA.AL32UTF8
      dstStringAMERICAN_AMERICA.AL32UTF8
      flagStringnormal
      msgString
    nlangObject
      srcStringAL32UTF16
      dstString
      flagStringwarning
      msgStringcharOnBothCountryIncon
    db_block_sizeObject
      srcString1
      dstString2
      flagStringwarning
      msgStringblockSizesTwoNotSame
    all_redo_sizeObject
      srcNumber1000
      dstNumber999
      flagStringnormal
      msgStringsmallCausePerTakeoverSlow
    max_processesObject
      srcNumber100
      dstNumber99
      flagStringwarning
      msgStringsmallCausePerTakeover
    db_fileObject
      src_db_fileNumber100
      dst_db_fileNumber999
      flagStringwarning
      msgStringsmallCauseCreateTableFileFail
    open_cursorObject
      srcNumber100
      dstNumber99
      flagStringwarning
      msgStringsmallCausePerTakeover
    partition_large_extentsObject
      srcBoolean
      dstNumberYES
      flagStringwarning
      msgStringcanLeadShortageTableSpace
    componentsObject
      srcArray[11,22]
      dstArray[11,22]
      flagStringnormal
      msgString
    not_support_objObject
      srcArray[11,22]
      dstArray[11,22]
      flagStringnormal
      msgString
    min_supple_logObject
      srcStringYES
      dstString
      flagStringwarning
      msgStringsourceMustMinAddLog
    force_loggingObject
      srcStringYES
      dstString
      flagStringwarning
      msgStringsourceMustLog
    index_partition_large_extentsObject
      srcBooleanYES
      dstBoolean
      flagStringwarning
      msgStringcanLeadShortageTableSpace
    open_archObject
      srcBooleanYES
      dstBooleanNO
      flagStringwarning
      msgStringcanLeadFullSlow
    db_connectObject
      srcBooleanYES
      dstBooleanYES
      flagStringerror
      msgString数据库连接失败,规则无法正常运行dbFailRuleNotRun
    noticeObject
      srcStringa\nb\n\c\n
      dstStringa
b
c
      flagStringwarning
      msgString

同步规则 - MySQL源端数据库环境检查

SDK方法名:streamRulePreCheck

URL

/stream/rule/db_check

Method

POST

Request

名称类型必选简介Mock初始值Mock规则
src_db_uuidString
dst_db_uuidString
map_typeString与新建同步规则一致
db_mapString与新建同步规则一致
tab_mapString与新建同步规则一致
tgt_typeString备端类型

Response

名称类型必选简介Mock初始值Mock规则
codeNumber0
retNumber200
msgString
dataObject
  messageString
  codeNumber0
  info_listObject
    verObject
      srcString11.1.0
      dstString11.0.0
      flagStringwarning
      msgStringbackVerNumLow
    server_character_setObject服务端字符集
      srcStringAMERICAN_AMERICA.AL32UTF8
      dstStringAMERICAN_AMERICA.AL32UTF8
      flagStringnormal
      msgString
    nlangObject数据库字符集
      srcStringAL32UTF16
      dstString
      flagStringwarning
      msgString
    enable_binlogObject开启binlog
      srcString1
      dstString2
      flagStringwarning
      msgString
    use_mysql_native_passwordObject使用 mysql_native_password 身份验证插件
      srcNumber1000
      dstNumber999
      flagStringnormal
      msgString
    contain_geometryObject数据源包含空间类型
      srcNumber100
      dstNumber99
      flagStringwarning
      msgStringsmallCausePerTakeover
    contain_jsonObject数据源包含json类型
      src_db_fileNumber100
      dst_db_fileNumber999
      flagStringwarning
      msgString
    data_garbleObject数据乱码
      srcNumber100
      dstNumber99
      flagStringwarning
      msgString
    null_stringsObject空字符
      srcBoolean
      dstNumberYES
      flagStringwarning
      msgString
    replication_slaveObject
      srcArrayYES
      dstArrayYES
      flagStringnormal
      msgString
    replication_clientObject
      srcStringYES
      dstString
      flagStringwarning
      msgStringsourceMustMinAddLog
    reloadObject
      srcStringYES
      dstString
      flagStringwarning
      msgString
    selectObject
      srcBooleanYES
      dstBoolean
      flagStringwarning
      msgString
    supperObject
      srcBooleanYES
      dstBooleanNO
      flagStringwarning
      msgString
    createObject
      srcBooleanYES
      dstBooleanYES
      flagStringerror
      msgString
    insertObject
      srcStringYES
      dstStringYES
      flagStringnormal
      msgString
    updateObject
      srcStringYES
      dstStringYES
      flagStringnormal
      msgString
    deleteObject
      srcStringYES
      dstStringYES
      flagStringnormal
      msgString
    dropObject
      srcStringYES
      dstStringYES
      flagStringnormal
      msgString
    db_connectObject
      srcString
      dstString
      flagStringnormal

同步规则-选择用户

SDK方法名:describeRuleSelectUser;选择用户

URL

/active/rule/select_user

Method

POST

Request

名称类型必选简介Mock初始值Mock规则
db_uuidString数据uuid@guid

Response

名称类型必选简介Mock初始值Mock规则
msgString
dataObject
  codeNumber0
  messageStringDelete success
  info_listArray6
    idString
    pidString
    db_uuidStringdb_uuid@guid
    nameString@name
retNumber200

同步规则-表修复

SDK方法名:describeRuleTableFix;表修复

URL

/active/rule/table_fix

Method

POST

Request

名称类型必选简介Mock初始值Mock规则
rule_uuidString规则uuidF530FB0E-0208-9071-66D3-E595AE7D5A4C
tabArrayI2.table["I2.table"]
fix_relationNumber0 无关联 1 有关联0

Response

名称类型必选简介Mock初始值Mock规则
retNumber200
msgString
dataObject
  messageString
  codeNumber0

同步规则-获取scn号

SDK方法名:describeRuleGetScn;

URL

/active/rule/get_scn

Method

GET

Request

名称类型必选简介Mock初始值Mock规则
uuidString@guid

Response

名称类型必选简介Mock初始值Mock规则
retNumber200
msgString
dataObject
  messageString
  codeNumber0
  scnString

同步规则 - 从底层获取SCN

getSCN获取SCN

URL

/active/rule/get_rpc_scn

Method

GET

Request

名称类型必选简介Mock初始值Mock规则
db_uuidString

Response

名称类型必选简介Mock初始值Mock规则
retString
msgString
dataObject
  messageString
  codeNumber
  scnString

同步规则 - 从底层获取接管SCN

getRevertSCN获取SCN

URL

/active/rule/get_revert_rpc_scn

Method

GET

Request

名称类型必选简介Mock初始值Mock规则
rule_uuidString

Response

名称类型必选简介Mock初始值Mock规则
retString
msgString
dataObject
  messageString
  codeNumber
  scnString

同步规则-装载统计报表

SDK方法名:listRuleLoadReport;

URL

/active/rule/load_report

Method

POST

Request

名称类型必选简介Mock初始值Mock规则
typeStringsec
start_timeString
end_timeString
limitNumber10
offsetNumber0
uuidString1d2F6Fed-DAC6-FE94-A6cB-5Ab55415E9fd

Response

名称类型必选简介Mock初始值Mock规则
codeNumber0
retNumber200
msgString
dataObject
  codeNumber0
  messageString[0] success
  totalNumber2161
  info_listObject
    2020-02-05 22:28Array3
      0Number56
      1Number82
      2Number125
      3Number52
      4Number0
      5Number0
      6Number6
      7Number7
      8Number8
      9Number9
      10Number10
      11Number11
      12String12
    2020-02-05 22:29Array
      0Number0
      1Number0
      2Number0
      3Number12
      4Number70
      5Number150
      6Number6
      7Number7
      8Number8
      9Number9
      11Number11
      10Number10
      12Number668
    2020-02-05 22:30Array
      0Number87
      1Number8
      2Number0
      3Number0
      4Number0
      5Number0
      6Number6
      7Number7
      8Number8
      9Number9
      10Number10
      11Number11
      12Number12
    2020-02-05 22:31Array
      0Number0
      1Number12
      2Number78
      3Number84
      4Number145
      5Number8
      6Number999
      7Number7777
      8Number888
      9Number9999
      10Number1000
      11Number1188
      12Number12576

同步规则-日志下载

SDK方法名:downloadLog

URL

/active/rule/log_download

Method

GET

Request

名称类型必选简介Mock初始值Mock规则
rule_uuidString
typeNumber日志级别
module_typeNumber模块
date_startNumber
date_endNumber

Response

名称类型必选简介Mock初始值Mock规则

同步规则-偏移量信息

SDK方法名:listKafkaOffsetInfo;

URL

/active/rule/kafka_offset

Method

POST

Request

名称类型必选简介Mock初始值Mock规则
rule_uuidString@guid

Response

名称类型必选简介Mock初始值Mock规则
info_listString
retNumber200
msgString
dataObject
  messageString
  codeNumber0
  info_listObject
    update_timeString2020-12-02 18:07:59
    kafka_latest_offsetArray2
      topicStringtest1
      partitionString0
      offsetString1
      timestampString2020-12-02 16:45:27

同步规则-增量失败统计删除(失败对象)

URL

/active/rule/incre_dml_summary

Method

DELETE

Request

名称类型必选简介Mock初始值Mock规则
uuidString
typeNumber0:同步失败对象
1:增量失败dml 统计信息
0

Response

名称类型必选简介Mock初始值Mock规则
retNumber200
msgString
dataObject
  codeNumber0
  messageStringsuccess

清除增量失败(ddl,dml)

URL

/active/rule/incre_dml

Method

DELETE

Request

名称类型必选简介Mock初始值Mock规则
uuidString
opr_typeStringddl 失败:ddl
dml 失败:dml
ddl

Response

名称类型必选简介Mock初始值Mock规则
retNumber200
msgString
dataObject
  codeNumber0
  messageStringsuccess

dml-一键修复

dml 修复所有坏表

URL

/active/rule/table_fix_all

Method

POST

Request

名称类型必选简介Mock初始值Mock规则
rule_uuidString规则uuid

Response

名称类型必选简介Mock初始值Mock规则
retNumber200
msgString
dataObject
  codeNumber0
  messageString
  info_listArray
    userString
    tableString

同步规则 - 增量表DML抽取统计

SDK方法名:listIncreDmlExtract

URL

/active/rule/incre_dml_extract

Method

POST

Request

名称类型必选简介Mock初始值Mock规则
rule_uuidString规则uuid@guid
offsetNumber
limitNumber

Response

名称类型必选简介Mock初始值Mock规则
retNumber200
msgString
dataObject
  codeNumber0
  messageString
  info_listArray1-10
    userString用户@first
    doneString表数量@last
    errString错误表数量@natural(1,100)
    dIrpString总的插入操作@natural(1,100)
    dUrpString总的更新操作@natural(1,100)
    dDrpString总的删除操作@natural(1,100)
    eIrpString总的插入出错操作@natural(1,100)
    eUrpString总的更新出错操作@natural(1,100)
    eDrpString总的删除出错操作@natural(1,100)
    nDMLString增量总行数@natural(1,100)
    byteIRPString插入字节@natural()
    byteURPString更新字节@natural(1,100)
    byteDRPString删除字节@natural(1,100)
    byteDMLString增量总字节@natural(1,100)
    eAllString错误总量@natural(1,100)
  totalNumber100

同步规则 - 增量表DML装载统计

SDK方法名:listIncreDmlLoad

URL

/active/rule/incre_dml_load

Method

POST

Request

名称类型必选简介Mock初始值Mock规则
rule_uuidString规则uuid@guid
offsetNumber
limitNumber

Response

名称类型必选简介Mock初始值Mock规则
retNumber200
msgString
dataObject
  codeNumber0
  messageString
  info_listArray1-10
    userString用户@first
    doneString表数量@last
    errString错误表数量@natural(1,100)
    dIrpString总的插入操作@natural(1,100)
    dUrpString总的更新操作@natural(1,100)
    dDrpString总的删除操作@natural(1,100)
    eIrpString总的插入出错操作@natural(1,100)
    eUrpString总的更新出错操作@natural(1,100)
    eDrpString总的删除出错操作@natural(1,100)
    nDMLString增量总行数@natural(1,100)
    byteIRPString插入字节@natural()
    byteURPString更新字节@natural(1,100)
    byteDRPString删除字节@natural(1,100)
    byteDMLString增量总字节@natural(1,100)
    eAllString错误总量@natural(1,100)
  totalNumber100

同步规则 - 解析热点图

SDK方法名:listExtractHeatMap

URL

/active/rule/extract_heat_map

Method

POST

Request

名称类型必选简介Mock初始值Mock规则
rule_uuidString规则uuid
topString取首N个最高的表

Response

名称类型必选简介Mock初始值Mock规则
retString
msgString
dataObject
  codeString
  messageString
  extract_info_listArray解析热点图,按照增量总字节排序1-10
    nameString表名@first
    stateString状态done
    byteIRPString插入字节@natural()
    byteURPString更新字节@natural()
    byteDRPString删除字节@natural()
    byteDMLString增量总字节@natural()

同步规则 - 装载热点图

SDK方法名:listLoadHeatMap

URL

/active/rule/load_heat_map

Method

POST

Request

名称类型必选简介Mock初始值Mock规则
rule_uuidString规则uuid
topString取首N个最高的表

Response

名称类型必选简介Mock初始值Mock规则
retString
msgString
dataObject
  codeString
  messageString
  load_info_listArray装载热点图,按照增量总字节排序1-10
    nameString表名@last
    stateString状态done
    byteIRPString插入字节@natural()
    byteURPString更新字节@natural()
    byteDRPString删除字节@natural()
    byteDMLString增量总字节@natural()
Last update: 2/26/2024, 5:49:44 PM
Contributors: ganl