数据检查

February 26, 2024About 18 min

数据检查

SDK类名:/active/DataChk;

示例接口

示例接口描述

URL

/example/1614233102246

Method

GET

Request

名称类型必选简介Mock初始值Mock规则
fooString请求属性示例@ctitle

Response

名称类型必选简介Mock初始值Mock规则
stringString字符串属性示例1-10
numberNumber数字属性示例11-100
booleanBoolean布尔属性示例true1-2
regexpRegExp正则属性示例/[a-z][A-Z][0-9]/
functionFunction函数属性示例() => Math.random()
arrayArray数组属性示例1-10
  fooNumber数组元素示例1+1
  barString数组元素示例1-10
itemsArray自定义数组元素示例[1, true, 'hello', /\w{10}/]
objectObject对象属性示例
  fooNumber对象属性示例1+1
  barString对象属性示例1-10
placeholderString占位符示例@title

对象比较 - 列表

SDK方法名:listDatacheckObjCmp

URL

/datacheck/obj_cmp

Method

GET

Request

名称类型必选简介Mock初始值Mock规则
pageNumber1
limitNumber10
search_fieldStringobj_cmp_name
search_valueStringtest

Response

名称类型必选简介Mock初始值Mock规则
retNumber200
msgString
dataObject
  codeNumber0
  totalNumber20
  info_listArray16
    create_timeString1593511163
    obj_cmp_uuidStringC038DE5A-CDB2-F26D-FA5F-93E3FF266A87
    obj_cmp_nameStringtest
    src_db_uuidString3D7dFcd9-C176-d9ee-4FFB-f22bbd554926
    tgt_db_uuidString3D7dFcd9-C176-d9ee-4FFB-f22bbd554925
    cmp_typeStringuser
    user_uuidString1BCFCAA3-E3C8-3E28-BDC5-BE36FDC2B5DC
    src_db_nameStringyuan
    tgt_db_nameStringbei
    usernameStringadmin
    can_opNumber1
    can_upNumber1
    can_delNumber1
    configObject
      one_taskString'immediate'
  messageString

对象比较 - 新建

SDK方法名:createDatacheckObjCmp

URL

/datacheck/obj_cmp

Method

POST

Request

名称类型必选简介Mock初始值Mock规则
obj_cmp_nameString对象比较名称test
src_db_uuidString源端数据库uuid4CA773F4-36E3-A091-122C-ACDFB2112C21
tgt_db_uuidString备端数据库uuid40405FD3-DB86-DC8A-81C9-C137B6FDECE5
src_db_auth_uuidString
tgt_db_auth_uuidString
cal_table_recodersNumber是否对比表的记录数1
rule_uuidString同步规则uuid751A03F5-C97D-645B-82B2-316A5D198528
cmp_typeString类型user
db_user_mapString用户映射{'src_user':'dst_user'}
policiesString策略
policy_typeString策略类型 one_time 一次性
immediate 立即
periodic 周期性
interval 间隔
periodic
one_timeString2019-05-27 16:07:08
repairNumber1
configObject
  one_taskString立即比较:immediate
选择时间:select_time
immediate

Response

名称类型必选简介Mock初始值Mock规则
retNumber200
msgString
dataObject
  messageString
  codeNumber0
  uuidString@uuid

对象比较 - 删除

SDK方法名:deleteDatacheckObjCmp

URL

/datacheck/obj_cmp

Method

DELETE

Request

名称类型必选简介Mock初始值Mock规则
uuidsArray[@guid]
forceBooleanfalse

Response

名称类型必选简介Mock初始值Mock规则
retNumber200
msgString
dataObject
  messageString
  codeNumber
  success_listArray5
    codeString0
    messageString
    obj_cmp_nameString@last
    obj_cmp_uuidString@guid
  fail_listArray5
    codeString-1
    messageString
    obj_cmp_nameString@first
    obj_cmp_uuidString@guid

对象比较 - 获取单个

SDK方法名:describeDatacheckObjCmp

URL

/datacheck/obj_cmp/:uuid([A-F0-9-]+)

Method

GET

Request

名称类型必选简介Mock初始值Mock规则

Response

名称类型必选简介Mock初始值Mock规则
retNumber200
msgString
dataObject
  active_obj_cmpObject
    obj_cmp_uuidString
    obj_cmp_nameStringtest
    src_db_uuidString4CA773F4-36E3-A091-122C-ACDFB2112C21
    tgt_db_uuidString40405FD3-DB86-DC8A-81C9-C137B6FDECE5
    rule_uuidString751A03F5-C97D-645B-82B2-316A5D198528
    cmp_typeStringuser
    cal_table_recodersNumber1
    db_user_mapString{"user1":"user1"}
    policiesString1|00:091,2,3*1
    policy_typeStringperiodic
    one_timeString2019-05-27 16:07:08
    repairNumber1
  messageString
  codeNumber0

对象比较 - 操作

SDK方法名: 停止:stopObjCmp; 重启:restartObjCmp; 停止定时:cmpStopTimeObjCmp; 继续定时:cmpResumeTimeObjCmp; 立即比较:cmpImmediateObjCmp;

URL

/datacheck/obj_cmp/operate

Method

POST

Request

名称类型必选简介Mock初始值Mock规则
operateStringcmp_stop (停止)
| cmp_restart (重启)
cmp_immediate(立即比较)
cmp_stop_time (停止定时)
obj_cmp_uuidsArray

Response

名称类型必选简介Mock初始值Mock规则
retNumber200
msgString
dataObject
  messageString
  codeNumber0

对象比较-比较结果时间列表

SDK方法名:listDatacheckObjCmpResultTimeList

URL

/datacheck/obj_cmp/result_time_list

Method

GET

Request

名称类型必选简介Mock初始值Mock规则
uuidString@guid

Response

名称类型必选简介Mock初始值Mock规则
retNumber200
msgString
dataObject
  codeNumber0
  messageString
  time_listArray16
    show_timeString2019-07-05 17:35:13
    summaryObject
      diffNumber1-100
    timeString2019-07-05_17-35-13
  totalNumber20

对象比较-比较任务结果

SDK方法名:describeDatacheckObjCmpResult

URL

/datacheck/obj_cmp/result

Method

GET

Request

名称类型必选简介Mock初始值Mock规则
uuidString@guid
start_timeString开始时间
limitNumber
offsetString
search_valueString搜索值
BackLackOnlyNumber显示备端差异0

Response

名称类型必选简介Mock初始值Mock规则
codeNumber0
retNumber200
msgString
dataObject
  messageString
  codeNumber0
  result_infoObject
    totalNumber20
    rowsArray
      CONSTRAINTString1/1__1
      DATABASE LINKString0/0__1
      FUNCTIONString0/0__1
      INDEXString4/5__0
      JAVA CLASSString0/0__1
      JAVA RESOURCEString0/0__1
      JAVA SOURCEString0/0__1
      JOBString0/0__1
      MATERIALIZED VIEWString0/0__1
      OLD JOBString0/0__1
      PACKAGEString0/0__1
      PACKAGE BODYString0/0__1
      PRIVSString9/8__0
      PROCEDUREString0/0__1
      QUEUEString0/0__1
      SEQUENCEString0/0__1
      SYNONYMString0/0__1
      TABLEString18/19__0
      TABLE PARTITIONString0/0__1
      TRIGGERString0/0__1
      TYPEString0/0__1
      TYPE BODYString0/0__1
      VIEWString2/2__1
      usrStringI2/I2
  head_infoObject
    obj_cmp_nameStringMichelle Lewis

获取对象比较状态

SDK方法名:listDatacheckObjCmpStatus

URL

/datacheck/obj_cmp/status

Method

POST

Request

名称类型必选简介Mock初始值Mock规则
uuidsArray

Response

名称类型必选简介Mock初始值Mock规则
retNumber200
msgString
dataObject
  codeNumber0
  messageString
  info_listArray
    cmp_uuidStringC038DE5A-CDB2-F26D-FA5F-93E3FF266A87
    wStObject
      statusStringERROR
      progressNumber
      error_codeNumber-4022
    bStObject
      statusStringDUMP
      progressString80
      error_codeString-22
    diff_numberNumber10

对象比较-比较结果的删除

SDK方法名:describeDatacheckObjCmpResultTimeList

URL

/datacheck/obj_cmp/result_time_list

Method

DELETE

Request

名称类型必选简介Mock初始值Mock规则
uuidString@guid
time_listArray

Response

名称类型必选简介Mock初始值Mock规则
retNumber200
msgString
dataObject
  messageString
  codeNumber0

对象比较-比较结果详细信息

SDK方法名:listDatacheckObjCmpCmpInfo

URL

/datacheck/obj_cmp/cmp_info

Method

GET

Request

名称类型必选简介Mock初始值Mock规则
offsetNumber1
limitNumber10
search_valueString
usrStringI2
filedString
uuidString
start_timeString

Response

名称类型必选简介Mock初始值Mock规则
retNumber200
msgString
dataObject
  messageString
  codeNumber0
  info_listObject
    totalNumber2000
    rowsArray
      srcString1111
      dstString2222
    cal_table_recodersBoolean是否比较表的记录false

表比较 - 新建

SDK方法名:createTbCmp

URL

/datacheck/tb_cmp

Method

POST

Request

名称类型必选简介Mock初始值Mock规则
tb_cmp_nameString规则名
src_db_uuidsArray4CA773F4-36E3-A091-122C-ACDFB2112C21
tgt_db_uuidsArray40405FD3-DB86-DC8A-81C9-C137B6FDECE5
cmp_typeStringtable
filter_tableArray[user.table]
dump_thdNumber抽取线程数
db_mapObject整库映射
  srcArray
    db_uuidString
    auth_uuidString
  tgtArray
    db_uuidString
    auth_uuidString
db_tb_mapArray5
  regex_switchString0:关闭正则表名,1:开启1
  srcArray源端映射列
    userString用户名@word
    tabString列名@word
    dbsArray对应数据库节点uuid列表3
      db_uuidString数据库节点uuid
      auth_uuidString数据库节点认证uuid
  tgtArray备端映射列
    userString用户名
    tabString列名
    dbsArray对应数据库节点uuid列表3
      db_uuidString数据库节点uuid
      auth_uuidString数据库节点认证uuid
  colString列映射{"col1":"col2", "col3":"col4"}
db_user_mapArray
  srcArray源端映射列
    userString用户名
    dbsArray对应数据库节点uuid列表3
      db_uuidString数据库节点uuid
      auth_uuidString数据库节点认证uuid
  tgtArray备端映射列
    userString用户名
    dbsArray对应数据库节点uuid列表
      db_uuidString数据库节点uuid
      auth_uuidString数据库节点认证uuid
policesString策略"0|00:00
policy_typeString策略类型;periodic:周期,one_time:一次性任务 ,immediate:立刻执行,interval :每隔one_time
intervalString时间间隔,分钟:10m,小时:10h10m
concurrent_tableArray并发表["hh.ww"]
try_split_part_tableNumber尝试并发设置 0:否 1:是0
one_timeString策略的开始时间,如果不是一次性任务为空值2019-05-27 16:07:08
configObject
  globalConfigObject
    dkdiff_enable_step_count_tableString启用count类型


不启用count比对:‘’
仅count比对:onlycount
比较时count:ondiff
默认值:空
""
    dkdbsource_diff_only_key_columnsBoolean关闭:false,
开启:true
false
    dkmagic_plan_max_diffsNumber值: 整数(-1表示不限制)10000
    dkfilesink_enable_sqlpatch_fileBoolean关闭:false, 开启:truefalse
    dkmagic_plan_number_tolerance_typeString

绝对差值 absolute,
相对差值 relative
absolute
    dkmagic_plan_number_toleranceNumber绝对差值
正数

相对差值
0~1
    dkmagic_plan_datetime_toleranceNumber时间容差
正数
    split_table_schedule_cronString大表拆分类型

不拆分:空,
比较时进行拆分:immediate
""
    split_table_single_segment_max_rowsNumber拆分后单个计划最大行数
正整数
5000000
    split_table_result_expire_in_secondsNumber拆分结果最大过期时间

非负整数 (单位: 秒)
0
    dkdiffengine_recursion_max_stepsNumber"递归比对"最大次数

正整数(>=1)
1
    dkdiffengine_recursion_interval_step_delayNumber每次“递归”的时间间隔
值:非负整数(单位:毫秒)
默认值:0
0
    dkdbsource_left_ignore_type_namesString源端忽略类型

值:字符串 (多个类型用逗号分隔)
默认值:空
""
    dkdbsource_right_ignore_type_namesString备端忽略类型

值:字符串 (多个类型用逗号分隔)
默认值:空
""
    dkdbsource_left_ignore_column_namesString源端忽略列名

值:字符串 (多个列名用逗号分隔)
默认值:空
""
    dkdbsource_right_ignore_column_namesString备端忽略列名

值:字符串 (多个列名用逗号分隔)
默认值:空
    globalconfigArray
      keyStringkey
      valueStringvalue
    toleranceBoolean是否启用容差值比对
默认 false
false
    execute_patch_after_completeString自动修复
  data_selectArray单表筛选配置
    src_userString
    src_tbString
    src_queryString
    dst_userString
    dst_tbString
    dst_queryString
  compare_keyArray比较key列
    src_userString
    src_tbString
    dst_userString
    dst_tbString
    src_dst_keyString
  globalsArray
全局筛选配置
    src_userString
    dst_userString
    src_queryString
    dst_queryString
  exclude_tablesArray排除表配置
    src_userString
    src_tbString
    dst_userString
    dst_tbString
  timestampsObject
    column_nameString时间戳字段名称
    back_delay_in_secondsNumber追溯时间间隔
    end_timeString最新时间
  global_time_limitBoolean是否开启全局时间限制比对
  v_tabmapArray
    src_userString源端用户
    src_tbString源端表名
    src_sqlString源端SQL
    tgt_userString备端用户
    tgt_tbString备端表名
    tgt_sqlString备端SQL
    keyStringkey列

Response

名称类型必选简介Mock初始值Mock规则
retNumber200
msgString
dataObject
  messageString
  codeNumber

表比较 - 获取单个

SDK方法名:describeTbCmp

URL

/datacheck/tb_cmp/:uuid([A-F0-9-]+)

Method

GET

Request

名称类型必选简介Mock初始值Mock规则
uuidString表比较规则的uuid@guid

Response

名称类型必选简介Mock初始值Mock规则
src_db_uuidString4CA773F4-36E3-A091-122C-ACDFB2112C21
retNumber200
msgString
dataObject
  codeNumber0
  messageString
  active_tb_cmpObject
    table_cmp_nameStringctt->ctt
    src_db_uuidString4CA773F4-36E3-A091-122C-ACDFB2112C21
    tgt_db_uuidString40405FD3-DB86-DC8A-81C9-C137B6FDECE5
    cmp_typeStringuser
    db_user_mapString{"CTT":"CTT"}
    filter_table_settingsString[用户.表名]
    db_tb_mapString表映射
    dump_thdNumber1
    rule_uuidString5DA7469c-b5d5-Bd53-5ADB-7Eee6D31e60B
    policiesString1|00:091,2,3*1
    policy_typeStringperiodic
    concurrentTabArray["hh.ww"]
    try_split_part_tableNumber0
    one_timeString2019-05-27 16:07:08

表比较 - 删除

SDK方法名:deleteTbCmp

URL

/datacheck/tb_cmp

Method

DELETE

Request

名称类型必选简介Mock初始值Mock规则
uuidsArray@guid
forceBooleanfalse

Response

名称类型必选简介Mock初始值Mock规则
retNumber200
msgString
dataObject
  messageString
  codeNumber0
  success_listArray
    codeString
    messageString
    tb_cmp_nameString
    tb_cmp_uuidString
  fail_listArray
    codeString
    messageString
    tb_cmp_nameString
    tb_cmp_uuidString

表比较 - 列表

SDK方法名:listTbCmp

URL

/datacheck/tb_cmp

Method

GET

Request

名称类型必选简介Mock初始值Mock规则
pageNumber1
limitNumber10
search_fieldStringtb_cmp_name
search_valueString测试

Response

名称类型必选简介Mock初始值Mock规则
retNumber200
msgString
dataObject
  codeNumber0
  totalNumber20
  info_listArray
    create_timeString1593511163
    tb_cmp_nameStringname321
    src_db_uuidString4CA773F4-36E3-A091-122C-ACDFB2112C21
    tgt_db_uuidString40405FD3-DB86-DC8A-81C9-C137B6FDECE5
    user_uuidString1BCFCAA3-E3C8-3E28-BDC5-BE36FDC2B5DC
    tb_cmp_uuidStringC038DE5A-CDB2-F26D-FA5F-93E3FF266A87
    tgt_db_nameStringbei
    usernameStringadmin
    can_opNumber1
    can_upNumber1
    can_delNumber1
    is_biz_adminNumber1
    src_db_nameStringyuan
    policy_typeStringimmediate; one_time;periodicimmediate
  messageString

表比较 历史结果(查看表比较时间结果集)

SDK方法名:listTbCmpResultTimeList

URL

/datacheck/tb_cmp/result_time_list

Method

GET

Request

名称类型必选简介Mock初始值Mock规则
uuidString

Response

名称类型必选简介Mock初始值Mock规则
retNumber200
msgString
dataObject
  codeNumber0
  messageString
  time_listArray16
    show_timeString2019-07-05 17:35:13
    summaryObject
      totalNumber1192
      use_timeNumber844
      diffNumber130
    timeString2019-07-05_17-35-13
  totalNumber20

表比较-操作

SDK方法名:

停止:stopTbCmp;

重启:restartTbCmp;

继续:resumeTbCmp;

URL

/datacheck/tb_cmp/operate

Method

POST

Request

名称类型必选简介Mock初始值Mock规则
tb_cmp_uuidsArray@guid
operateStringcmp_stop | cmp_restartresume

Response

名称类型必选简介Mock初始值Mock规则
retNumber200
msgString
dataObject
  messageString
  codeNumber0

表比较-比较结果的删除

SDK方法名:describeTbCmpResuluTimeList;查看结果删除

URL

/datacheck/tb_cmp/result_time_list

Method

DELETE

Request

名称类型必选简介Mock初始值Mock规则
uuidString
time_listArray@guid

Response

名称类型必选简介Mock初始值Mock规则
retNumber200
msgString
dataObject
  messageString
  codeNumber0

表比较-比较任务结果

SDK方法名:describeTbCmpResult

URL

/datacheck/tb_cmp/result

Method

GET

Request

名称类型必选简介Mock初始值Mock规则
pageNumber1
limitNumber10
search_fieldString
search_valueString
uuidString@guid
start_timeString对应的时间
flagNumber0:仅显示差异表
1:显示所有比对表

Response

名称类型必选简介Mock初始值Mock规则
retNumber200
msgString
dataObject
  messageString
  codeNumber0
  head_infoObject
    totalNumber100
    errNumber10
    endString2019-10-10 12:00:00
    startString2019-10-10 10:00:00
    use_timeString3600
  result_infoObject
    rowsArray10
      src_userStringuser
      src_table_nameStringAnna Martin
      srcStringCynthia Gonzalez
      dstStringRobert Johnson
      src_diff_msgString差异描述
      dst_diff_msgString
      aggregateNumber是否聚合查询0:不聚合,1:聚合(控制页面的查看按钮,0时不显示)
    totalNumber30
    rule_relatedNumber是否关联规则0:关,1:开
    only_countNumber是否仅count。0:关,1:开(1的时候不显示操作列 )

表比较-错误信息

SDK方法名:describeTbCmpErrorMsg;错误信息

URL

/datacheck/tb_cmp/error_msg

Method

GET

Request

名称类型必选简介Mock初始值Mock规则
offsetNumber1
limitNumber10
search_fieldString
search_valueString
uuidString@guid
start_timeString
nameString
ownerString所属者admin

Response

名称类型必选简介Mock初始值Mock规则
retNumber200
msgString
dataObject
  messageString
  codeNumber0
  result_infoObject
    rowsArray10
      src_rowString@name
      dst_rowString@name
      src_dbArray源端数据库名@name
      tgt_dbArray备端数据库名test
    totalNumber2000

表比较-比较结果

SDK方法名:describeTbCmpCmpResult

URL

/datacheck/tb_cmp/cmp_result/:uuid([A-F0-9-]+)

Method

GET

Request

名称类型必选简介Mock初始值Mock规则
uuidString

Response

名称类型必选简介Mock初始值Mock规则
retNumber200
msgString
dataObject
  codeNumber0
  messageString
  summaryObject
    totalNumber1192
    use_timeNumber844
    diffNumber130

表比较-表比对的详细信息

SDK方法名:describeTbCmpCmpDesc;表比对的详细信息

URL

/datacheck/tb_cmp/:uuid([A-F0-9-]+)/describe

Method

GET

Request

名称类型必选简介Mock初始值Mock规则
offsetNumber1
limitNumber10
search_fieldString
search_valueString
uuidString@guid
start_timeString
nameString
ownerString所属者admin

Response

名称类型必选简介Mock初始值Mock规则
retNumber200
msgString
dataObject
  messageString
  codeNumber0
  result_infoObject
    diffObject10
      srcSchemaArray源端用户
        nameString源端表名srcTableName
        dstSchemaString备端schema名称dstSchema
        dstNameString备端表名dstTableName
        userString用户user
        maxStepsNumber该表最大执行步数2
        plansArray
          planString计划名称plan15
          recursionsArray一个执行计划可以有多个执行步(递归比对
            srowNumber3
            drowNumber3
            srcSqlArray[
"select id,c1,c2,c3 from srcSchema.srcTableName where id<10000"
],
            dstSqlArray[
"select id,c1,c2,c3 from dstSchema.dstTableName where id<10000"
]

表比较-启动表比对

SDK方法名:describeTbCmpStart

URL

/datacheck/tb_cmp/:uuid([A-F0-9-]+)/start

Method

GET

Request

名称类型必选简介Mock初始值Mock规则

Response

名称类型必选简介Mock初始值Mock规则
retNumber200
msgString
dataObject
  messageString
  codeNumber0
Last update: 2/26/2024, 5:49:44 PM
Contributors: ganl