TIDB模块

February 26, 2024About 10 min

TIDB模块

SDK类名:/active/Tidb;

同步规则 - 新建

SDK 方法名:createTidbRule

URL

/tidb/rule

Method

POST

Request

名称类型必选简介Mock初始值Mock规则
mysql_nameBoolean@name
tgt_db_uuidArray备端数据库(分发时为多选)D42BF707-C971-EEA9-521F-BB0F3F7A92FC
tgt_typeString备库类型 mysql , oracle,kfaka,postgres,vertica,greenplumoracle
start_rule_nowNumber0
dbmap_topicStringkafka类型,整库映射
map_typeString映射方式 库映射database 表映射:table 整库映射 alltable
tab_mapArray表映射
  src_tableStringsrc_table
  dst_tableStringdst_table
  src_dbString111
  dst_dbString222
full_syncNumber全量同步
当备端类型不是mysql时 全量同步不用选择同步方式 默认 否
0
incre_syncNumber增量同步1
model_typeString模式 汇聚n:1, 分发:1:n,主-主:1:1 主-从:1:01:0
full_sync_modeString全同步方式,逻辑:logic 物理 physics 自动 auto(汇聚只有逻辑一种)auto
db_setObject高级设置->数据库设置
  binlog_row_imageStringfullfull
  default_storage_engineStringinnoDBinnoDB
  sync_binlogString11
  innodb_flush_logString2
  innodb_flush_methodStringO_DIRECTO_DIRECT
  binlog_formatStringrowrow
  open_files_limitString6553565535
  server_idString随机值123456
  expire_logs_daysString77
  nat_modeNumber否:0 是 1,默认为否,如果选择是,则显示出如下内容0
  ipString外网 ip
  max_allowed_packetString52m52
src_db_uuidArray汇聚可一次传多个已逗号隔开1B1153F6-DAD9-BC39-888A-A743FCC208E5
primary_db_oneString(主-主 有值其他情况空)主数据库1
primary_map_type_oneString映射方式 库,表,整库 映射(主主 其他为空)
primary_map_oneString主-主 有值其他情况空) 映射下传的值
{111:222, 111:333}
primary_db_twoString主-主 有值其他情况空)主数据库2
primary_map_type_twoString主-主 有值其他情况空)映射方式
primary_map_twoString主-主 有值其他情况空)传递值
db_mapArray库映射
  dst_tableString
  src_tableString
modifyBooleanfalse
start_src_db_setNumber开启源端配置0
start_dst_db_setNumber0
dst_db_setObject备端数据库设置
  binlog_formatString
  binlog_row_imageString
  default_storage_engineString
  sync_binlogString
  innodb_flush_logString
  innodb_flush_methodString
  max_allowed_packetString
  open_files_limitString
  server_idString
  expire_logs_daysString
  nat_modeNumber
  ipString
dst_full_sync_setObject
  support_ddlNumber
  change_tf_pathString
  tf_file_save_timeString
  nat_modeString
  foreign_ipString
  extractionNumber0
  start_lsnNumber
full_sync_setObject同步程序设置
  support_ddlNumber否:0 是 1,是否支持ddl
当备端为mysql时,缺省为支持DDL,当备端非mysql时,缺省为不支持DDL
1
  change_tf_pathString更改TF文件路径
  tf_file_save_timeNumber传数字7
  nat_modeNumber默认为否,如果选择是,则显示出如下内容0
  foreign_ipString外网ip
  extractionNumber是否支持远程抽取0
  start_lsnNumber
configObject
  dml_trackObject
    delcolString删除标记字段名称
    drpNumber删除
    enableNumber0不启用 1启用1
    tmcolString操作时间字段名称
    urpNumber更新
  src_connect_userString
  dst_connect_userString
  bw_settingsObject
    bw_limitString"1200:00-13:0040M,300:00-13:0040M"
  full_sync_settingsObject全量设置
    clean_user_before_dumNumber0
    concurrent_tableArray
    dump_thdNumber
    load_thdNumber
    existing_tableStringdrop_to_recycle
    try_split_part_tableNumber
  etl_settingsObject
    etl_tableArray
      oprTypeStringIRP
      tableString
      userString
      processStringSKIP
      addInfoString
  inc_sync_ddl_filterObject
    inc_sync_ddl_dataArray[
"INDEX",
"VIEW",
"FUNCTION"
]
  binary_codeStringhex
  table_change_infoNumber
  jointingObject字段拼接
    opString操作
op类型定义
前辍 prefix 后辍 append 常量 const 拼接 join 加 add 减 sub 乘 multiply 除 divide
    tableString
    contentString目标列+其他两行
part_load_balanceString
kafka_time_outString
save_json_textBoolean【目标类型为Kafka】保存为文件

Response

名称类型必选简介Mock初始值Mock规则
retNumber200
msgString
dataObject
  codeNumber0
  messageStringsuccess
  uuidString@uuid

同步规则 - 修改

SDK方法名:modifyTidbRule

URL

/tidb/rule

Method

PUT

Request

名称类型必选简介Mock初始值Mock规则
mysql_nameStringmysql
src_db_uuidArray1B1153F6-DAD9-BC39-888A-A743FCC208E5
tgt_db_uuidArrayD42BF707-C971-EEA9-521F-BB0F3F7A92FC
tgt_typeStringkafka
start_rule_nowNumber0
node_uuidString6B1153F6-DAD9-BC39-888A-A743FCC208E6
dbmap_topicString
map_typeStringtable
tab_mapArray
  src_tableStringsrc_table
  topicStringtopic
full_syncNumber0
incre_syncNumber1
model_typeString1:0
full_sync_modeStringauto
db_setObject
  db_nodeString1B1153F6-DAD9-BC39-888A-A743FCC208E5
  binlog_formatStringrow
  binlog_row_imageStringfull
  default_storage_engineStringinnoDB
  sync_binlogString1
  innodb_flush_logString2
  innodb_flush_methodStringO_DIRECT
  max_allowed_packetString52
  open_files_limitString65535
  server_idString123456
  expire_logs_daysString7
  nat_modeNumber0
  ipString
full_sync_setObject
  support_ddlNumber1
  nodeString6B1153F6-DAD9-BC39-888A-A743FCC208E6
  change_tf_pathString
  tf_file_save_timeNumber7
  nat_modeNumber0
  foreign_ipString
primary_node_oneString
primary_node_twoString
primary_db_oneString
primary_map_type_oneString
primary_map_oneArray
primary_db_twoString
primary_map_type_twoString
primary_map_twoArray
db_mapArray
  src_dbStringsrc_db
  dst_dbStringdst_db
mysql_uuidString5349E2CF-7DBO-OAF2-13CB-BB7DFD8A9D86
configObject
  kafka_time_outString
  part_load_balanceString

Response

名称类型必选简介Mock初始值Mock规则
retNumber200
msgString
dataObject
  codeNumber0
  messageStringsuccess

同步规则 - 删除

SDK方法名:deleteTidbRule

URL

/tidb/rule

Method

DELETE

Request

名称类型必选简介Mock初始值Mock规则
mysql_uuidsArray
forceBooleantrue

Response

名称类型必选简介Mock初始值Mock规则
retNumber200
msgString
dataObject
  codeNumber0
  messageString[0] success
  success_listArray
    codeNumber0
    messageString[0] success
    mysql_uuidString16CB63E1-13FA-FB32-EB49-D790682C9648
    mysql_nameStringtask1
  fail_listArray
    codeNumber-1
    messageString[-1] 找不到节点
    mysql_uuidString16CB63E1-13FA-FB32-EB49-D790682C9647
    mysql_nameStringtask2

同步规则 - 获取单个

SDK方法名:describeTidbRule

URL

/tidb/rule/:uuid([A-F0-9-]+)

Method

GET

Request

名称类型必选简介Mock初始值Mock规则
mysql_uuidString

Response

名称类型必选简介Mock初始值Mock规则
retNumber200
msgString
dataObject
  messageString
  codeNumber0
  info_listObject
    mysql_nameStringmysql
    src_db_uuidString['1111','2222']
    tgt_db_uuidArray2222
    tgt_typeStringkafka
    start_rule_nowNumber0
    node_uuidString6B1153F6-DAD9-BC39-888A-A743FCC208E6
    dbmap_topicStringdb_topic
    map_typeStringdatabasetable
    tab_mapArray2
      src_tableString@name
      dst_tableString@name
      src_dbString111
      dst_dbString222
    full_syncNumber0
    incre_syncNumber1
    model_typeStringn:1
    full_sync_modeStringauto
    db_setObject
      db_nodeString1B1153F6-DAD9-BC39-888A-A743FCC208E5
      binlog_formatStringrow
      binlog_row_imageStringfull
      default_storage_engineStringinnoDB
      sync_binlogString777
      innodb_flush_logString777
      innodb_flush_methodStringO_DIRECT
      max_allowed_packetString777
      open_files_limitString777
      server_idString777
      expire_logs_daysString777
      nat_modeNumber0
      ipString192.168.1.1
    full_sync_setObject
      support_ddlNumber1
      nodeString6B1153F6-DAD9-BC39-888A-A743FCC208E6
      change_tf_pathString
      tf_file_save_timeNumber777
      nat_modeNumber0
      foreign_ipString192.168.1.1
      start_lsnString9
    primary_node_oneString1111
    primary_node_twoString2222
    primary_db_oneStringEC9D7dcC-55BC-849b-ABd1-F7AbADC7f936
    primary_map_type_oneStringtable
    primary_map_oneString{"123":"123"}
    primary_db_twoStringb254e0c8-f91d-b4Ac-4ab3-C8A2bCbdB86c
    primary_map_type_twoStringdatabase
    primary_map_twoString{"44":"44","555":"555"}
    db_mapArray2
      src_tableString555
      dst_tableString666
    dst_full_sync_setObject
      support_ddlNumber1
      change_tf_pathString
      tf_file_save_timeNumber7
      nat_modeNumber0
      foreign_ipNumber
      extractionNumber0
      start_lsnString0
    configObject
      dml_trackObject
        enableNumber0
        urpNumber0
        drpNumber0
        tmcolString
        delcolString

同步规则 - 操作

SDK方法名:

继续:resumeTidbRule;

停止:stopTidbRule;

修改:modifyTidbRule;

重启:restartTidbRule;

开始解析:startParsingTidbRule;

停止解析:stopParsingTidbRule;

重新解析:resetParsingTidbRule;

开始加载:startLoadTidbRule;

停止加载:stopLoadTidbRule;

重新加载:resetLoadTidbRule;

移除:removeTidbRule;

URL

/tidb/rule/operate

Method

POST

Request

名称类型必选简介Mock初始值Mock规则
operateStringresume 继续
stop 停止
restart 重启
modify
start_parsing(开始解析)
stop_parsing
reset_parsing
start_load(开始装载)
stop_load
reset_load
remove |
stop_schedule 停止调度
start_chedule 启动调度
restart
mysql_uuidString@guid
scnString
tfString只有在重置装载时才有此值

Response

名称类型必选简介Mock初始值Mock规则
retNumber200
msgString
dataObject
  messageString
  codeNumber0

同步规则 - 列表

SDK方法名:listTidbRules

URL

/tidb/rule

Method

GET

Request

名称类型必选简介Mock初始值Mock规则
pageNumber1
limitNumber10
search_fieldString
search_valueString
where_argsObject
  mysql_uuidString@guid

Response

名称类型必选简介Mock初始值Mock规则
retNumber200
msgString
dataObject
  codeNumber0
  totalNumber12
  info_listArray
    mysql_uuidArray规则uuid['3D7dFcd9-C176-d9ee-4FFB-f22bbd554929', '3D7dFcd9-C176-d9ee-4FFB-f22bbd554928']+1
    src_db_uuidArray源端uuid['3D7dFcd9-C176-d9ee-4FFB-f22bbd554926']
    tgt_db_uuidArray备端uuid['3D7dFcd9-C176-d9ee-4FFB-f22bbd554927']
    tgt_typeArray备端类型[
"kafka",
"sqlserver",
"hbase",
"postgres",
"oracle"
]
+1
    user_uuidString1BCFCAA3-E3C8-3E28-BDC5-BE36FDC2B5DC
    mysql_nameString规则名称@name
    tgt_db_nameArray备端数据库名称['bei']
    model_typeStringn:1, 1:0n:1
    can_opNumber1
    can_upNumber1
    can_delNumber1
    src_db_nameArray['111', 'hello']['hello']
    is_biz_adminNumber1
    map_typeStringtable, databasedatabase
    tab_mapArray表映射
      src_tableString@name
      dst_tableString@name
      src_dbString111
      dst_dbString222
    db_mapArray库映射
      src_tableString@name
      dst_tableString@name
  messageString

同步规则-日志

SDK方法名:listRuleLog;同规则的日志管理

URL

/active/rule/log

Method

POST

Request

名称类型必选简介Mock初始值Mock规则
offsetNumber0
limitNumber10
date_startString开始时间@date
date_endString开始时间的结束时间@date
typeNumber0:错误 2:消息 -1:全部-1
module_typeNumber0:导出 1:装载 2:解析 3:中继 4:脱敏 -1 全部-1
query_typeNumber最新查询:1 最早查询:2 查询 :01
rule_uuidString规则uuidF530FB0E-0208-9071-66D3-E595AE7D5A4C
search_contentString关键词过滤test

Response

名称类型必选简介Mock初始值Mock规则
msgString
dataObject
  codeNumber0
  messageStringDelete success
  info_listArray5
    create_timeString2019-08-09 17:29:43
    detailStringFull Sync done, elapsed time: 24 sec'
    log_levelString日志级别 0:serious 2
2
    flagNumber0:正常, 1新信息 标红1
    log_typeString模块: 导出,装载,解析装载
    uuidString@uuid
  totalNumber666
retNumber200
Last update: 2/26/2024, 5:49:44 PM
Contributors: ganl