OGG进程拆分（单表拆成多个进程）

Posted wounder

tags:

篇首语：本文由小常识网(cha138.com)小编为大家整理，主要介绍了OGG进程拆分（单表拆成多个进程）相关的知识，希望对你有一定的参考价值。

OGG进程拆分（单表拆成多个进程）
 
概要：
《OGG进程拆分》介绍了如何将一个入库进程中的多个表拆分到其他进程中。本篇将着重介绍如何使用多个进程同时入库一张表。
适用条件：
1）入库进程只同步一张表，但仍有延时
2）目标段主机CPU、内存压力不大，以便有足够的资源添加新的入库进程
 
本示例将RZG_CXI2中的HX_SB.SB_CWBB_XQYKJZZ_ZCFZB表拆分到RZG_CXI1-RZG_CXI8这8个进程中
1. 创建新添加进程的配置文件
edit  params RZG_CXI1
 ##添加以下内容##
REPLICAT RZG_CXI1
SETENV (ORACLE_SID="hasthxcx1")
SETENV (NLS_LANG=AMERICAN_AMERICA.AL32UTF8)
Userid ggs,PASSWORD AACAAAAAAAAAAAIAUCOJGDDFPFHEGCPD, BLOWFISH, ENCRYPTKEY DEFAULT
REPORT AT 01:59
REPORTROLLOVER AT 02:00
CACHEMGR, CACHESIZE 256MB
REPERROR DEFAULT,ABEND
DISCARDFILE ./dirrpt/RZG_CXI1.dsc,APPEND,MEGABYTES 100
DISCARDROLLOVER AT 06:00
GETTRUNCATES
NUMFILES 3000
EOFDELAYCSECS 30
ASSUMETARGETDEFS
ALLOWNOOPUPDATES
DYNAMICRESOLUTION
GETUPDATEBEFORES
NOCOMPRESSDELETES
MAP HX_SB.SB_CWBB_XQYKJZZ_ZCFZB , TARGET HX_SB.SB_CWBB_XQYKJZZ_ZCFZB , colmap (usedefaults ,  &
    sjtb_sj = @date ("yyyy-mm-dd hh:mi:ss.ffffff", "JTS", @GETENV("JULIANTIMESTAMP"))),  FILTER (@RANGE (1, 8));
##结束## 
 
 edit  params RZG_CXI2
 ##开始##
REPLICAT RZG_CXI2
SETENV (ORACLE_SID="hasthxcx1")
SETENV (NLS_LANG=AMERICAN_AMERICA.AL32UTF8)
Userid ggs,PASSWORD AACAAAAAAAAAAAIAUCOJGDDFPFHEGCPD, BLOWFISH, ENCRYPTKEY DEFAULT
REPORT AT 01:59
REPORTROLLOVER AT 02:00
CACHEMGR, CACHESIZE 256MB
REPERROR DEFAULT,ABEND
DISCARDFILE ./dirrpt/RZG_CXI2.dsc,APPEND,MEGABYTES 100
DISCARDROLLOVER AT 06:00
GETTRUNCATES
NUMFILES 3000
EOFDELAYCSECS 30
ASSUMETARGETDEFS
ALLOWNOOPUPDATES
DYNAMICRESOLUTION
GETUPDATEBEFORES
NOCOMPRESSDELETES
MAP HX_SB.SB_CWBB_XQYKJZZ_ZCFZB , TARGET HX_SB.SB_CWBB_XQYKJZZ_ZCFZB , colmap (usedefaults ,  &
    sjtb_sj = @date ("yyyy-mm-dd hh:mi:ss.ffffff", "JTS", @GETENV("JULIANTIMESTAMP"))),  FILTER (@RANGE (2, 8));
 ##结束##
 
 edit  params RZG_CXI3
 ##开始##
REPLICAT RZG_CXI3
SETENV (ORACLE_SID="hasthxcx1")
SETENV (NLS_LANG=AMERICAN_AMERICA.AL32UTF8)
Userid ggs,PASSWORD AACAAAAAAAAAAAIAUCOJGDDFPFHEGCPD, BLOWFISH, ENCRYPTKEY DEFAULT
REPORT AT 01:59
REPORTROLLOVER AT 02:00
CACHEMGR, CACHESIZE 256MB
REPERROR DEFAULT,ABEND
DISCARDFILE ./dirrpt/RZG_CXI3.dsc,APPEND,MEGABYTES 100
DISCARDROLLOVER AT 06:00
GETTRUNCATES
NUMFILES 3000
EOFDELAYCSECS 30
ASSUMETARGETDEFS
ALLOWNOOPUPDATES
DYNAMICRESOLUTION
GETUPDATEBEFORES
NOCOMPRESSDELETES 
MAP HX_SB.SB_CWBB_XQYKJZZ_ZCFZB , TARGET HX_SB.SB_CWBB_XQYKJZZ_ZCFZB , colmap (usedefaults ,  &
    sjtb_sj = @date ("yyyy-mm-dd hh:mi:ss.ffffff", "JTS", @GETENV("JULIANTIMESTAMP"))),  FILTER (@RANGE (3, 8));
 ##结束##
 
 edit  params RZG_CXI4
 ##开始##
REPLICAT RZG_CXI4
SETENV (ORACLE_SID="hasthxcx1")
SETENV (NLS_LANG=AMERICAN_AMERICA.AL32UTF8)
Userid ggs,PASSWORD AACAAAAAAAAAAAIAUCOJGDDFPFHEGCPD, BLOWFISH, ENCRYPTKEY DEFAULT
REPORT AT 01:59
REPORTROLLOVER AT 02:00
CACHEMGR, CACHESIZE 256MB
REPERROR DEFAULT,ABEND
DISCARDFILE ./dirrpt/RZG_CXI4.dsc,APPEND,MEGABYTES 100
DISCARDROLLOVER AT 06:00
GETTRUNCATES
NUMFILES 3000
EOFDELAYCSECS 30
ASSUMETARGETDEFS
ALLOWNOOPUPDATES
DYNAMICRESOLUTION
GETUPDATEBEFORES
NOCOMPRESSDELETES
 MAP HX_SB.SB_CWBB_XQYKJZZ_ZCFZB , TARGET HX_SB.SB_CWBB_XQYKJZZ_ZCFZB , colmap (usedefaults ,  &
    sjtb_sj = @date ("yyyy-mm-dd hh:mi:ss.ffffff", "JTS", @GETENV("JULIANTIMESTAMP"))),  FILTER (@RANGE (4, 8));
 ##结束##
 
 edit  params RZG_CXI5
 ##开始##
REPLICAT RZG_CXI5
SETENV (ORACLE_SID="hasthxcx1")
SETENV (NLS_LANG=AMERICAN_AMERICA.AL32UTF8)
Userid ggs,PASSWORD AACAAAAAAAAAAAIAUCOJGDDFPFHEGCPD, BLOWFISH, ENCRYPTKEY DEFAULT
REPORT AT 01:59
REPORTROLLOVER AT 02:00
CACHEMGR, CACHESIZE 256MB
REPERROR DEFAULT,ABEND
DISCARDFILE ./dirrpt/RZG_CXI5.dsc,APPEND,MEGABYTES 100
DISCARDROLLOVER AT 06:00
GETTRUNCATES
NUMFILES 3000
EOFDELAYCSECS 30
ASSUMETARGETDEFS
ALLOWNOOPUPDATES
DYNAMICRESOLUTION
GETUPDATEBEFORES
NOCOMPRESSDELETES
  MAP HX_SB.SB_CWBB_XQYKJZZ_ZCFZB , TARGET HX_SB.SB_CWBB_XQYKJZZ_ZCFZB , colmap (usedefaults ,  &
    sjtb_sj = @date ("yyyy-mm-dd hh:mi:ss.ffffff", "JTS", @GETENV("JULIANTIMESTAMP"))),  FILTER (@RANGE (5, 8));
 ##结束##
 
 edit  params RZG_CXI6
 ##开始##
REPLICAT RZG_CXI6
SETENV (ORACLE_SID="hasthxcx1")
SETENV (NLS_LANG=AMERICAN_AMERICA.AL32UTF8)
Userid ggs,PASSWORD AACAAAAAAAAAAAIAUCOJGDDFPFHEGCPD, BLOWFISH, ENCRYPTKEY DEFAULT
REPORT AT 01:59
REPORTROLLOVER AT 02:00
CACHEMGR, CACHESIZE 256MB
REPERROR DEFAULT,ABEND
DISCARDFILE ./dirrpt/RZG_CXI6.dsc,APPEND,MEGABYTES 100
DISCARDROLLOVER AT 06:00
GETTRUNCATES
NUMFILES 3000
EOFDELAYCSECS 30
ASSUMETARGETDEFS
ALLOWNOOPUPDATES
DYNAMICRESOLUTION
GETUPDATEBEFORES
NOCOMPRESSDELETES
MAP HX_SB.SB_CWBB_XQYKJZZ_ZCFZB , TARGET HX_SB.SB_CWBB_XQYKJZZ_ZCFZB , colmap (usedefaults ,  &
    sjtb_sj = @date ("yyyy-mm-dd hh:mi:ss.ffffff", "JTS", @GETENV("JULIANTIMESTAMP"))),  FILTER (@RANGE (6, 8));                   
 ##结束##
 
 edit  params RZG_CXI7
 ##开始##
REPLICAT RZG_CXI7
SETENV (ORACLE_SID="hasthxcx1")
SETENV (NLS_LANG=AMERICAN_AMERICA.AL32UTF8)
Userid ggs,PASSWORD AACAAAAAAAAAAAIAUCOJGDDFPFHEGCPD, BLOWFISH, ENCRYPTKEY DEFAULT
REPORT AT 01:59
REPORTROLLOVER AT 02:00
CACHEMGR, CACHESIZE 256MB
REPERROR DEFAULT,ABEND
DISCARDFILE ./dirrpt/RZG_CXI7.dsc,APPEND,MEGABYTES 100
DISCARDROLLOVER AT 06:00
GETTRUNCATES
NUMFILES 3000
EOFDELAYCSECS 30
ASSUMETARGETDEFS
ALLOWNOOPUPDATES
DYNAMICRESOLUTION
GETUPDATEBEFORES
NOCOMPRESSDELETES
 MAP HX_SB.SB_CWBB_XQYKJZZ_ZCFZB , TARGET HX_SB.SB_CWBB_XQYKJZZ_ZCFZB , colmap (usedefaults ,  &
    sjtb_sj = @date ("yyyy-mm-dd hh:mi:ss.ffffff", "JTS", @GETENV("JULIANTIMESTAMP"))),  FILTER (@RANGE (7, 8));
 ##结束##
 
 edit  params RZG_CXI8
 ##开始##
REPLICAT RZG_CXI8
SETENV (ORACLE_SID="hasthxcx1")
SETENV (NLS_LANG=AMERICAN_AMERICA.AL32UTF8)
Userid ggs,PASSWORD AACAAAAAAAAAAAIAUCOJGDDFPFHEGCPD, BLOWFISH, ENCRYPTKEY DEFAULT
REPORT AT 01:59
REPORTROLLOVER AT 02:00
CACHEMGR, CACHESIZE 256MB
REPERROR DEFAULT,ABEND
DISCARDFILE ./dirrpt/RZG_CXI8.dsc,APPEND,MEGABYTES 100
DISCARDROLLOVER AT 06:00
GETTRUNCATES
NUMFILES 3000
EOFDELAYCSECS 30
ASSUMETARGETDEFS
ALLOWNOOPUPDATES
DYNAMICRESOLUTION
GETUPDATEBEFORES
NOCOMPRESSDELETES
MAP HX_SB.SB_CWBB_XQYKJZZ_ZCFZB , TARGET HX_SB.SB_CWBB_XQYKJZZ_ZCFZB , colmap (usedefaults ,  &
    sjtb_sj = @date ("yyyy-mm-dd hh:mi:ss.ffffff", "JTS", @GETENV("JULIANTIMESTAMP"))),  FILTER (@RANGE (8, 8));
 ##结束##
 
 
  1，查看 日志序列号和rba (添加进程时注意修改trail文件名，日志序号，rba)
 
   等stop后查看 info RZG_CX2I
 
 
GGSCI (hasthxcxdb01) 33>  info RZG_CX2I
 
REPLICAT   RZG_CX2I  Last Started 2016-06-02 11:39   Status RUNNING
Checkpoint Lag       91:53:11 (updated 03:12:24 ago)
Log Read Checkpoint  File ./dirdat/za003124
                     2016-05-30 19:43:03.015049  RBA 114276026
 
   2，登录数据库
dblogin Userid ggs,PASSWORD AACAAAAAAAAAAAIAUCOJGDDFPFHEGCPD, BLOWFISH, ENCRYPTKEY DEFAULT ##密文部分为OGG用户ggs的密码，也可用明文
 
  3.，添加进程 RZG_CXI
上面已经编辑过8个进程的参数文件，这里添加进程即可
   $ ggsci
   add replicat RZG_CXI1, exttrail ./dirdat/za
   add replicat RZG_CXI2, exttrail ./dirdat/za
   add replicat RZG_CXI3, exttrail ./dirdat/za
   add replicat RZG_CXI4, exttrail ./dirdat/za
   add replicat RZG_CXI5, exttrail ./dirdat/za
   add replicat RZG_CXI6, exttrail ./dirdat/za
   add replicat RZG_CXI7, exttrail ./dirdat/za
   add replicat RZG_CXI8, exttrail ./dirdat/za
 
 
  4， 修改进程检查点
   $ ggsci
    alter replicat RZG_CXI1, extseqno 3124, extrba 114276026
   alter replicat RZG_CXI2, extseqno 3124, extrba 114276026
   alter replicat RZG_CXI3, extseqno 3124, extrba 114276026
   alter replicat RZG_CXI4, extseqno 3124, extrba 114276026
   alter replicat RZG_CXI5, extseqno 3124, extrba 114276026
   alter replicat RZG_CXI6, extseqno 3124, extrba 114276026
   alter replicat RZG_CXI7, extseqno 3124, extrba 114276026
   alter replicat RZG_CXI8, extseqno 3124, extrba 114276026   
 
 
  5，启动新增的8个进程
　start RZG_CXI*
 
 
  6，再次登录数据库，删除原进程
  dblogin Userid ggs,PASSWORD AACAAAAAAAAAAAIAUCOJGDDFPFHEGCPD, BLOWFISH, ENCRYPTKEY DEFAULT
   delete RZG_CX2I
 
 

以上是关于OGG进程拆分（单表拆成多个进程）的主要内容，如果未能解决你的问题，请参考以下文章

OGG进程拆分

GoldenGate复制单表开并行

聊五毛钱的分库分表

请教ogg中复制进程rep01延迟问题

如何将1个excel文件中的100个工作表拆分成独立的excel文件

在多个进程之间拆分工作队列