异步部署

1. 环境的配置准备

1.1. 数据库版本

SQL> select * from v$version;

BANNER

-----------------------------------------------------------------

Oracle Database 11g Enterprise Edition Release 11.2.0.1. - Production

PL/SQL Release 11.2.0.1. - Production

CORE    11.2.0.1.      Production

TNS for Linux: Version 11.2.0.1. - Production

NLSRTL Version 11.2.0.1. - Production

1.2. 配置数据库参数

SQL> show parameter job_que

NAME                                 TYPE        VALUE

----------------------------------------------- job_queue_processes                  integer     

SQL> show parameter streams_pool_size

NAME                                 TYPE        VALUE

-----------------------------------------------

streams_pool_size                    big integer 

SQL> show parameter sga_targ

NAME                                 TYPE        VALUE

-----------------------------------------------

sga_target                           big integer 

SQL> show parameter memory_targ

NAME                                 TYPE        VALUE

----------------------------------------------

memory_target                        big integer 472M

SQL> show parameter java_pool

NAME                                 TYPE        VALUE

------------------------------------ -----------

java_pool_size                       big integer

SQL> alter system set streams_pool_size=50m ;

System altered.

SQL> show parameter java_pool

NAME                                 TYPE        VALUE

------------------------------------ -----------

java_pool_size                       big integer

SQL> alter system set java_pool_size=50m;

System altered.

SQL> show parameter undo_ret

NAME                                 TYPE        VALUE

------------------------------------ -----------

undo_retention                       integer

SQL> alter system set undo_retention=;

System altered.

SQL> show parameter streams_pool

NAME                                 TYPE        VALUE

------------------------------------ -----------

streams_pool_size                    big integer 52M

SQL> show parameter java_pool

NAME                                 TYPE        VALUE

------------------------------------ -----------

java_pool_size                       big integer 52M

SQL> show parameter undo_re

NAME                                 TYPE        VALUE

------------------------------------ -----------

undo_retention                       integer

1.3. 开启归档及补充日志

SQL> archive log list

Database log mode              Archive Mode

Automatic archival             Enabled

Archive destination            /u02/archivelog_dest

Oldest online log sequence

Next log sequence to archive

Current log sequence

SQL> alter database force logging;  

Database altered.

SQL> alter database add supplemental log data;  

Database altered.

SQL> select LOG_MODE,FORCE_LOGGING,SUPPLEMENTAL_LOG_DATA_MIN

    from v$database;

LOG_MODE     FOR SUPPLEME

------------ --- --------

ARCHIVELOG   YES YES

1.4. 准备测试的表

SQL> conn scott/tiger

Connected.

SQL> create table test(id int,name varchar2(),mark varchar2());

Table created.

SQL> select * from tab;

TNAME                          TABTYPE  CLUSTERID

------------------------------ ------- ----------

BONUS                          TABLE

DEPT                           TABLE

EMP                            TABLE

GTT                            TABLE

SALGRADE                       TABLE

TEMP                           TABLE

TEST                           TABLE

 rows selected.

2. 创建发布者和订阅者

2.1. 创建发布者/授权

SQL> create tablespace cdc_tbsp

datafile '/u02/app/oradata/ORCL/cdc_tbsp01.dbf' size 200m;

Tablespace created.

SQL> create user cdc_publisher identified by cdc_publisher

default tablespace cdc_tbsp temporary tablespace temp;

User created.

SQL> grant create session TO cdc_publisher;

Grant succeeded.

SQL> grant create table TO cdc_publisher;

Grant succeeded.

SQL> grant create sequence TO cdc_publisher; 

Grant succeeded.

SQL> grant create procedure TO cdc_publisher;  

Grant succeeded.

SQL> grant create any job TO cdc_publisher;  

Grant succeeded.

SQL> grant execute_catalog_role TO cdc_publisher; 

Grant succeeded.

SQL> grant select_catalog_role TO cdc_publisher;  

Grant succeeded.

SQL> grant execute ON dbms_cdc_publish TO cdc_publisher;  

Grant succeeded.

SQL> grant execute ON dbms_lock TO cdc_publisher;  

Grant succeeded.

SQL> GRANT UNLIMITED TABLESPACE TO cdc_publisher;

Grant succeeded.

SQL> execute dbms_streams_auth.grant_admin_privilege('CDC_PUBLISHER');  

PL/SQL procedure successfully completed.

SQL> grant all on scott.test to cdc_publisher;

Grant succeeded.

2.2. 创建订阅者/授权

SQL> create user cdc_subscriber identified by cdc_subscriber

    default tablespace cdc_tbsp temporary tablespace temp;

User created.

SQL> grant create session TO cdc_subscriber;

Grant succeeded.

3. 发布/订阅具体数据

3.1. 发布：准备源表(Source Table)

SQL> conn cdc_publisher/cdc_publisher

Connected.

SQL> BEGIN

    DBMS_CAPTURE_ADM.PREPARE_TABLE_INSTANTIATION(

TABLE_NAME => 'scott.test');

    END;

    /

PL/SQL procedure successfully completed.

3.2. 发布：创建变更集(Data Set)

SQL> conn cdc_publisher/cdc_publisher

Connected.

SQL> BEGIN

    DBMS_CDC_PUBLISH.CREATE_CHANGE_SET(

    change_set_name => 'CDC_SCOTT_TEST',

    description => 'Change set for product info',

    change_source_name => 'HOTLOG_SOURCE',

    stop_on_ddl => 'y',

    begin_date => sysdate,

    end_date => sysdate+);

    END;

   /

PL/SQL procedure successfully completed.

3.3. 发布：创建变更表

SQL> BEGIN

       DBMS_CDC_PUBLISH.CREATE_CHANGE_TABLE(

       owner              => 'cdc_publisher',

       change_table_name  => 'cdc_test',

       change_set_name    => 'CDC_SCOTT_TEST',

       source_schema      => 'SCOTT',

       source_table       => 'TEST',

       column_type_list   => 'ID NUMBER(5), NAME VARCHAR2(30),MARK VARCHAR2(50)',

       capture_values     => 'both',

      rs_id              => 'y',

      row_id             => 'n',

      user_id            => 'n',

      timestamp          => 'n',

      object_id          => 'n',

      source_colmap      => 'n',

      target_colmap      => 'y',

      options_string     => 'TABLESPACE CDC_TBSP');

   END;

   /

PL/SQL procedure successfully completed.

3.4. 发布：激活变更集

SQL> BEGIN

       DBMS_CDC_PUBLISH.ALTER_CHANGE_SET(

          change_set_name => 'CDC_SCOTT_TEST',

          enable_capture => 'y');

    END;

    /

PL/SQL procedure successfully completed.

SQL> grant select on  cdc_test to cdc_subscriber;

Grant succeeded.

备注：其实到此cdc_subscriber用户已经可以检测到scott.test表的变更了

如下测试：

[oracle@std ~]$ sqlplus scott/tiger

SQL*Plus: Release 11.2.0.1. Production on Wed Jan  :: 

Copyright (c) , , Oracle.  All rights reserved.

Connected to:

Oracle Database 11g Enterprise Edition Release 11.2.0.1. - Production

With the Partitioning, OLAP, Data Mining and Real Application Testing options

SQL> insert into test values(,'beijing','');

 row created.

SQL> commit;

Commit complete.

SQL> update test set name='shanghai' where id=;

 row updated.

SQL> commit;

Commit complete.

SQL> delete test where id=;

 row deleted.

SQL> commit;

Commit complete.

SQL> conn cdc_subscriber/cdc_subscriber

Connected.

SQL> select t.operation$,t.commit_timestamp$,t.id,t.name,t.mark

    from cdc_publisher.cdc_test t;

OP COMMIT_TIMESTAMP$          ID NAME                           MARK

-- ------------------ ---------- ------------------------------

I  -JAN-                    beijing

UO -JAN-                    beijing

UN -JAN-                    shanghai

D  -JAN-                    shanghai

3.5. 订阅：创建订阅集

SQL> conn cdc_subscriber/cdc_subscriber

Connected.

SQL> BEGIN

    dbms_cdc_subscribe.create_subscription(

    change_set_name=>'CDC_SCOTT_TEST',

    description=>'cdc scott subx',

    subscription_name=>'CDC_SCOTT_SUB');

    END;

    /

PL/SQL procedure successfully completed.

3.6. 订阅：开始订阅表信息

SQL> BEGIN

    dbms_cdc_subscribe.subscribe(

    subscription_name=>'CDC_SCOTT_SUB',

    source_schema=>'SCOTT',

    source_table=>'TEST',

    column_list=>'ID, NAME,MARK',

    subscriber_view=>'TEST_TEMP');

    END;

    /

PL/SQL procedure successfully completed.

SQL> select * from tab;

TNAME                          TABTYPE  CLUSTERID

------------------------------ ------- ----------

TEST_TEMP                      VIEW

3.7. 订阅：激活订阅

SQL> BEGIN

    dbms_cdc_subscribe.activate_subscription(

    subscription_name=>'CDC_SCOTT_SUB');

    END;

    /

PL/SQL procedure successfully completed.

3.8. 订阅：扩展订阅窗口

SQL> conn cdc_subscriber/cdc_subscriber

Connected.

SQL> BEGIN

    dbms_cdc_subscribe.extend_window(

    subscription_name=>'CDC_SCOTT_SUB');

    END;

    /

PL/SQL procedure successfully completed.

SQL> conn cdc_subscriber/cdc_subscriber

Connected.

SQL> select t.operation$,t.commit_timestamp$,t.id,t.name,t.mark

    from test_temp t; 

OP COMMIT_TIMESTAMP$          ID NAME                           MARK

-- ------------------ ---------- ------------------------------

I  -JAN-                    beijing

UO -JAN-                    beijing

UN -JAN-                    shanghai

D  -JAN-                    shanghai

4. 测试订阅发布

4.1. SCOTT表更改

SQL> conn scott/tiger

Connected.

SQL> insert into test values(,'renqinglei','aa');

 row created.

SQL> commit;

Commit complete.

SQL> update test set mark='tt' where id=;

 row updated.

SQL> commit;

Commit complete.

SQL> delete test where id=;

 row deleted.

SQL> commit;

Commit complete.

4.2. 查询数据发布情况

SQL> conn cdc_publisher/cdc_publisher

Connected.

SQL> select t.operation$,t.commit_timestamp$,t.id,t.name,t.mark

    from cdc_publisher.cdc_test t;

OP COMMIT_TIMESTAMP$          ID NAME                           MARK

-- ------------------ ---------- ------------------------------

I  -JAN-                    beijing

UO -JAN-                    beijing

UN -JAN-                    shanghai

D  -JAN-                    shanghai

I  -JAN-                    renqinglei                     aa

UO -JAN-                    renqinglei                     aa

UN -JAN-                    renqinglei                     tt

D  -JAN-                    renqinglei                     tt

 rows selected.

4.3. 查询数据订阅情况

SQL> conn cdc_subscriber/cdc_subscriber

Connected.

SQL> select t.operation$,t.commit_timestamp$,t.id,t.name,t.mark

    from test_temp t; 

OP COMMIT_TIMESTAMP$          ID NAME                           MARK

-- ------------------ ---------- ------------------------------

I  -JAN-                    beijing

UO -JAN-                    beijing

UN -JAN-                    shanghai

D  -JAN-                    shanghai

发现订阅的数据没有变化,扩展一下订阅窗口:

SQL> conn cdc_subscriber/cdc_subscriber

Connected.

SQL> BEGIN

    dbms_cdc_subscribe.extend_window(

    subscription_name=>'CDC_SCOTT_SUB');

    END;

    /

PL/SQL procedure successfully completed.

SQL> select t.operation$,t.commit_timestamp$,t.id,t.name,t.mark

    from test_temp t; 

OP COMMIT_TIMESTAMP$          ID NAME                           MARK

-- ------------------ ---------- ------------------------------

I  -JAN-                    beijing

UO -JAN-                    beijing

UN -JAN-                    shanghai

D  -JAN-                    shanghai

I  -JAN-                    renqinglei                     aa

UO -JAN-                    renqinglei                     aa

UN -JAN-                    renqinglei                     tt

D  -JAN-                    renqinglei                     tt

 rows selected.

4.4. 清除变更数据集

SQL> conn cdc_subscriber/cdc_subscriber

Connected.

SQL> BEGIN

    DBMS_CDC_SUBSCRIBE.PURGE_WINDOW(

    subscription_name => 'CDC_SCOTT_SUB');

    END;

    /

PL/SQL procedure successfully completed.

SQL> select t.operation$,t.commit_timestamp$,t.id,t.name,t.mark

    from test_temp t;

no rows selected

4.5. 重新生成变化数据

SQL> conn scott/tiger

Connected.

SQL> insert into test values(,'shandong','hh');

 row created.

SQL> insert into test values(,'diankeyuan','hh');

 row created.

SQL> commit;

Commit complete.

SQL> conn cdc_publisher/cdc_publisher

Connected.

SQL> select t.operation$,t.commit_timestamp$,t.id,t.name,t.mark

    from cdc_publisher.cdc_test t;

OP COMMIT_TIMESTAMP$          ID NAME                           MARK

-- ------------------ ---------- ------------------------------

I  -JAN-                    beijing

UO -JAN-                    beijing

UN -JAN-                    shanghai

D  -JAN-                    shanghai

I  -JAN-                    renqinglei                     aa

UO -JAN-                    renqinglei                     aa

UN -JAN-                    renqinglei                     tt

D  -JAN-                    renqinglei                     tt

I  -JAN-                    shandong                       hh

I  -JAN-                    diankeyuan                     hh

 rows selected.

SQL> conn cdc_subscriber/cdc_subscriber

Connected.

SQL> BEGIN

    dbms_cdc_subscribe.extend_window(

    subscription_name=>'CDC_SCOTT_SUB');

    END;

    /

PL/SQL procedure successfully completed.

SQL> select t.operation$,t.commit_timestamp$,t.id,t.name,t.mark

    from test_temp t;

OP COMMIT_TIMESTAMP$          ID NAME                           MARK

-- ------------------ ---------- ------------------------------

I  -JAN-                    shandong                       hh

I  -JAN-                    diankeyuan                     hh

4.6. 删除发布的数据

SQL> conn cdc_publisher/cdc_publisher

Connected.

SQL> select t.operation$,t.commit_timestamp$,t.id,t.name,t.mark

    from cdc_publisher.cdc_test t;

OP COMMIT_TIMESTAMP$          ID NAME                           MARK

-- ------------------ ---------- ------------------------------

I  -JAN-                    beijing

UO -JAN-                    beijing

UN -JAN-                    shanghai

D  -JAN-                    shanghai

I  -JAN-                    renqinglei                     aa

UO -JAN-                    renqinglei                     aa

UN -JAN-                    renqinglei                     tt

D  -JAN-                    renqinglei                     tt

I  -JAN-                    shandong                       hh

I  -JAN-                    diankeyuan                     hh

 rows selected.

SQL> truncate cdc_test;

truncate cdc_test

                *

ERROR at line :

ORA-: Invalid truncate command - missing CLUSTER or TABLE keyword

SQL> delete cdc_test;

 rows deleted.

SQL> commit;

Commit complete.

SQL> select t.operation$,t.commit_timestamp$,t.id,t.name,t.mark

    from cdc_publisher.cdc_test t;

no rows selected

Oracle CDC配置案例的更多相关文章

Oracle CDC简介及异步在线日志CDC部署示例
摘要最近由于工作需要,花时间研究了一下Oracle CDC功能和LogMiner工具,希望能找到一种稳定.高效的技术来实现Oracle增量数据抽取功能.以下是个人的部分学习总结和部署实践. 1. O ...
使用mysql存放Ambari元数据的配置案例
使用mysql存放Ambari元数据的配置案例作者:尹正杰版权声明:原创作品,谢绝转载!否则将追究法律责任. 一.环境准备详情请参考我之前的笔记:离线方式部署Ambari2.6.0.0 中关 ...
oracle odbc配置
oracle odbc配置 Win7 64位下安装oracle odbc 不能使用控制面板中 “管理工具”->“数据源(OBDC)”中安装数据源. 而要在“ 运行” 中输入 C:\Windo ...
SDE+ORACLE优化配置
原文 SDE+ORACLE优化配置 SDE的性能取决于: 首先操作系统的性能:其次是Oracle的性能,再次是SDE的性能. 第一:操作系统,无非是内存.CPU.带宽等. 可以有待提高的地方:第一.硬 ...
ThinkPHP pdo连接Oracle的配置写法，提示报错
'DB_TYPE' => 'pdo', // 数据库类型 'DB_USER' => 'user101', // username 'DB_PWD' => 'zb~!@#$%', // ...
Oracle数据库配置方式二--使用Net Manager配置数据库
在Oracle安装配置中使用Net Configuration配置了数据库,今天给大家介绍第二种配置方式,Net Manager配置. 先找到我们的Net Manager的快捷方式,如下面截图
Oracle 客户端配置笔记
1.右击桌面的我的电脑 -> 高级 -> 环境变量,新建 1) 变量名:ORACLE_HOME 变量值:D:\app\instantclient_11_2 2) 变量名:TNS_ADMIN ...
Oracle安装配置流程
Oracle安装流程第一次自己动手安装oracle,之前对oracle安装配置一窍不通,最后最终弄好.总结下. 1. 安装oracle10gserver端 2. 安装oracle10gclien ...
Nginx插件之openresty反向代理和日志滚动配置案例
Nginx插件之openresty反向代理和日志滚动配置案例作者:尹正杰版权声明:原创作品,谢绝转载!否则将追究法律责任. 一.openresty介绍 1>.Nginx介绍 Nginx是一款 ...

随机推荐

ecshop不同文章分类调用不同文章分类模板
根据需要,不同的文章分类会有不一样的页面风格.也就是说根据文章分类ID来判断,输出不同的文章分类模板. 重点就是文章分类的ID. 打开:article_cat.php $smarty->disp ...
win32调试打印
void __cdecl OutputDebugStringF(const char* format ...){ va_list vlArgs; char* stringBuffer=(char*)G ...
土地购买（bzoj 1597）
Description 农夫John准备扩大他的农场,他正在考虑N (1 <= N <= 50,000) 块长方形的土地. 每块土地的长宽满足(1 <= 宽 <= 1,000, ...
10个 jQuery 代码片段，可以帮你快速开发。
转载自:http://mp.weixin.qq.com/s/mMstI10vqwu8PvUwlLborw 1.返回顶部按钮你可以利用 animate 和 scrollTop 来实现返回顶部的动画,而 ...
ASN.1 key structures in DER and PEM
转自:https://tls.mbed.org/kb/cryptography/asn1-key-structures-in-der-and-pem Introduction Everybody lo ...
Sql server2012还原备份文件语句
--sql2012还原sql2008语句 --选择master数据库,新建查询输入下面sql语句 --选择兼容模式(sql 2008)创建数据库db(还原时db写成原生数据库名称) RESTORE ...
Duilib源码分析(三)XML解析器—CMarkup
上一节介绍了控件构造器CDialogBuilder,接下来将分析其XML解析器CMarkup: CMarkup:xml解析器,目前内置支持三种编码格式:UTF8.UNICODE.ASNI,默认为UTF ...
ZooKeeper基本原理
ZooKeeper简介 ZooKeeper是一个开放源码的分布式应用程序协调服务,它包含一个简单的原语集,分布式应用程序可以基于它实现同步服务,配置维护和命名服务等. ZooKeeper设计目的 1. ...
移动端webapp自适应实践（css雪碧图制作小工具实践）图文并茂
为什么要写这个以前写过关于webapp自适应屏幕的文章(链接),不过写的大多数群众看不懂,所以来个图文并茂的版本.虽然只是一个简单的页面,不过在做的过程中也遇到了一些问题,也算是好事吧! 该示例gi ...
sql基础大全

Oracle CDC配置案例

异步部署

1. 环境的配置准备

1.1. 数据库版本

1.2. 配置数据库参数

1.3. 开启归档及补充日志

1.4. 准备测试的表

2. 创建发布者和订阅者

2.1. 创建发布者/授权

2.2. 创建订阅者/授权

3. 发布/订阅具体数据

3.1. 发布：准备源表(Source Table)

3.2. 发布：创建变更集(Data Set)

3.3. 发布：创建变更表

3.4. 发布：激活变更集

3.5. 订阅：创建订阅集

3.6. 订阅：开始订阅表信息

3.7. 订阅：激活订阅

3.8. 订阅：扩展订阅窗口

4. 测试订阅发布

4.1. SCOTT表更改

4.2. 查询数据发布情况

4.3. 查询数据订阅情况

4.4. 清除变更数据集

4.5. 重新生成变化数据

4.6. 删除发布的数据

Oracle CDC配置案例的更多相关文章

随机推荐

热门专题