Oracle GoldenGate 11g Implementer's guide电子书

Oracle GoldenGate 11g Implementer's guide

Table of Contents

Oracle GoldenGate 11g Implementer's guide

Credits

Foreword

About the Author

About the Reviewers

www.PacktPub.com

Support files, eBooks, discount offers and more

Why Subscribe?

Free Access for Packt account holders

Instant Updates on New Packt Books

Preface

What this book covers

What you need for this book

Who this book is for

Conventions

Reader feedback

Customer support

Errata

Piracy

Questions

1. Getting Started

What is GoldenGate?

Oracle GoldenGate evolution

Oracle GoldenGate solutions

Oracle GoldenGate technology overview

The capture process (Extract)

Trail files

Data Pump

Server Collector

The Apply process (Replicat)

The Manager process

GGSCI

Process data flow

Oracle GoldenGate architecture

One-to-One

One-to-Many

Many-to-One

Cascading

Bi-directional (Active-Active)

Bi-directional (Active-Passive)

Supported platforms and databases

Oracle Goldengate topology

Process topology

The rules

Position

Statistics

Design considerations

Choosing a solution

Network

Database schema

What to Replicate?

Object mapping and data selection

Initial Load

CSN co-ordination

Trail file format

Summary

2. Installing and Preparing GoldenGate

Prerequisites

Downloading the software

Software requirements

Hardware requirements

Memory

CPU

Network

Disk

Software installation

Installing GoldenGate

The subdirectories

dirchk

dirdat

dirdef

dirpcs

dirprm

dirrpt

dirsql

dirtmp

Preparing the environment

Preparing the database for data replication

Enabling supplemental logging

Preparing the operating system

Creating the initial configuration

Creating the GoldenGate administrator

The Manager process

The Extract process

Creating and starting an Extract process

The Data Pump process

The Replicat process

Creating and starting a Replicat process

Configuration summary

Uninstalling GoldenGate from Linux/UNIX

Summary

3. Design Considerations

Replication methods

Active-active

Active-passive

Cascading

Physical Standby

Networking

Surviving network outages

Redundant networks

NIC teaming

Non-functional requirements (NFRs)

Latency

Availability

Backup and recovery

Hardware considerations

Computing architectures

Grid computing

Single server

Clusters

Machines

The x86-64 Linux Server

The Database Machine

Scaling up and out

Changed data management

Point in Time Recovery (PITR)

Oracle Recovery Manager (RMAN)

Flashback

SAN Snapshot

Summary

4. Configuring Oracle GoldenGate

GoldenGate parameters

Configuring the Initial Load

Choosing a method

File to Replicat

Extract parameters

Replicat parameters

File to database utility

Extract parameters

Replicat parameters

Direct Load

Extract parameters

Replicat parameters

Direct Bulk Load

Extract parameters

Replicat parameters

Performing the Initial Load

Example architecture

File to Replicat method

Configuring Initial Data Capture

Configuring Initial Data Delivery

Configuring Change Data Capture

Configuring Change Delivery

Testing Change Data Capture and Delivery

Stopping GoldenGate processes

More about trail files

The trail

Trail file purging

Configuring the Manager process

Summary

5. Configuration Options

Using BATCHSQL

SQL cache

Exceptions

When to use BATCHSQL

Data compression

Compressing the Data Stream

The COMPRESS option

Oracle table compression

Security features

Data encryption

Password encryption

Default method

Named method

Event Actions

Event Records

Bi-directional configuration options

Loop detection

Conflict detection

Conflict resolution

Oracle sequences

Oracle triggers

Heterogeneous environments

Specific options

Microsoft SQL Server

IBM DB2

The DEFGEN utility

DDL replication

The DDL parameter

Filtering

Mapping options

Initial setup

Known issues

Using DUMPDDL

DDL OPTIONS

Summary

6. Configuring GoldenGate for HA

GoldenGate on RAC

Shared storage

Automatic Storage Management Cluster File System (ACFS)

Database File System (DBFS)

Configuring Clusterware for GoldenGate

The Virtual IP

Creating a GoldenGate application

Increasing system resilience

GoldenGate on Exadata

Configuration

Creating the Extract process

Creating the Replicat process

Failover

Automatic failover

Manual failover

Relocating a service

Relocating a VIP

Summary

7. Advanced Configuration

Mapping your data

Column mapping

Using the COLMAP option

The COLMATCH option

Using the DEFGEN utility

Data selection and filtering

The WHERE clause

The FILTER clause

Loop detection

Active-active

Cascade

Data transformation

Truncation and extraction

Concatenation

Substitution

Case changing

Numeric conversions

Date conversions

DDL support

The SQLEXEC parameter

Data lookups

Executing stored procedures

Executing SQL

Executing DML

Handling errors

Scheduling jobs

Using and defining macros

User tokens

User Exits

Calling C routines

Sample User Exits

Source files explained

Using logic in data replication

Licensing

Summary

8. Managing Oracle GoldenGate

Command level security

The CMDSEC file

Trail file management

Managing process startup

Managing TCP/IP errors

The tcperrs file

Reporting and statistics

Monitoring errors

Monitoring latency

A bespoke solution to monitoring and reporting

Graphing the results using Microsoft Excel

Measuring throughput

Data throughput

Operation throughput

Summary

9. Performance Tuning

Before tuning GoldenGate

Online redo

Large objects (LOBs)

Base lining

Balancing the load across parallel process groups

Considerations for using parallel process groups

Splitting large tables into row ranges across process groups

The RANGE function

Adding Replicats with @RANGE function

Configuring multiple parallel process groups

Source system configuration

Parallel process parameter files

Creating extract parallel process groups

Target system configuration

Parallel process parameter files

Creating Replicat parallel process groups

Improving Replicat throughput

New releases

DBFS enhancements

New redo log OCI API

Tuning the network

Linux TCP tuning

Configuring a Bequeath connection

Summary

10. Troubleshooting GoldenGate

Troubleshooting tips

Replication not working?

The CHECKPARAMS parameter

Adjusting the start point

Altering Extract processes in RAC environments

Checking process checkpoints

Investigating network issues

TCP/IP

SQL*Net

Investigating Oracle errors

Exception handling

Creating an Exceptions handler

Viewing Exceptions

Before and after images

Handling Oracle Sequences

Using LOGDUMP

Opening files

Viewing the header record

Viewing the transaction record

Miscellaneous commands

Filtering records

Upgrading GoldenGate

Summary

A. GGSCI Commands

B. GoldenGate Installed Components

C. The Future of Oracle GoldenGate

Index