Oracle GoldenGate 12c Implementer's Guide电子书

Oracle GoldenGate 12c Implementer's Guide

Table of Contents

Oracle GoldenGate 12c Implementer's Guide

Credits

About the Author

About the Reviewers

www.PacktPub.com

Support files, eBooks, discount offers, and more

Why subscribe?

Free access for Packt account holders

Instant updates on new Packt books

Preface

What this book covers

What you need for this book

Who this book is for

Conventions

Reader feedback

Customer support

Downloading the example code

Errata

Piracy

Questions

1. Getting Started

What is GoldenGate?

Oracle GoldenGate evolution

Oracle GoldenGate solutions

Oracle GoldenGate technology overview

Extract – the capture process

Trail files

Data pump

Server collector

Replicat – the apply process

The Manager process

GGSCI

Process data flow

Oracle GoldenGate architecture

Classic configurations

One-to-one architecture

One-to-many architecture

Many-to-one architecture

Cascading

Bidirectional – active-active

Bidirectional – active-passive

New configurations

Oracle Data Integrator

Oracle Big Data

12c new features

Integrated capture

Integrated Replicat

Downstream capture

Installation

Upgrading to 12c

Multitenant database replication

Coordinated Delivery

Enhanced event-based processing

Enhanced security

Conflict Detection and Resolution

Dynamic Rollback

Streams to GoldenGate migration

Improved management and monitoring

Oracle Management Pack

Oracle GoldenGate Veridata

Supported platforms and databases

Oracle GoldenGate topology

Process topology

The rules

Position

Statistics

Design considerations

Choosing a solution

Network

Database schema

What to replicate?

Object mapping and data selection

Initial load

CSN coordination

Trail file format

Summary

2. Installing and Preparing GoldenGate

Prerequisites

The GoldenGate certification matrix

Downloading the software

Software requirements

Hardware requirements

Memory

CPU

Network

Disk

The Oracle virtual machine

The software installation

Installing GoldenGate using the OUI

Unpacking the media

Enabling the X server

Running the installer

Performing a silent installation

The subdirectories

br

dircrd

dirchk

dirdat

dirdef

dirpcs

dirprm

dirrpt

dirsql

dirtmp

dirwlt

Preparing the environment

Preparing the 12c container database for data replication

Enabling archive log mode

Enabling supplemental logging

Creating GoldenGate admin user

Enabling the Flashback Query

Enabling transaction data capture

Preparing the 11g database for replication

Enabling the archive log mode

Creating the GoldenGate admin user

Enabling the transaction data capture

Preparing the operating system

Creating the initial configuration

Configuring the Manager process

The capture process

Creating the capture process

Registering the capture process in a 12c container database

Registering the capture process in a 11g database

The data pump process

Starting the capture process

The apply process

Creating the GoldenGate admin user on the target database

Registering the Replicat process in the target database

Creating and starting the apply process

The configuration summary

Patching the GoldenGate home

GoldenGate deinstallation from Linux/Unix

Summary

3. Design Considerations

Replication methods

Active-active replication

Active-passive replication

Cascading

Downstream capture

Extract Load and Transform (E-LT)

Networking

Surviving network outages

Redundant networks

NIC teaming

Non-functional requirements

Performance

Availability

Security

Backup and recovery

Support

Hardware considerations

Computing architectures

Grid computing

Single server

Clusters

Cloud computing

Machines

The x86-64 Linux server

The database machine

Scaling up and out

Changed data management

Integrated capture and delivery

Classic mode

Coordinated mode

DDL replication

Changed data recovery

Point-in-time recovery (PITR)

Oracle Recovery Manager (RMAN)

Flashback

SAN Snapshot

Summary

4. Configuring Oracle GoldenGate

GoldenGate parameters

The GoldenGate instantiation

Choosing an instantiation method

File to Replicat

Extract parameters

Replicat parameters

File to Database Utility

Extract parameters

Replicat parameters

Direct Load

Extract parameters

Replicat parameters

Direct Bulk Load

Extract parameters

Replicat parameters

Performing the initial load

The example architecture

Direct Load instantiation

Configuring initial data capture

Configuring change data capture

The configuration summary

Creating the configuration for multitenant databases

Creating the configuration for nonCDB databases

Configuring change delivery

Testing change data capture and delivery

Stopping GoldenGate processes

More about trail files

The trail

Trail file purging

Configuring Oracle Manager process

Configuring the downstream mining database

Preparing the source database

Preparing the target database

The GoldenGate configuration

Summary

5. Configuration Options

Using BATCHSQL

The SQL cache

Exceptions

When to use BATCHSQL

Data compression

Compressing the data stream

The COMPRESS option

The Oracle table compression

Security features

The wallet method

The ENCKEYS method

The data encryption

The message encryption

The trail file encryption

The password encryption

The default method

The named method

The Credential Store

Event-based processing

The Event Marker System

Triggering Event Actions

Using Event Actions to improve batch performance

Bidirectional configuration options

The loop detection

Conflict Detection and Resolution in bidirectional environment

CDR reporting

Exception handling

Oracle sequences

Oracle triggers

The DDL support

The DDL replication

The DDL configuration

Filtering

Mapping options

The DDLOPTIONS parameter

Using DUMPDDL

Using LogMiner

Heterogeneous environments

Microsoft SQL Server

IBM DB2

The DEFGEN utility

Oracle Streams to GoldenGate Migration

Summary

6. Configuring GoldenGate for HA

GoldenGate on RAC

Shared Storage

ACFS

DBFS

OCFS

Configuring GoldenGate on RAC

Configuring Grid Infrastructure for GoldenGate

Oracle Grid Infrastructure Agents (XAG)

Installing the XAG Grid Infrastructure Agents

The Virtual IP

Creating an ACFS-shared filesystem

Installing the GoldenGate software

Creating the GoldenGate application VIP

Resilience

GoldenGate on Exadata

Supported compression methods

Considerations

Creating the Extract process

Creating the Replicat process

Failover

The automatic failover

The manual failover

The GoldenGate application failover

The active-active configuration

Summary

7. Advanced Configuration

Mapping your data

Column mapping

Using the COLMAP option

The COLMATCH option

Using the DEFGEN utility

Data selection and filtering

The WHERE clause

The FILTER clause

Loop detection

Active-active

Cascade

Data transformation

Truncation and extraction

Concatenation

Substitution

Case changing

Conversion functions

Arithmetic expressions

Date functions

DDL support

The SQLEXEC parameter

Data lookups

Executing stored procedures

Executing SQL

Executing DML

Handling errors

Scheduling jobs

Using and defining macros

User tokens

Using user tokens to populate a heartbeat table

User exits

Calling C routines

Sample user exits

Source files explained

Using logic in the data replication

Replicating data between different GoldenGate versions

Licensing

Oracle Data Integrator 12c

ETL versus E-LT

Pros

Cons

Knowledge Modules

Summary

8. Managing Oracle GoldenGate

The Oracle Management Pack for GoldenGate

Oracle GoldenGate Monitor 12c

Command-level security

The CMDSEC file

Managing the trail file

Managing the process startup

Managing TCP/IP errors

Reporting and statistics

Monitoring errors

Monitoring latency

Creating an OEM 12c Metric Extension to monitor GoldenGate processes

Creating the monitoring script

Creating the Metric Extension

Deploying the Metric Extension

Historical reporting

Measuring throughput

The data throughput

The operation throughput

Summary

9. Performance Tuning

Before tuning GoldenGate

The online redo logs

Large objects – LOBs

Base lining

DBFS enhancements

Tuning data delivery

Balancing load across parallel process groups

Considerations when using parallel process groups

Splitting large tables into row ranges across process groups

The RANGE function

Adding Replicats with the @RANGE function

Tuning parameters to improve the Replicat throughput

BATCHSQL

COMMIT_SERIALIZATION

EAGER_SIZE

PARALLELISM

Viewing integrated parameters

Controlling the memory consumption

Tracing processes to find wait events

Diagnosing a slow Extract

Static data dictionary views

Tuning the network

Linux TCP tuning

Hardware upgrades

Solid-state disks

Summary

10. Troubleshooting GoldenGate

Troubleshooting tips

Troubleshooting process startup failures

The CHECKPARAMS parameter

Adjusting the replication starting point

Altering Extract processes in RAC environments

Classic capture

Integrated capture

Confirming the integrated capture process status

Checking data throughput

Checking process checkpoints

Recovering from a corrupt trail file

GoldenGate health check

The GoldenGate dynamic performance views

Investigating network issues

TCP/IP

SQL*Net

Bequeath connections

Investigating Oracle errors

Exception handling

Creating an exceptions handler

Viewing exceptions

Handling Oracle Sequences

Using LOGDUMP

Opening files

Viewing the header record

Viewing the transaction record

Miscellaneous commands

Filtering records

Upgrading GoldenGate

Dynamic Rollback

Creating process groups and trails for reverse processing

Summary

11. The Future of GoldenGate

Cloud computing

The Oracle Integration Cloud Service

On-premises to cloud migrations

GoldenGate and Big Data

Deprecation of the nonCDB architecture

Oracle GoldenGate 12c Release 2

Summary

A. GGSCI Commands

B. GoldenGate Installed Components

C. Acronyms

Index