You are previewing Oracle GoldenGate 11g Complete Cookbook.
O'Reilly logo
Oracle GoldenGate 11g Complete Cookbook

Book Description

Over 60 simple and easy-to-follow recipes to perform various Goldengate administration tasks such as installing, configuring, and maintaining Goldengate replication

  • Various recipes that will help you to set up Goldengate in various environments

  • Practical examples of Goldengate management tasks

  • Step by step instructions with various examples and scripts

In Detail

Oracle Goldengate 11g Complete Cookbook is your complete guide to all aspects of Goldengate administration. The recipes in this book will teach you how to setup Goldengate configurations for simple and complex environments requiring various filtering and transformations. It also covers various aspects of tuning and troubleshooting the replication setups using exception handling, custom fields, and logdump utility.

The book begins by explaining some basic tasks like Installation and Process groups setup. You will then be introduced to some further topics including DDL replication and various options to perform Initial Loads. You will then learn some advanced administration tasks such as Multi Master replication setup and conflict resolution. Further recipes, contain the cross platform replication and high availability options for Goldengate.

Table of Contents

  1. Oracle GoldenGate 11g Complete Cookbook
    1. Table of Contents
    2. Oracle GoldenGate 11g Complete Cookbook
    3. Credits
    4. About the Author
    5. About the Reviewers
    6. www.PacktPub.com
      1. Support files, eBooks, discount offers, and more
        1. Why Subscribe?
        2. Free Access for Packt account holders
        3. Instant Updates on New Packt Books
    7. Preface
      1. What this book covers
      2. What you need for this book
      3. Who this book is for
      4. Conventions
      5. Reader feedback
      6. Customer support
        1. Downloading the example code
        2. Errata
        3. Piracy
        4. Questions
    8. 1. Installation and Initial Setup
      1. Introduction
      2. Installing Oracle GoldenGate in a x86_64 Linux-based environment
        1. Getting ready
        2. How to do it...
        3. How it works...
      3. Installing Oracle GoldenGate in a Windows environment
        1. Getting ready
        2. How to do it...
        3. How it works...
      4. Enabling supplemental logging in the source database
        1. Getting ready
        2. How to do it…
        3. How it works…
        4. There's more…
        5. See also
      5. Supported datatypes in Oracle GoldenGate
        1. Getting ready
        2. How to do it…
        3. How it works…
        4. There's more…
      6. Preparing the source database for GoldenGate setup
        1. Getting ready
        2. How to do it…
        3. How it works…
        4. There's more…
          1. The Classic Capture mode
          2. The Integrated Capture mode
        5. See also
      7. Preparing the target database for GoldenGate setup
        1. Getting ready
        2. How to do it…
        3. How it works…
        4. There's more…
      8. Setting up a Manager process
        1. Getting ready
        2. How to do it…
        3. How it works…
        4. There's more…
      9. Setting up a Classic Capture Extract process
        1. Getting ready
        2. How to do it…
        3. How it works…
        4. There's more…
        5. See also
      10. Setting up an Integrated Capture Extract process
        1. Getting ready
        2. How to do it…
        3. How it works…
        4. There's more…
        5. See also
      11. Setting up a Datapump process
        1. Getting ready
        2. How to do it…
        3. How it works…
        4. There's more…
        5. See also
      12. Setting up a Replicat process
        1. Getting ready
        2. How to do it…
        3. How it works…
        4. There's more…
        5. See also
    9. 2. Setting up GoldenGate Replication
      1. Introduction
      2. Setting up a simple GoldenGate replication configuration between two single node databases
        1. Getting ready
        2. How to do it...
        3. How it works...
        4. There's more...
        5. See also
      3. Setting up a GoldenGate replication with multiple process groups
        1. Getting ready
        2. How to do it...
        3. How it works...
        4. There's more...
        5. See also
      4. Configuring an Extract process to read from an Oracle ASM instance
        1. How to do it…
        2. How it works…
      5. Setting up a GoldenGate replication between Oracle RAC databases
        1. Getting ready
        2. How to do it…
        3. How it works…
        4. See also
      6. Determining the size of trail file areas
        1. How to do it…
        2. How it works...
      7. Verifying the data transfer on the target system
        1. Getting ready
        2. How to do it...
        3. How it works…
        4. There's more...
      8. Generating encryption keys
        1. How to do it…
        2. How it works…
      9. Encrypting database user passwords
        1. Getting ready
        2. How to do it…
        3. How it works…
      10. Encrypting the trail files
        1. Getting ready
        2. How to do it…
        3. How it works…
      11. Setting up a GoldenGate replication between tables with different structures using defgen
        1. Getting ready
        2. How to do it…
        3. How it works…
        4. See also
    10. 3. DDL Replication and Initial Load
      1. Introduction
      2. Performing an initial setup required for GoldenGate DDL replication
        1. Getting ready
        2. How to do it...
        3. How it works...
        4. There's more...
        5. See also
      3. Setting up a GoldenGate DDL replication and verifying the changes
        1. Getting ready
        2. How to do it...
        3. How it works...
        4. There's more...
          1. Extra privileges that are required for the GoldenGate Admin user
          2. Filtering and mapping
          3. Additional DDLOPTIONS
      4. Performing an initial load using GoldenGate
        1. Getting ready
        2. How to do it...
        3. How it works...
        4. There's more...
          1. Extract file to the Replicat method
          2. Trail to the Replicat method
          3. File to the database utility method
          4. GoldenGate direct load method
          5. Direct bulk load to SQL loader method
        5. See also
      5. Performing an initial load using an extract file to the GoldenGate's replicat method
        1. Getting ready
        2. How to do it...
        3. How it works...
        4. There's more...
      6. Loading data using trail files to the Replicat process method
        1. Getting ready
        2. How to do it...
        3. How it works...
      7. Loading data with files to the database utility method
        1. Getting ready
        2. How to do it...
        3. How it works...
        4. There's more...
        5. See also
      8. Loading data with the GoldenGate direct load method
        1. Getting ready
        2. How to do it...
        3. How it works...
        4. There's more...
      9. Loading data with bulk load to the SQL loader method
        1. Getting ready
        2. How to do it...
        3. How it works...
    11. 4. Mapping and Manipulating Data
      1. Introduction
      2. Setting up a GoldenGate replication with mapping between different columns
        1. Getting ready
        2. How to do it...
        3. How it works...
        4. There's more...
          1. Source environment mapping
          2. Defining global mappings
          3. Defining mappings using prefix/suffix
        5. See also
      3. Adding custom fields for a replicated record using tokens
        1. Getting ready
        2. How to do it...
        3. How it works...
        4. There's more...
        5. See also
      4. Adding custom fields to a replicated record using SQLEXEC
        1. Getting ready
        2. How to do it...
        3. How it works...
        4. There's more...
          1. Running a stored procedure with SQLEXEC
          2. Running a global SQL statement/procedure
      5. Filtering the records using the FILTER and WHERE clause
        1. Getting ready
        2. How to do it...
        3. How it works...
        4. There's more...
          1. Using the Where clause
          2. Filtering in the source environment
          3. Filtering the records into parallel groups
        5. See also
      6. Mapping the changes to a target table and storing the transaction history in a history table
        1. Getting ready
        2. How to do it...
        3. How it works...
        4. See also
      7. Creating a GoldenGate configuration to run a Shell script when an end-of-day processing record is replicated
        1. Getting ready
        2. How to do it...
        3. How it works...
        4. There's more...
        5. See also
      8. Creating an exception handler to record the erroneous transactions in a GoldenGate configuration
        1. Getting ready
        2. How to do it...
        3. How it works...
        4. There's more...
          1. MAPEXCEPTION method
          2. Handle exceptions with a MACRO
        5. See also
    12. 5. Oracle GoldenGate High Availability
      1. Introduction
      2. Choosing a GoldenGate high availability option
        1. Getting ready
        2. How to do it...
        3. How it works...
        4. There's more…
          1. Oracle Cluster File System (OCFS2)
          2. Database File System (DBFS)
          3. ASM Cluster File System (ACFS)
        5. See also
      3. Creating a highly available GoldenGate configuration using Oracle Clusterware and ACFS
        1. Getting ready
        2. How to do it...
        3. How it works...
      4. Creating a highly available GoldenGate configuration using Oracle Clusterware and OCFS2
        1. Getting ready
        2. How to do it...
        3. How it works...
      5. Creating a highly available GoldenGate configuration using Oracle Clusterware and DBFS
        1. Getting ready
        2. How to do it...
        3. How it works...
        4. See also
      6. Manually switching over Oracle Clusterware-based configuration to the other node
        1. Getting ready
        2. How to do it...
        3. How it works...
      7. Automatic failover of a DBFS-based configuration
        1. Getting ready
        2. How to do it...
        3. How it works...
        4. There's more...
          1. Manual relocation of a DBFS-based GoldenGate configuration
      8. Creating a set of parallel load balanced, highly available GoldenGate configurations using Oracle Clusterware and DBFS
        1. Getting ready
        2. How to do it...
        3. How it works...
        4. See also
    13. 6. Monitoring, Tuning, and Troubleshooting GoldenGate
      1. Introduction
      2. Steps to configure a BATCHSQL mode
        1. How to do it...
        2. How it works...
        3. There's more…
        4. See also
      3. Splitting the replication load into multiple process groups for optimal performance
        1. How to do it...
        2. How it works...
        3. There's more…
          1. The RANGE function
        4. See also
      4. Optimizing the network settings for a GoldenGate configuration
        1. Getting ready
        2. How to do it...
        3. How it works...
      5. Performing a healthcheck of a live GoldenGate configuration
        1. How to do it...
        2. How it works...
        3. See also
      6. Script to perform a regular scheduled healthcheck of a live GoldenGate configuration
        1. Getting ready
        2. How to do it...
        3. How it works...
        4. See also
      7. Steps to measure throughput of a GoldenGate configuration
        1. Getting ready
        2. How to do it...
        3. How it works...
        4. There's more...
          1. Stats command options
        5. See also
      8. Steps to re-instantiate a failed GoldenGate configuration
        1. Getting ready
        2. How to do it...
        3. How it works...
        4. See also
      9. Steps to implement a Heartbeat mechanism for the GoldenGate replication
        1. Getting ready
        2. How to do it...
        3. How it works...
        4. There's more...
        5. See also
    14. 7. Advanced Administration Tasks – I
      1. Introduction
      2. Upgrading Oracle GoldenGate binaries
        1. Getting ready
        2. How to do it...
        3. How it works...
      3. Table structure changes in GoldenGate environments with similar table definitions
        1. Getting ready
        2. How to do it…
        3. How it works...
        4. There's more...
          1. Specific tables defined in GoldenGate parameter files
          2. Individual table permissions granted to the GoldenGate Admin user
          3. Supplemental logging for modified tables without any keys
          4. Supplemental log groups with all columns for modified tables
        5. See also
      4. Table structure changes in GoldenGate environments with different table definitions
        1. Getting ready
        2. How to do it...
        3. How it works...
        4. There's more…
          1. Individual table permissions granted to the GoldenGate Admin user
          2. Supplemental logging for modified tables without any keys
          3. Supplemental log groups with all columns for modified tables
      5. Resolving GoldenGate errors using the logdump utility
        1. Getting ready
        2. How to do it...
        3. How it works...
        4. There's more...
          1. Count
          2. Scan for timestamp
          3. Filter on SCN
        5. See also
      6. Undoing the applied changes using the reverse utility
        1. Getting ready
        2. How to do it...
        3. How it works...
        4. There's more...
      7. Creating an Integrated Capture with a downstream database for compressed tables
        1. Getting ready
        2. How to do it...
        3. How it works...
    15. 8. Advanced Administration Tasks – Part II
      1. Introduction
      2. Creating a GoldenGate configuration with a consistent state behind the target database
        1. Getting ready
        2. How to do it...
        3. How it works...
        4. There's more…
          1. Why use deferred apply
          2. DEFERAPPLYINTERVAL UNITS
        5. See also
      3. Replicating data from an active standby database in Archivelog mode only
        1. Getting ready
        2. How to do it…
        3. How it works...
      4. Migrating from an Oracle Streams environment to Oracle GoldenGate
        1. Getting ready
        2. How to do it...
        3. How it works...
      5. GoldenGate Administration role separation from the DBA team
        1. Getting ready
        2. How to do it…
        3. How it works...
      6. Cross RDBMS replication using GoldenGate
        1. Getting ready
        2. How to do it...
        3. How it works...
      7. Creating a multimaster GoldenGate replication configuration
        1. Getting ready
        2. How to do it...
        3. How it works...
        4. There's more…
          1. Data collision avoidance
          2. Data collision resolution
            1. Timestamp-based
            2. Defined trusted source
    16. 9. GoldenGate Veridata, Director, and Monitor
      1. Introduction
      2. Setting up the Oracle GoldenGate Monitor server
        1. Getting ready
        2. How to do it...
        3. How it works...
        4. There's more…
          1. Installing the GoldenGate Monitor server using HTTPS
        5. See also
      3. Setting up Oracle GoldenGate Monitor Agents
        1. Getting ready
        2. How to do it…
        3. How it works...
        4. There's more…
      4. Installing Oracle GoldenGate Director
        1. Getting ready
        2. How to do it...
        3. How it works...
        4. See also
      5. Installing and using Oracle GoldenGate Director Client to manage the GoldenGate instances
        1. Getting ready
        2. How to do it...
        3. How it works...
      6. Steps to set up the GoldenGate monitoring using OEM 12c
        1. Getting ready
        2. How to do it...
        3. How it works...
        4. There's more...
      7. Steps to install Oracle GoldenGate Veridata
        1. Getting ready
        2. How to do it...
        3. How it works...
        4. See also
      8. Steps to compare data between the source and target environment using Oracle GoldenGate Veridata
        1. Getting ready
        2. How to do it...
        3. How it works...
    17. Index