You are previewing Oracle GoldenGate 11g Implementer's guide.
O'Reilly logo
Oracle GoldenGate 11g Implementer's guide

Book Description

Design, install, and configure high-performance data replication solutions using Oracle GoldenGate

  • The very first book on GoldenGate, focused on design and performance tuning in enterprise-wide environments

  • Exhaustive coverage and analysis of all aspects of the GoldenGate software implementation, including design, installation, and advanced configuration

  • Migrate your data replication solution from Oracle Streams to GoldenGate

  • Design a GoldenGate solution that meets all the functional and non-functional requirements of your system

  • Written in a simple illustrative manner, providing step-by-step guidance with discussion points

  • Goes way beyond the manual, appealing to Solution Architects, System Administrators and Database Administrators

  • In Detail

    Data replication is an important part of any database system that is growing due to today's demand for real-time reporting and regulatory requirements. GoldenGate has recently become Oracle's strategic real-time data replication solution. Until now, very little has been written about how to implement GoldenGate in a production enterprise environment where performance, scalability, and data integrity are paramount.

    Your days of dismay over the lack of documentation over Oracle GoldenGate are over.

    Welcome to Oracle GoldenGate 11g Implementer's guide – a comprehensive practical book, which will deliver answers to your questions in a clear, concise style, allowing you to progress effectively in a timeline-driven environment. Based on the author's own experience, this long awaited GoldenGate administration book has all that is required to install, design, configure, and tune data replication solutions suited to every environment. Be the first to master GoldenGate's power and flexibility by reading this unique hands-on implementation companion.

    Systems need to send data from one system to another in a timely manner to satisfy the ever-increasing need for speed. Regardless of whether you are a novice or an expert - or someone in between - this book will guide you through all the steps necessary to build a high-performance GoldenGate solution on Oracle11gR1. Expert users can dive into key topic areas such as performance tuning or troubleshooting, while novice users can step through the early installation and configuration chapters, later progressing to the advanced chapters.

    This book is more than an implementation guide. It offers detailed real-life examples, encouraging additional thought and discussion by going beyond the manual.

    With Oracle GoldenGate 11g Implementer's guide in hand, you'll be designing, installing, and configuring high-performance solutions using GoldenGate in less time than you can say "replicate"

    Table of Contents

    1. Oracle GoldenGate 11g Implementer's guide
      1. Oracle GoldenGate 11g Implementer's guide
      2. Credits
      3. Foreword
      4. About the Author
      5. About the Reviewers
      6. www.PacktPub.com
        1. Support files, eBooks, discount offers and more
          1. Why Subscribe?
          2. Free Access for Packt account holders
          3. Instant Updates on New Packt Books
      7. Preface
        1. What this book covers
        2. What you need for this book
        3. Who this book is for
        4. Conventions
        5. Reader feedback
        6. Customer support
          1. Errata
          2. Piracy
          3. Questions
      8. 1. Getting Started
        1. What is GoldenGate?
        2. Oracle GoldenGate evolution
        3. Oracle GoldenGate solutions
        4. Oracle GoldenGate technology overview
          1. The capture process (Extract)
          2. Trail files
          3. Data Pump
          4. Server Collector
          5. The Apply process (Replicat)
          6. The Manager process
          7. GGSCI
          8. Process data flow
        5. Oracle GoldenGate architecture
          1. One-to-One
          2. One-to-Many
          3. Many-to-One
          4. Cascading
          5. Bi-directional (Active-Active)
          6. Bi-directional (Active-Passive)
        6. Supported platforms and databases
        7. Oracle Goldengate topology
          1. Process topology
            1. The rules
            2. Position
            3. Statistics
        8. Design considerations
          1. Choosing a solution
          2. Network
          3. Database schema
        9. What to Replicate?
          1. Object mapping and data selection
          2. Initial Load
          3. CSN co-ordination
          4. Trail file format
        10. Summary
      9. 2. Installing and Preparing GoldenGate
        1. Prerequisites
          1. Downloading the software
          2. Software requirements
          3. Hardware requirements
            1. Memory
            2. CPU
            3. Network
            4. Disk
        2. Software installation
          1. Installing GoldenGate
          2. The subdirectories
            1. dirchk
            2. dirdat
            3. dirdef
            4. dirpcs
            5. dirprm
            6. dirrpt
            7. dirsql
            8. dirtmp
        3. Preparing the environment
          1. Preparing the database for data replication
            1. Enabling supplemental logging
          2. Preparing the operating system
        4. Creating the initial configuration
          1. Creating the GoldenGate administrator
          2. The Manager process
          3. The Extract process
            1. Creating and starting an Extract process
          4. The Data Pump process
          5. The Replicat process
            1. Creating and starting a Replicat process
          6. Configuration summary
        5. Uninstalling GoldenGate from Linux/UNIX
        6. Summary
      10. 3. Design Considerations
        1. Replication methods
          1. Active-active
          2. Active-passive
          3. Cascading
          4. Physical Standby
        2. Networking
          1. Surviving network outages
            1. Redundant networks
              1. NIC teaming
        3. Non-functional requirements (NFRs)
          1. Latency
          2. Availability
          3. Backup and recovery
        4. Hardware considerations
          1. Computing architectures
            1. Grid computing
            2. Single server
            3. Clusters
          2. Machines
            1. The x86-64 Linux Server
            2. The Database Machine
            3. Scaling up and out
        5. Changed data management
          1. Point in Time Recovery (PITR)
            1. Oracle Recovery Manager (RMAN)
            2. Flashback
            3. SAN Snapshot
        6. Summary
      11. 4. Configuring Oracle GoldenGate
        1. GoldenGate parameters
        2. Configuring the Initial Load
          1. Choosing a method
            1. File to Replicat
              1. Extract parameters
              2. Replicat parameters
            2. File to database utility
              1. Extract parameters
              2. Replicat parameters
            3. Direct Load
              1. Extract parameters
              2. Replicat parameters
            4. Direct Bulk Load
              1. Extract parameters
              2. Replicat parameters
        3. Performing the Initial Load
          1. Example architecture
          2. File to Replicat method
            1. Configuring Initial Data Capture
            2. Configuring Initial Data Delivery
        4. Configuring Change Data Capture
        5. Configuring Change Delivery
        6. Testing Change Data Capture and Delivery
        7. Stopping GoldenGate processes
        8. More about trail files
          1. The trail
          2. Trail file purging
        9. Configuring the Manager process
        10. Summary
      12. 5. Configuration Options
        1. Using BATCHSQL
          1. SQL cache
          2. Exceptions
          3. When to use BATCHSQL
        2. Data compression
          1. Compressing the Data Stream
            1. The COMPRESS option
          2. Oracle table compression
        3. Security features
          1. Data encryption
          2. Password encryption
            1. Default method
            2. Named method
        4. Event Actions
          1. Event Records
        5. Bi-directional configuration options
          1. Loop detection
          2. Conflict detection
          3. Conflict resolution
          4. Oracle sequences
          5. Oracle triggers
        6. Heterogeneous environments
          1. Specific options
            1. Microsoft SQL Server
            2. IBM DB2
          2. The DEFGEN utility
        7. DDL replication
          1. The DDL parameter
            1. Filtering
            2. Mapping options
          2. Initial setup
            1. Known issues
          3. Using DUMPDDL
          4. DDL OPTIONS
        8. Summary
      13. 6. Configuring GoldenGate for HA
        1. GoldenGate on RAC
          1. Shared storage
            1. Automatic Storage Management Cluster File System (ACFS)
            2. Database File System (DBFS)
          2. Configuring Clusterware for GoldenGate
            1. The Virtual IP
            2. Creating a GoldenGate application
          3. Increasing system resilience
        2. GoldenGate on Exadata
          1. Configuration
            1. Creating the Extract process
            2. Creating the Replicat process
        3. Failover
          1. Automatic failover
          2. Manual failover
            1. Relocating a service
            2. Relocating a VIP
        4. Summary
      14. 7. Advanced Configuration
        1. Mapping your data
          1. Column mapping
            1. Using the COLMAP option
            2. The COLMATCH option
            3. Using the DEFGEN utility
        2. Data selection and filtering
          1. The WHERE clause
          2. The FILTER clause
          3. Loop detection
            1. Active-active
            2. Cascade
        3. Data transformation
          1. Truncation and extraction
          2. Concatenation
          3. Substitution
          4. Case changing
          5. Numeric conversions
          6. Date conversions
        4. DDL support
        5. The SQLEXEC parameter
          1. Data lookups
            1. Executing stored procedures
            2. Executing SQL
          2. Executing DML
            1. Handling errors
          3. Scheduling jobs
        6. Using and defining macros
        7. User tokens
        8. User Exits
          1. Calling C routines
          2. Sample User Exits
            1. Source files explained
        9. Using logic in data replication
        10. Licensing
        11. Summary
      15. 8. Managing Oracle GoldenGate
        1. Command level security
          1. The CMDSEC file
        2. Trail file management
        3. Managing process startup
        4. Managing TCP/IP errors
          1. The tcperrs file
        5. Reporting and statistics
          1. Monitoring errors
          2. Monitoring latency
            1. A bespoke solution to monitoring and reporting
              1. Graphing the results using Microsoft Excel
          3. Measuring throughput
            1. Data throughput
            2. Operation throughput
        6. Summary
      16. 9. Performance Tuning
        1. Before tuning GoldenGate
          1. Online redo
          2. Large objects (LOBs)
          3. Base lining
        2. Balancing the load across parallel process groups
          1. Considerations for using parallel process groups
        3. Splitting large tables into row ranges across process groups
          1. The RANGE function
            1. Adding Replicats with @RANGE function
        4. Configuring multiple parallel process groups
          1. Source system configuration
            1. Parallel process parameter files
            2. Creating extract parallel process groups
          2. Target system configuration
            1. Parallel process parameter files
            2. Creating Replicat parallel process groups
            3. Improving Replicat throughput
        5. New releases
          1. DBFS enhancements
          2. New redo log OCI API
        6. Tuning the network
          1. Linux TCP tuning
          2. Configuring a Bequeath connection
        7. Summary
      17. 10. Troubleshooting GoldenGate
        1. Troubleshooting tips
          1. Replication not working?
            1. The CHECKPARAMS parameter
          2. Adjusting the start point
            1. Altering Extract processes in RAC environments
          3. Checking process checkpoints
          4. Investigating network issues
            1. TCP/IP
            2. SQL*Net
          5. Investigating Oracle errors
        2. Exception handling
          1. Creating an Exceptions handler
          2. Viewing Exceptions
            1. Before and after images
        3. Handling Oracle Sequences
        4. Using LOGDUMP
          1. Opening files
          2. Viewing the header record
          3. Viewing the transaction record
          4. Miscellaneous commands
          5. Filtering records
        5. Upgrading GoldenGate
        6. Summary
      18. A. GGSCI Commands
      19. B. GoldenGate Installed Components
      20. C. The Future of Oracle GoldenGate