You are previewing Exploiting IBM PowerHA SystemMirror V6.1 for AIX Enterprise Edition.
O'Reilly logo
Exploiting IBM PowerHA SystemMirror V6.1 for AIX Enterprise Edition

Book Description

This IBM® Redbooks® publication positions the IBM PowerHA® SystemMirror® V6.1 for AIX® Enterprise Edition as the cluster management solution for high availability. This solution enables near-continuous application service and minimizes the impact of planned and unplanned outages.

The primary goal of this high-availability solution is to recover operations at a remote location after a system or data center failure, establish or strengthen a business recovery plan, and provide separate recovery location. The IBM PowerHA SystemMirror Enterprise Edition is targeted at multisite high-availability disaster recovery.

The objective of this book is to help new and existing PowerHA customers to understand how to plan to accomplish a successful installation and configuration of the PowerHA SystemMirror for AIX Enterprise Edition.

This book emphasizes the IBM Power Systems™ strategy to deliver more advanced functional capabilities for business resiliency and to enhance product usability and robustness through deep integration with AIX, affiliated software stack, and storage technologies. PowerHA SystemMirror is designed, developed, integrated, tested, and supported by IBM from top to bottom.

Table of Contents

  1. Front cover
  2. Notices
    1. Trademarks
  3. Preface
    1. The team who wrote this book
    2. Now you can become a published author, too!
    3. Comments welcome
    4. Stay connected to IBM Redbooks
  4. Summary of changes
    1. May 2013, Second Edition
  5. Part 1 Introduction
    1. Chapter 1. High-availability and disaster recovery overview
      1. 1.1 Introduction
      2. 1.2 Disaster recovery and PowerHA
        1. 1.2.1 Local failover versus site failover
        2. 1.2.2 Independent versus integrated replication
      3. 1.3 Application data integrity
        1. 1.3.1 Disaster recover for applications with dependent writes
        2. 1.3.2 PowerHA Enterprise Edition SNMP trap support
      4. 1.4 Selecting the correct solution
        1. 1.4.1 Synchronous versus asynchronous replication
        2. 1.4.2 Decision making
      5. 1.5 PowerHA enterprise logistics
        1. 1.5.1 IBM PowerHA SystemMirror Enterprise Edition licensing
        2. 1.5.2 Dynamic LPAR integration and licensing
      6. 1.6 What is new on PowerHA Enterprise Edition
        1. 1.6.1 PowerHA Enterprise Edition for Metro Mirror software
        2. 1.6.2 ESSCLI-based PPRC support
        3. 1.6.3 DSCLI-based PPRC support
        4. 1.6.4 DSCLI-based PPRC support for multiple storage units per site
        5. 1.6.5 SVC-PPRC support
        6. 1.6.6 PowerHA Enterprise Edition
        7. 1.6.7 PowerHA/XD SPPRC DSCLI security enhancements
        8. 1.6.8 PowerHA and Power Systems hardware and software support considerations
        9. 1.6.9 Viewing and installing the documentation files
    2. Chapter 2. Infrastructure considerations
      1. 2.1 Network considerations
        1. 2.1.1 Bandwidth
        2. 2.1.2 Bandwidth sizing
        3. 2.1.3 Network technologies
        4. 2.1.4 EtherChannel and IEEE 802.3ad link aggregation
        5. 2.1.5 XD_rs232 networks and Serial over Ethernet
        6. 2.1.6 Fibre Channel principles of distance
        7. 2.1.7 DWDM
        8. 2.1.8 Firewalls
      2. 2.2 Cluster topology considerations
        1. 2.2.1 Cluster topologies
        2. 2.2.2 Topology failure detection rates
        3. 2.2.3 IPAT across sites and DNS considerations
      3. 2.3 Storage considerations
        1. 2.3.1 PowerHA using cross-site LVM mirroring
        2. 2.3.2 PowerHA Enterprise Edition with storage replication
        3. 2.3.3 SAN considerations in storage replication environments
        4. 2.3.4 PowerHA Enterprise Edition with GLVM
      4. 2.4 PowerVM virtualization considerations
        1. 2.4.1 Network virtualization considerations
        2. 2.4.2 Storage considerations in a virtualized environment
        3. 2.4.3 Virtualization performance considerations
        4. 2.4.4 Live Partition Mobility and PowerHA
        5. 2.4.5 Virtualization and migrating to new hardware
      5. 2.5 Server considerations
        1. 2.5.1 Software considerations
        2. 2.5.2 AIX level requirements
        3. 2.5.3 Multipath driver requirements
        4. 2.5.4 DSCLI requirements
        5. 2.5.5 Requirements for PowerHA Enterprise Edition for Metro Mirror with SAN Volume Controller
        6. 2.5.6 Hardware considerations
  6. Part 2 Campus style disaster recovery
    1. Chapter 3. Campus-style disaster recovery solutions
      1. 3.1 IBM cross-site LVM mirroring
      2. 3.2 IBM SAN Volume Controller VDisk split I/O group
      3. 3.3 IBM Metro Mirror
      4. 3.4 IBM GLVM
      5. 3.5 Performance implications
        1. 3.5.1 Test environment details
        2. 3.5.2 Mirroring performance penalty test results
        3. 3.5.3 Test results
        4. 3.5.4 Customer case study
        5. 3.5.5 Summary
    2. Chapter 4. Configuring PowerHA Standard Edition with cross-site logical volume mirroring
      1. 4.1 Configuring the cross-site LVM mirroring cluster
        1. 4.1.1 Configuring the cluster topology
        2. 4.1.2 Configuring the cross-site LVM disk mirroring dependency
        3. 4.1.3 Mirror pool disk
        4. 4.1.4 Configuring a resource group
      2. 4.2 Testing cross-site LVM mirroring cluster
        1. 4.2.1 Adding file systems
        2. 4.2.2 Changing a file system size
        3. 4.2.3 Moving cluster resource group
        4. 4.2.4 Node failure
        5. 4.2.5 Storage connection failure
        6. 4.2.6 Storage failure
        7. 4.2.7 Site failure
      3. 4.3 Maintaining cross-site LVM mirroring cluster
        1. 4.3.1 Creating a volume group
        2. 4.3.2 Adding and removing volumes into an existing volume group
        3. 4.3.3 Adding new logical volumes
        4. 4.3.4 Adding space to an existing logical volume
        5. 4.3.5 Adding a file system
        6. 4.3.6 Increasing the size of a file system
  7. Part 3 Extended distance disaster recovery short overview
    1. Chapter 5. Configuring PowerHA SystemMirror Enterprise Edition with Metro Mirror and Global Mirror
      1. 5.1 Scenario description
      2. 5.2 Planning and prerequisites overview
        1. 5.2.1 Planning
        2. 5.2.2 Prerequisites overview
      3. 5.3 Installing and configuring PowerHA Enterprise Edition for SAN Volume Controller
        1. 5.3.1 Topology
        2. 5.3.2 Configuring PowerHA Enterprise Edition for SAN Volume Controller
        3. 5.3.3 Adding the cluster
        4. 5.3.4 Adding four nodes
        5. 5.3.5 Adding two sites
        6. 5.3.6 Adding the net_ether_01 network
        7. 5.3.7 Adding the net_XD_ip_01 network
        8. 5.3.8 Adding the net_diskhb_01 network
        9. 5.3.9 Adding the net_diskhb_02 network
        10. 5.3.10 Adding the service IP label
        11. 5.3.11 Adding SAN Volume Controller cluster definitions
        12. 5.3.12 Adding the SVC PPRC relationships
        13. 5.3.13 Adding the SVC PPRC replicated resource configuration
        14. 5.3.14 Creating volume groups in the svc_sitea
        15. 5.3.15 Creating the volumes groups
        16. 5.3.16 Creating temporary SVC PPRC relationships
        17. 5.3.17 Importing the volume groups to the remote site svc_siteb
        18. 5.3.18 Creating the resource groups
        19. 5.3.19 Adding volumes groups, replicated resources, and services IP labels
        20. 5.3.20 Synchronizing the cluster
      4. 5.4 Adding and removing disks to PowerHA Enterprise Editionfor SAN Volume Controller
        1. 5.4.1 Adding disks to PowerHA Enterprise Edition with SAN Volume Controller
        2. 5.4.2 Removing disks from PowerHA Enterprise Edition with SAN Volume Controller
      5. 5.5 Testing PowerHA Enterprise Edition with SAN Volume Controller
        1. 5.5.1 Monitoring the SVC PPRC relationship
        2. 5.5.2 Site failure (soft and hard)
        3. 5.5.3 Storage loss
        4. 5.5.4 Convert replication mode
        5. 5.5.5 Lost of the replication links (auto versus manual)
      6. 5.6 Troubleshooting PowerHA Enterprise Edition for SAN Volume Controller
    2. Chapter 6. Configuring PowerHA SystemMirror Enterprise Edition with ESS/DS Metro Mirror
      1. 6.1 Planning
      2. 6.2 Software requirements
      3. 6.3 Considerations and restrictions
      4. 6.4 Environment example
        1. 6.4.1 Volume information
        2. 6.4.2 Topology (cltopinfo command)
        3. 6.4.3 Volume groups
        4. 6.4.4 Resource groups
      5. 6.5 Installing and configuring Metro Mirroring
        1. 6.5.1 Installing the software
        2. 6.5.2 Setting up the disks and volume groups
        3. 6.5.3 Configuring the PPRC replicated resources
        4. 6.5.4 Verifying the DSCLI managed configuration
        5. 6.5.5 Configuring the resource groups
        6. 6.5.6 Configuring the resources and attributes for the resource group
        7. 6.5.7 Synchronizing the cluster
      6. 6.6 Test scenarios
        1. 6.6.1 Moving a resource group to another site
        2. 6.6.2 Loss of both nodes at one site
        3. 6.6.3 Loss of local disk storage on one site
        4. 6.6.4 Loss of the PPRC connection between sites
        5. 6.6.5 Loss of all XD_ip networks between sites
        6. 6.6.6 Total site failure
      7. 6.7 Adding and removing LUNs
        1. 6.7.1 Adding a disk or LUN
        2. 6.7.2 Removing a disk or LUN
      8. 6.8 Commands for troubleshooting or gathering information
      9. 6.9 PowerHA Enterprise Edition: SPPRC DSCLI security enhancements
    3. Chapter 7. Configuring PowerHA SystemMirror Enterprise Edition with SRDF replication
      1. 7.1 General considerations
        1. 7.1.1 Operational considerations for the current release of integration
        2. 7.1.2 Documentation resources
      2. 7.2 Planning
        1. 7.2.1 Hardware considerations
        2. 7.2.2 Software prerequisites
      3. 7.3 Environment description
      4. 7.4 Installation and configuration
        1. 7.4.1 Installing and configuring the prerequisite software
        2. 7.4.2 Installing the cluster software
        3. 7.4.3 Defining the cluster topology
        4. 7.4.4 Defining the SRDF configuration
        5. 7.4.5 Importing the volume group definition in the remote site
        6. 7.4.6 Defining the cluster resources
        7. 7.4.7 Adding the second resource group to the existing configuration
      5. 7.5 Test scenarios
        1. 7.5.1 Graceful site failover
        2. 7.5.2 Total site failure
        3. 7.5.3 Storage access failure
      6. 7.6 Maintaining the cluster configuration with SRDF replicated resources
        1. 7.6.1 Changing an SRDF replicated resource
        2. 7.6.2 Removing an SRDF replicated resource
        3. 7.6.3 Changing between SRDF/S and SRDF/A operation modes
        4. 7.6.4 Adding volumes to the cluster configuration
      7. 7.7 Troubleshooting PowerHA Enterprise Edition SRDF managed replicated resources
      8. 7.8 Commands for managing the SRDF environment
        1. 7.8.1 SYMCLI commands for SRDF environment
        2. 7.8.2 Deleting existing device group and composite group definitions
    4. Chapter 8. Configuring PowerHA SystemMirror Enterprise Edition with Geographic Logical Volume Manager
      1. 8.1 Planning the implementation of PowerHA Enterprise Edition with GLVM
        1. 8.1.1 Requirements and considerations
        2. 8.1.2 Asynchronous mirroring practices
      2. 8.2 Installing and configuring PowerHA for GLVM
        1. 8.2.1 Installation components and prerequisites for implementing PowerHA Enterprise Edition for GLVM
        2. 8.2.2 Configuring geographically mirrored volume groups
        3. 8.2.3 Integrating geographically mirrored volume groups into a PowerHA cluster
      3. 8.3 Configuration wizard for GLVM
        1. 8.3.1 Prerequisites
        2. 8.3.2 Considerations
        3. 8.3.3 Starting with the GLVM wizard
        4. 8.3.4 Configuring GLVM and PowerHA by using the GLVM wizard
      4. 8.4 Configuring a 4-node, 2-site PowerHA for GLVM
        1. 8.4.1 Configuring a geographically mirrored volume group
        2. 8.4.2 Extending the geographically mirrored standard volume group to other nodes in the cluster
        3. 8.4.3 Configuring the cluster, the nodes, and the sites
        4. 8.4.4 Configuring XD-type networks and communication interfaces
      5. 8.5 Configuring site-specific networks
        1. 8.5.1 Configuring the ether-type networks
        2. 8.5.2 Configuring the persistent IP addresses for each node
        3. 8.5.3 Configuring resource groups in PowerHA for GLVM
        4. 8.5.4 Verifying and synchronizing the GLVM configuration
      6. 8.6 Configuring a 3-node, 2-site PowerHA for GLVM
        1. 8.6.1 Creating a GLVM cluster between two sites
        2. 8.6.2 Testing the cluster
      7. 8.7 Performance with aio_cache
      8. 8.8 Monitoring
        1. 8.8.1 The rpvstat command
        2. 8.8.2 The gmvstat command
        3. 8.8.3 SMIT interfaces for GLVM status monitoring tools
      9. 8.9 Test scenarios
        1. 8.9.1 Graceful site failover
        2. 8.9.2 Total site loss
        3. 8.9.3 XD_data network loss
        4. 8.9.4 Storage loss at one site
      10. 8.10 Performing management operations on the cluster
        1. 8.10.1 Converting synchronous GMVGs to asynchronous GMVGs
        2. 8.10.2 Adding physical volumes to a running cluster
        3. 8.10.3 Removing physical volumes in a running cluster
      11. 8.11 Migration from HAGEO (AIX 5.3) to GLVM (AIX 6.1)
        1. 8.11.1 Overview of an alternative migration
        2. 8.11.2 Adding GLVM to a running HAGEO environment
      12. 8.12 Data divergence in PowerHA for GLVM
        1. 8.12.1 Quorum and forced varyon in geographically mirrored volume group
        2. 8.12.2 Data divergence in asynchronous GMVGs
        3. 8.12.3 Recovering from data divergence for asynchronous GMVGs
        4. 8.12.4 Overriding the default data divergence recovery
  8. Part 4 Maintenance, management, and disaster recovery
    1. Chapter 9. Maintenance and management
      1. 9.1 Maintaining the servers
        1. 9.1.1 AIX maintenance
        2. 9.1.2 PowerHA cluster maintenance
        3. 9.1.3 Displaying the cluster configuration
        4. 9.1.4 Cluster reporting
        5. 9.1.5 PowerHA Enterprise Edition and the cluster test tool
        6. 9.1.6 Reporting a problem
      2. 9.2 Resource group management
        1. 9.2.1 Checking the status of the RGs with the clRGinfo utility
        2. 9.2.2 RG states
        3. 9.2.3 RG site-specific dependencies
        4. 9.2.4 Customizing inter-site RG recovery
      3. 9.3 Partitioned cluster considerations
        1. 9.3.1 Methods to avoid cluster partitioning
        2. 9.3.2 Expected behaviors in a partitioned cluster
        3. 9.3.3 Recommendations for recovery
    2. Chapter 10. Disaster recovery with DS8700 Global Mirror
      1. 10.1 Planning for Global Mirror
        1. 10.1.1 Software prerequisites
        2. 10.1.2 Minimum DS8700 requirements
        3. 10.1.3 Considerations
      2. 10.2 Installing the DSCLI client software
      3. 10.3 Scenario description
      4. 10.4 Configuring the Global Mirror resources
        1. 10.4.1 Checking the prerequisites
        2. 10.4.2 Identifying the source and target volumes
        3. 10.4.3 Configuring the Global Mirror relationships
      5. 10.5 Configuring AIX volume groups
        1. 10.5.1 Configuring volume groups and file systems on primary site
        2. 10.5.2 Importing the volume groups in the remote site
      6. 10.6 Configuring the cluster
        1. 10.6.1 Configuring the cluster topology
        2. 10.6.2 Configuring cluster resources and resource group
      7. 10.7 Failover testing
        1. 10.7.1 Graceful site failover
        2. 10.7.2 Rolling site failure
        3. 10.7.3 Site reintegration
      8. 10.8 LVM administration of DS8000 Global Mirror replicated resources
        1. 10.8.1 Adding a Global Mirror pair to an existing volume group
        2. 10.8.2 Adding a Global Mirror pair into a new volume group
    3. Chapter 11. Disaster recovery by using Hitachi TrueCopy and Universal Replicator
      1. 11.1 Planning for TrueCopy/HUR management
        1. 11.1.1 Software prerequisites
        2. 11.1.2 Minimum connectivity requirements for TrueCopy/HUR
        3. 11.1.3 Considerations
      2. 11.2 Overview of TrueCopy/HUR management
        1. 11.2.1 Installing the Hitachi CCI software
        2. 11.2.2 Overview of the CCI instance
        3. 11.2.3 Creating and editing the horcm.conf files
      3. 11.3 Scenario description
      4. 11.4 Configuring the TrueCopy/HUR resources
        1. 11.4.1 Assigning LUNs to the hosts (host groups)
        2. 11.4.2 Creating replicated pairs
        3. 11.4.3 Configuring an AIX disk and dev_group association
        4. 11.4.4 Defining TrueCopy/HUR managed replicated resource to PowerHA
      5. 11.5 Failover testing
        1. 11.5.1 Graceful site failover for the Austin site
        2. 11.5.2 Rolling site failure of the Austin site
        3. 11.5.3 Site re-integration for the Austin site
        4. 11.5.4 Graceful site failover for the Miami site
        5. 11.5.5 Rolling site failure of the Miami site
        6. 11.5.6 Site reintegration for the Miami site
      6. 11.6 LVM administration of TrueCopy/HUR replicated pairs
        1. 11.6.1 Adding LUN pairs to an existing volume group
        2. 11.6.2 Adding a new logical volume
        3. 11.6.3 Increasing the size of an existing file system
        4. 11.6.4 Adding a LUN pair to a new volume group
  9. Related publications
    1. IBM Redbooks publications
    2. Other publications
    3. Online resources
    4. Help from IBM
  10. Back cover