Data Migration to IBM Disk Storage Systems

Data Migration to IBM Disk Storage Systems

Released February 2012
Publisher(s): IBM Redbooks
ISBN: 9780738436289

Read it now on the O’Reilly learning platform with a 10-day free trial.

O’Reilly members get unlimited access to books, live events, courses curated by job role, and more from O’Reilly and nearly 200 top publishers.

Start your free trial

Book description

Data migration has become a mandatory and regular activity for most data centers. Companies need to migrate data not only when technology needs to be replaced, but also for consolidation, load balancing, and disaster recovery.

This IBM Redbooks® publication addresses the aspects of data migration efforts while focusing on the IBM System Storage® as the target system. Data migration is a critical and complex operation, and this book provides the phases and steps to ensure a smooth migration. Topics range from planning and preparation to execution and validation.

The book also reviews products and describes available IBM data migration services offerings. It explains, from a generic standpoint, the appliance-based, storage-based, and host-based techniques that can be used to accomplish the migration. Each method is explained including the use of the various products and techniques with different migration scenarios and various operating system platforms.

This document targets storage administrators, storage network administrators, system designers, architects, and IT professionals who design, administer or plan data migrations in large data Centers. The aim is to ensure that you are aware of the current thinking, methods, tools, and products that IBM can make available to you. These items are provided to ensure a data migration process that is as efficient and problem-free as possible.

The material presented in this book was developed with versions of the referenced products as of June 2011.

Table of contents

  1. Front cover
  2. Notices
    1. Trademarks
  3. Summary of changes
    1. February 2012, Second Edition
  4. Preface
    1. The team who wrote this book
    2. Now you can become a published author, too!
    3. Comments welcome
    4. Stay connected to IBM Redbooks
  5. Part 1 Data migration
  6. Chapter 1. Introducing disk data migration
    1. 1.1 Data migration and its business reasons
    2. 1.2 Aspects of data migration
    3. 1.3 Addressing data migration issues
  7. Chapter 2. Migration techniques and processes
    1. 2.1 Data migration techniques
      1. 2.1.1 Host-Based migration
      2. 2.1.2 Array-Based migrations
      3. 2.1.3 Appliance-Based migrations
      4. 2.1.4 Migrating using backup and restore
      5. 2.1.5 Data migration in System z environments
      6. 2.1.6 Summary
    2. 2.2 Key decision factors
      1. 2.2.1 Migration performance
      2. 2.2.2 Migration backout scenarios, protecting source and target volumes
      3. 2.2.3 Understand target storage requirements
      4. 2.2.4 Different source and target hardware
      5. 2.2.5 Application downtime
      6. 2.2.6 Key decision factors summary
    3. 2.3 Data migration process
      1. 2.3.1 Planning phase
      2. 2.3.2 Validation phase
    4. 2.4 Preparing DS8000 for data migration
      1. 2.4.1 Available hardware resources
      2. 2.4.2 Understanding array characteristics
  8. Chapter 3. IBM service offerings
    1. 3.1 IBM Global Services offerings
      1. 3.1.1 IBM Migration Services for data for Open Systems
      2. 3.1.2 IBM Migration Services for System z data
      3. 3.1.3 IBM Migration Services for Network Attached Storage Systems
    2. 3.2 IBM Systems and Technology Group Lab Services
      1. 3.2.1 IBM XIV Migration Services
      2. 3.2.2 IBM DS8000 Data Migration Services
      3. 3.2.3 Additional Services & Offerings
  9. Part 2 Migration scenarios
  10. Chapter 4. Data migration using IBM Remote Mirror and Copy
    1. 4.1 IBM System Storage Remote Mirror and Copy overview
      1. 4.1.1 Metro Mirror
      2. 4.1.2 Global Copy
      3. 4.1.3 Target DS8000 configuration considerations
      4. 4.1.4 Automation software: Tivoli Storage Productivity Center for Replication
    2. 4.2 DS8000 user interface for Copy Services
      1. 4.2.1 IBM System Storage DS8000 Storage Manager
      2. 4.2.2 IBM System Storage DS8000 command-line interface
      3. 4.2.3 System z interfaces
    3. 4.3 Data migration from Enterprise Storage Server Model 800 to DS8000
      1. 4.3.1 Adding Enterprise Storage Server Copy Services Domain to the DS8000 Storage Complex
      2. 4.3.2 Creating Remote Mirror and Copy paths
      3. 4.3.3 Creating Remote Mirror and Copy pairs
      4. 4.3.4 Completing the data migration
    4. 4.4 Data migration from DS8000 to DS8000
      1. 4.4.1 Configuring the remote DS8000
      2. 4.4.2 Creating Remote Mirror and Copy paths
      3. 4.4.3 Creating Remote Mirror and Copy pairs
      4. 4.4.4 Completing the data migration from DS8000 to DS8000
    5. 4.5 Post-migration tasks
      1. 4.5.1 AIX post-migration tasks
      2. 4.5.2 Solaris and VxVM post-migration tasks
      3. 4.5.3 System z post-migration tasks
  11. Chapter 5. DSCLIbroker
    1. 5.1 Overview
      1. 5.1.1 DSCLIbroker concepts
      2. 5.1.2 DSCLIbroker scripts
      3. 5.1.3 User customized scripts
      4. 5.1.4 Additional useful scripts
    2. 5.2 System environment
      1. 5.2.1 Architecture
      2. 5.2.2 Communication
      3. 5.2.3 Users
      4. 5.2.4 DSCLIbroker maintenance
      5. 5.2.5 Licenses
    3. 5.3 Programming techniques
      1. 5.3.1 Using DSCLIbroker scripts
      2. 5.3.2 Using DSCLIbroker libraries
    4. 5.4 Automation techniques
      1. 5.4.1 Subjects for writing automation scripts
      2. 5.4.2 Generating DSCLI scripts
      3. 5.4.3 Using control files
    5. 5.5 Considerations about configuration data
      1. 5.5.1 Data sources
      2. 5.5.2 Importing data to the repository
    6. 5.6 Example migration using DSCLIbroker
      1. 5.6.1 Overview
      2. 5.6.2 Analysis
      3. 5.6.3 Test and develop
      4. 5.6.4 Planning
      5. 5.6.5 Running
      6. 5.6.6 Validating
  12. Chapter 6. IBM XIV data migration
    1. 6.1 Overview
    2. 6.2 Handling I/O requests
      1. 6.2.1 Methods of handling write requests
      2. 6.2.2 Multi-pathing with data migrations
    3. 6.3 Data migration steps
      1. 6.3.1 Initial connection setup
      2. 6.3.2 Creating a data migration volume on XIV
      3. 6.3.3 Activate a data migration on XIV
      4. 6.3.4 Defining the host on XIV and bringing the host online
      5. 6.3.5 Completing the data migration on XIV
    4. 6.4 Command-line interface
      1. 6.4.1 Using XCLI scripts or batch files
      2. 6.4.2 Sample scripts
    5. 6.5 Manually creating the migration volume
    6. 6.6 Changing and monitoring the progress of a migration
      1. 6.6.1 Changing the synchronization rate
      2. 6.6.2 Monitoring migration speed
      3. 6.6.3 Monitoring migration using the XIV event log
      4. 6.6.4 Monitoring migration speed through the fabric
      5. 6.6.5 Monitoring migration speed through the non-XIV storage
    7. 6.7 Thick-to-thin migration
      1. 6.7.1 Writing zeros to recover space
      2. 6.7.2 Recovering space after the migration
    8. 6.8 Resizing the XIV volume after migration
    9. 6.9 Troubleshooting
      1. 6.9.1 Target connectivity fails
      2. 6.9.2 Remote volume LUN is unavailable
      3. 6.9.3 Local volume is not formatted
      4. 6.9.4 Host server cannot access the XIV migration volume
      5. 6.9.5 Remote volume cannot be read
      6. 6.9.6 LUN is out of range
    10. 6.10 Backing out of a data migration
      1. 6.10.1 Back out before migration is defined on the XIV
      2. 6.10.2 Back out after a data migration is defined but not activated
      3. 6.10.3 Back out after a data migration is activated but is not complete
      4. 6.10.4 Back out after a data migration reaches the synchronized state
    11. 6.11 Migration checklist
    12. 6.12 Other considerations
  13. Chapter 7. SAN Volume Controller-based migration
    1. 7.1 IBM System Storage SAN Volume Controller overview
      1. 7.1.1 SAN Volume Controller components, concepts, and terminology
      2. 7.1.2 SAN Volume Controller copy services
      3. 7.1.3 Metro Mirror
      4. 7.1.4 Global Mirror
    2. 7.2 SAN Volume Controller concepts for migrating the data
      1. 7.2.1 Data migration using SAN Volume Controller volume migration
      2. 7.2.2 Data migration using SAN Volume Controller FlashCopy
      3. 7.2.3 Data migration using SAN Volume Controller Metro Mirror
      4. 7.2.4 Data migration using mirrored volumes
    3. 7.3 Migrating using SAN Volume Controller
      1. 7.3.1 Migrating extents
      2. 7.3.2 Migrating extents off an MDisk that is being deleted
      3. 7.3.3 Migrating a volume between storage pools
      4. 7.3.4 Using volume mirroring
      5. 7.3.5 Image mode volume migration
      6. 7.3.6 Migrating the volume to image mode
      7. 7.3.7 Migrating a volume between I/O groups
      8. 7.3.8 Monitoring the migration progress
      9. 7.3.9 Parallelism
      10. 7.3.10 Error handling
      11. 7.3.11 Migration tips
    4. 7.4 SAN Volume Controller Migration preparation prerequisites
      1. 7.4.1 Fabric zoning
      2. 7.4.2 Connect SAN Volume Controller to the fabric for migration
      3. 7.4.3 Remove SAN Volume Controller from the fabric after migration
      4. 7.4.4 Back-End storage consideration
      5. 7.4.5 Unsupported storage systems
      6. 7.4.6 Host attachment
    5. 7.5 Migrating SAN disks to SAN Volume Controller volumes and back to SAN
      1. 7.5.1 Connecting the SAN Volume Controller to your SAN fabric
      2. 7.5.2 Preparing your SAN Volume Controller to virtualize disks
      3. 7.5.3 Moving the LUNs to the SAN Volume Controller
      4. 7.5.4 Migrating image mode volumes to volumes
      5. 7.5.5 Performance analysis
      6. 7.5.6 Preparing to migrate from the SAN Volume Controller
      7. 7.5.7 Creating new LUNs
      8. 7.5.8 Migrating the managed volumes
      9. 7.5.9 Removing the LUNs from the SAN Volume Controller
    6. 7.6 SAN Volume Controller Volume migration between two storage pools
      1. 7.6.1 Environment description
      2. 7.6.2 Performance measurement
      3. 7.6.3 Migration steps
      4. 7.6.4 Performance Analyses
    7. 7.7 Data migration using SAN Volume Controller mirrored volumes
      1. 7.7.1 Environment description
      2. 7.7.2 Creating mirrored volumes using the SAN Volume Controller GUI
      3. 7.7.3 Creating mirrored volumes using CLI
      4. 7.7.4 Performance analysis
    8. 7.8 Data migration using SAN Volume Controller Metro Mirror
      1. 7.8.1 SAN Volume Controller Metro Mirror partnership
      2. 7.8.2 SAN Volume Controller Metro Mirror relationships
      3. 7.8.3 Starting and monitoring SAN Volume Controller Metro Mirror Copy
      4. 7.8.4 Stopping SAN Volume Controller Metro Mirror Copy
      5. 7.8.5 Performance overview
    9. 7.9 SAN Volume Controller as data migration engine
    10. 7.10 Other resources
  14. Chapter 8. Using mirroring techniques
    1. 8.1 Concepts of the LVM
    2. 8.2 Preparation and planning
    3. 8.3 Migrating data using Windows Logical Disk Manager
      1. 8.3.1 Sample Windows LDM migration test environment
      2. 8.3.2 High-level plan for migration using Windows LDM mirroring
      3. 8.3.3 Detailed steps for migration using Windows LDM mirroring
    4. 8.4 Data migration using Solaris Volume Manager
      1. 8.4.1 Test environment
      2. 8.4.2 Solaris Volume Manager mirroring process
      3. 8.4.3 High-level plan for migration using SVM mirroring
      4. 8.4.4 Detailed steps for migration using SVM mirroring
    5. 8.5 Data migration using Veritas Storage Foundation
      1. 8.5.1 Test environment
      2. 8.5.2 Veritas Volume Manager mirroring
      3. 8.5.3 High-level plan for migration using VxVM mirroring
      4. 8.5.4 Detailed steps for migration using VxVM mirroring
    6. 8.6 Data migration using HP-UX Volume Manager mirroring
      1. 8.6.1 High-level plan for migration using HP_UX Volume Manager mirroring
      2. 8.6.2 Detailed steps for migration using HP-UX Volume Manager mirroring
    7. 8.7 Data migration using AIX LVM mirroring
      1. 8.7.1 ESS to DS8000 migration under AIX LVM test environment
      2. 8.7.2 High-level migration plan using the AIX LVM migratepv -l
      3. 8.7.3 Detailed steps using migratepv -l
      4. 8.7.4 High-level migration plan using AIX LVM mklvcopy and syncvg commands
      5. 8.7.5 Detailed migration steps using mklvcopy and syncvg
    8. 8.8 Data migration in a PowerHA clustered environment using AIX LVM mirroring
      1. 8.8.1 PowerHA test environment
      2. 8.8.2 High-level migration plan using PowerHA C-SPOC LVM mirroring
      3. 8.8.3 Detailed migration steps using PowerHA C-SPOC LVM mirroring
      4. 8.8.4 Migration Backout Considerations
    9. 8.9 Data migration using Linux LVM2 mirroring
      1. 8.9.1 Introduction to Linux LVM2
      2. 8.9.2 Multipathing considerations
      3. 8.9.3 Linux LVM migration scenario
    10. 8.10 Data migration using network block devices
      1. 8.10.1 General architecture
      2. 8.10.2 Using shell commands
      3. 8.10.3 Using software RAID1
      4. 8.10.4 Summary
      5. 8.10.5 Using Linux LVM2 mirroring
  15. Chapter 9. Using TDMF for z/OS
    1. 9.1 TDMF for z/OS overview
      1. 9.1.1 Data migration and migration tool definitions and characteristics
      2. 9.1.2 Terminology
      3. 9.1.3 TDMF z/OS components architecture
      4. 9.1.4 TDMF z/OS process flow
      5. 9.1.5 TDMF z/OS hardware compatibility
      6. 9.1.6 Installing TDMF z/OS
      7. 9.1.7 TDMF z/OS customer requirements
    2. 9.2 Customer scenarios
      1. 9.2.1 Test environment
      2. 9.2.2 Migration steps
    3. 9.3 TDMF preferred practices
      1. 9.3.1 Keeping current
      2. 9.3.2 Setting default options
      3. 9.3.3 Storage requirements
      4. 9.3.4 Communications data set
      5. 9.3.5 Participation of agent systems
      6. 9.3.6 Protection of target volume data
      7. 9.3.7 Pacing
      8. 9.3.8 Rank contention and storage subsystem performance
      9. 9.3.9 TDMF interaction with other programs
      10. 9.3.10 Identification of volumes requiring special handling
      11. 9.3.11 Migration considerations
      12. 9.3.12 Estimating how long it takes to move the data
      13. 9.3.13 Terminating a TDMF session
  16. Chapter 10. z/OS Dataset Mobility Facility
    1. 10.1 z/OS Dataset Mobility Facility overview
    2. 10.2 zDMF migration process
      1. 10.2.1 zDMF migration steps
      2. 10.2.2 Planning the migration
      3. 10.2.3 Pre migration tasks
      4. 10.2.4 Migration phase using DFSMS, HSM and utilities, or both
      5. 10.2.5 zDMF migration phase
      6. 10.2.6 Typical migration process scenario
      7. 10.2.7 Migration performance and scalability
      8. 10.2.8 Post-migration
    3. 10.3 Important zDMF-related topics
      1. 10.3.1 Understanding the catalog structure
      2. 10.3.2 BCS record types
      3. 10.3.3 Catalog diagnostic recommendations
      4. 10.3.4 Using Global Resource Serialization (GRS)
      5. 10.3.5 Ring complex
      6. 10.3.6 Star complex
      7. 10.3.7 Reserve handling requirements
    4. 10.4 Example migration in a shared DB2 test environment
      1. 10.4.1 Test Environment Overview
      2. 10.4.2 Preparing DSN List for Test Migration
      3. 10.4.3 Creating BATCH JCL
      4. 10.4.4 Checking Data and Starting DB2 Load
      5. 10.4.5 Starting and Monitoring Test Migration
      6. 10.4.6 Diverting the Group
      7. 10.4.7 Starting post migration cleanup procedure
  17. Chapter 11. Using TDMF TCP/IP for z/OS
    1. 11.1 TDMF TCP/IP for z/OS overview
      1. 11.1.1 Long-distance data migration software solution
      2. 11.1.2 Long-distance data migration characteristics
      3. 11.1.3 Terminology
      4. 11.1.4 TDMF z/OS components architecture
      5. 11.1.5 TDMF z/OS hardware compatibility
      6. 11.1.6 Install TDMF TCP/IP z/OS
      7. 11.1.7 TDMF z/OS customer requirements
    2. 11.2 TDMF general guidelines
      1. 11.2.1 Keeping current
      2. 11.2.2 Creating a consistent data structure
      3. 11.2.3 Summary of replication tasks and steps
      4. 11.2.4 Link performance information
    3. 11.3 TDMF TCP/IP example replication
      1. 11.3.1 Overview of replication
      2. 11.3.2 Naming conventions
      3. 11.3.3 TDMF TCP/IP examples for a network test
      4. 11.3.4 TDMF TCP/IP performance example
      5. 11.3.5 TCP/IP information
  18. Appendix A. Network block devices for Linux
    1. Network block devices
    2. Summary
  19. Appendix B. CLI Conversion
    1. Migrating ESS Copy Services tasks to DS8000 CLI
    2. Copy Services commands
  20. Related publications
    1. IBM Redbooks
    2. Other publications
    3. Online resources
    4. Help from IBM
  21. Back cover

Product information

  • Title: Data Migration to IBM Disk Storage Systems
  • Author(s):
  • Release date: February 2012
  • Publisher(s): IBM Redbooks
  • ISBN: 9780738436289