You are previewing IBM Spectrum Archive Enterprise Edition V1.2.1: Installation and Configuration Guide.
O'Reilly logo
IBM Spectrum Archive Enterprise Edition V1.2.1: Installation and Configuration Guide

Book Description

This IBM® Redbooks® publication helps you with the planning, installation, and configuration of the new IBM Spectrum™ Archive (formerly IBM Linear Tape File System™ (LTFS)) Enterprise Edition (EE) V1.2.1.0 for the IBM TS3310, IBM TS3500, and IBM TS4500 tape libraries. IBM Spectrum Archive™ EE enables the use of the LTFS for the policy management of tape as a storage tier in a IBM Spectrum Scale™ (formerly IBM General Parallel File System (IBM GPFS™)) based environment and helps encourage the use of tape as a critical tier in the storage environment. This is the second edition of IBM Spectrum Archive V1.2 (SG24-8333-00) although it is based on the prior editions of IBM Linear Tape File System Enterprise Edition V1.1.1.2: Installation and Configuration Guide, SG24-8143.

IBM Spectrum Archive EE can run any application that is designed for disk files on a physical tape media. IBM Spectrum Archive EE supports the IBM Linear Tape-Open (LTO) Ultrium 7, 6, and 5 tape drives in IBM TS3310, TS3500, and TS4500 tape libraries. Also, IBM TS1140 and IBM TS1150 tape drives are supported in TS3500 and TS4500 tape library configurations.

IBM Spectrum Archive EE can play a major role in reducing the cost of storage for data that does not need the access performance of primary disk. The use of IBM Spectrum Archive EE to replace disks with physical tape in Tier 2 and Tier 3 storage can improve data access over other storage solutions because it improves efficiency and streamlines management for files on tape. IBM Spectrum Archive EE simplifies the use of tape by making it transparent to the user and manageable by the administrator under a single infrastructure.

This publication is intended for anyone who wants to understand more about IBM Spectrum Archive EE planning and implementation. This book is suitable for IBM clients, IBM Business Partners, IBM specialist sales representatives, and technical specialists.

Table of Contents

  1. Front cover
  2. Notices
    1. Trademarks
  3. IBM Redbooks promotions
  4. Preface
    1. Authors
    2. Now you can become a published author, too!
    3. Comments welcome
    4. Stay connected to IBM Redbooks
  5. Summary of changes
    1. August 2016, Second Edition Version 1.2.1
    2. June 2016, Second Edition, Version 1.2
    3. January 2015, Third Edition Version 1.1.1.2
    4. November 2014, Second Edition Version 1.1.1.1
  6. Chapter 1. IBM Spectrum Archive Enterprise Edition
    1. 1.1 Introduction
      1. 1.1.1 Operational storage
      2. 1.1.2 Active archive
    2. 1.2 IBM Spectrum Archive EE functions
    3. 1.3 IBM Spectrum Archive EE components
    4. 1.4 IBM Spectrum Archive EE cluster configuration introduction
    5. 1.5 The Linear Tape File System tape format
      1. 1.5.1 LTFS tape format compatibility
    6. 1.6 Data access by using the LTFS index
  7. Chapter 2. IBM Spectrum Archive overview
    1. 2.1 Introduction to IBM Spectrum Archive and LTFS
      1. 2.1.1 Tape partitions
      2. 2.1.2 Index
      3. 2.1.3 Filesystem in Userspace
      4. 2.1.4 XML schema
    2. 2.2 Comparison of the IBM Spectrum Archive products
      1. 2.2.1 IBM Spectrum Archive Single Drive Edition
      2. 2.2.2 IBM Spectrum Archive Library Edition
      3. 2.2.3 LTFS Storage Manager
      4. 2.2.4 IBM Spectrum Archive EE
    3. 2.3 IBM Spectrum Scale
      1. 2.3.1 Overview
      2. 2.3.2 Storage pools
      3. 2.3.3 Policies and policy rules
      4. 2.3.4 Migration or premigration
      5. 2.3.5 IBM Spectrum Scale new features and enhancements
    4. 2.4 Types of archiving
  8. Chapter 3. Planning
    1. 3.1 System requirements
    2. 3.2 Required software
      1. 3.2.1 Required software for Red Hat Enterprise Linux systems
    3. 3.3 Hardware and software setup
    4. 3.4 Sizing and settings
      1. 3.4.1 IBM Spectrum Scale block size
      2. 3.4.2 IBM Spectrum Archive EE metadata file system
      3. 3.4.3 Redundant copies
  9. Chapter 4. Installation
    1. 4.1 Installing IBM Spectrum Archive EE on a Linux system
    2. 4.2 Installation prerequisites for IBM Spectrum Archive EE
      1. 4.2.1 Installing the host bus adapter and device driver
      2. 4.2.2 IBM Spectrum Archive EE distribution of packages for Linux
      3. 4.2.3 Installing the IBM tape device driver
    3. 4.3 Installing IBM Spectrum Archive EE
      1. 4.3.1 Extracting binary rpm files from an installation package
      2. 4.3.2 Installing, upgrading, or uninstalling IBM Spectrum Archive EE
    4. 4.4 Upgrading the IBM tape library or tape drive firmware
      1. 4.4.1 Downloading operator guides for IBM tape libraries and drives
      2. 4.4.2 Upgrading the TS3500 tape library firmware
      3. 4.4.3 Upgrading IBM tape drive firmware
    5. 4.5 Creating a logical library and defining tape drives
      1. 4.5.1 Creating a logical library for IBM Spectrum Archive EE
      2. 4.5.2 Assigning tape drives to the IBM Spectrum Archive EE logical library
      3. 4.5.3 Assigning the control path tape devices
      4. 4.5.4 Assigning tape media for IBM Spectrum Archive EE within the logical library
    6. 4.6 Quick installation guide for IBM Spectrum Archive EE
  10. Chapter 5. Upgrading from version 1.1.x
    1. 5.1 Overview of the IBM Spectrum Archive EE upgrade from version 1.1.x
    2. 5.2 The ltfsee_config_save command
    3. 5.3 ltfsee_config_upgrade command
    4. 5.4 Upgrading from IBM Spectrum Archive Enterprise Edition version 1.1.x
      1. 5.4.1 Prerequisite tasks for the upgrade
      2. 5.4.2 Upgrading your operating system
      3. 5.4.3 Upgrading IBM Spectrum Archive Enterprise Edition
      4. 5.4.4 Post-upgrade tasks
    5. 5.5 Upgrade processing output examples
      1. 5.5.1 Example output from ltfsee_config_save
      2. 5.5.2 Example of creating and moving the upgrade_offline.lst in the home directory to <metadata_filesystem_name>/.ltfsee/upgrade
      3. 5.5.3 Example output from ltfsee_config_upgrade
  11. Chapter 6. Configuration
    1. 6.1 Configuration prerequisites
      1. 6.1.1 Configuration worksheet tables
      2. 6.1.2 Obtaining configuration information
      3. 6.1.3 Configuring key-based login with OpenSSH
      4. 6.1.4 Preparing the GPFS file system for IBM Spectrum Archive EE
      5. 6.1.5 Enabling control paths in the logical library
    2. 6.2 Configuring IBM Spectrum Archive EE
      1. 6.2.1 The ltfsee_config utility
      2. 6.2.2 Configuring a single node cluster
      3. 6.2.3 Configuring a multiple-node cluster
      4. 6.2.4 Configuring a multiple-node cluster with two tape libraries
    3. 6.3 First-time start of IBM Spectrum Archive EE
  12. Chapter 7. Overview of IBM Spectrum Archive Enterprise Edition commands
    1. 7.1 IBM Spectrum Archive EE command summaries
  13. Chapter 8. Operations
    1. 8.1 Overview
      1. 8.1.1 Using the command-line interface
    2. 8.2 Status information
      1. 8.2.1 IBM Spectrum Scale (GPFS)
      2. 8.2.2 LTFS Library Edition Plus component
      3. 8.2.3 Hierarchical Space Management
      4. 8.2.4 IBM Spectrum Archive EE
    3. 8.3 Upgrading components
      1. 8.3.1 IBM Spectrum Scale
      2. 8.3.2 LTFS LE+ component
      3. 8.3.3 Hierarchical Space Management
      4. 8.3.4 IBM Spectrum Archive EE
    4. 8.4 Starting and stopping IBM Spectrum Archive EE
      1. 8.4.1 Starting IBM Spectrum Archive EE
      2. 8.4.2 Stopping IBM Spectrum Archive EE
    5. 8.5 Tape library management
      1. 8.5.1 Adding tape cartridges
      2. 8.5.2 Moving tape cartridges
      3. 8.5.3 Formatting tape cartridges
      4. 8.5.4 Removing tape drives
      5. 8.5.5 Adding tape drives
    6. 8.6 Tape storage pool management
      1. 8.6.1 Creating tape cartridge pools
      2. 8.6.2 Deleting tape cartridge pools
    7. 8.7 Migration
      1. 8.7.1 Managing file migration pools
      2. 8.7.2 Automated migration
      3. 8.7.3 Manual migration
      4. 8.7.4 Replicas and redundant copies
      5. 8.7.5 Migration hints and tips
    8. 8.8 Premigration
      1. 8.8.1 Premigration with the ltfsee premigrate command
      2. 8.8.2 Premigration running the mmapplypolicy command
    9. 8.9 Preserving file system objects on tape
      1. 8.9.1 Saving file system objects with the ltfsee save command
      2. 8.9.2 Saving file system objects with policies
    10. 8.10 Restoring non-empty regular files and file system objects from tape
    11. 8.11 Recall
      1. 8.11.1 Transparent recall
      2. 8.11.2 Selective recall
      3. 8.11.3 Recalling files with the ltfsee recall command
      4. 8.11.4 The ltfsee recall_deadline command
      5. 8.11.5 Read Starts Recalls: Early trigger for recalling a migrated file
    12. 8.12 Repairing files to their resident state
    13. 8.13 Recovering data from a write-failure tape
    14. 8.14 Reconciliation
    15. 8.15 Reclamation
    16. 8.16 Checking and repairing
    17. 8.17 Importing and exporting
      1. 8.17.1 Importing
      2. 8.17.2 Exporting
      3. 8.17.3 Import/Export enhancements
    18. 8.18 Drive Role settings for job assignment control
    19. 8.19 Tape drive intermix support
    20. 8.20 Write Once Read Many support for IBM TS1140/TS1150 tape drives
    21. 8.21 Obtaining the location of files and data
    22. 8.22 Obtaining inventory, job, and scan status
    23. 8.23 Cleaning up a scan or session
    24. 8.24 Monitoring the system with SNMP
      1. 8.24.1 Configuring Net-SNMP
      2. 8.24.2 Starting and stopping the snmpd daemon
      3. 8.24.3 Example of an SNMP traps
  14. Chapter 9. Hints, tips, and preferred practices
    1. 9.1 Preventing migration of the .SPACEMAN and metadata directories
    2. 9.2 Maximizing migration performance with redundant copies
    3. 9.3 Changing the SSH daemon settings
    4. 9.4 Setting job limits to increase performance with large numbers of jobs
    5. 9.5 Setting mmapplypolicy options for increased performance
    6. 9.6 Setting the inode size for the GPFS file system for increased performance
    7. 9.7 Determining the file states for all files within the GPFS file system
    8. 9.8 Increasing the default maximum number of inodes in IBM Spectrum Scale
    9. 9.9 Capturing a core file on RHEL with abrtd
    10. 9.10 Antivirus considerations
    11. 9.11 Automatic email notification with rsyslog
    12. 9.12 Overlapping IBM Spectrum Scale policy rules
    13. 9.13 Storage pool assignment
    14. 9.14 Tape cartridge removal
      1. 9.14.1 Reclaiming tape cartridges before you remove or export them
      2. 9.14.2 Exporting tape cartridges before physically removing them from the library
    15. 9.15 Reusing LTFS formatted tape cartridges
      1. 9.15.1 Reformatting LTFS tape cartridges through ltfsee commands
    16. 9.16 Reusing non-LTFS tape cartridges
    17. 9.17 Moving tape cartridges between pools
      1. 9.17.1 Avoiding changing assignments for tape cartridges that contain files
      2. 9.17.2 Reclaiming a tape cartridge and changing its assignment
    18. 9.18 Offline tape cartridges
      1. 9.18.1 Do not modify the files of offline tape cartridges
      2. 9.18.2 Solving problems
    19. 9.19 Scheduling reconciliation and reclamation
    20. 9.20 License Expiration Handling
    21. 9.21 Reassigning physical tape cartridges to another logical tape library
    22. 9.22 Disaster recovery
      1. 9.22.1 Tiers of disaster recovery
      2. 9.22.2 Preparing IBM Spectrum Archive EE for a Tier 1 disaster recovery strategy (offsite vaulting)
      3. 9.22.3 IBM Spectrum Archive EE Tier 1 DR procedure
    23. 9.23 IBM Spectrum Archive EE problem determination
    24. 9.24 Collecting IBM Spectrum Archive EE logs for support
    25. 9.25 Backing up file systems that are not managed by IBM Spectrum Archive EE
      1. 9.25.1 Considerations
      2. 9.25.2 Backing up a GPFS or IBM Spectrum Scale environment
      3. 9.25.3 Backing up non IBM Spectrum Scale file systems
      4. 9.25.4 IBM TS4500 Automated Media Verification with IBM Spectrum Archive EE
  15. Chapter 10. Use cases
    1. 10.1 Use cases overview
      1. 10.1.1 Use case for archiving
      2. 10.1.2 Use case for backup
      3. 10.1.3 Use case for tiered and scalable storage
      4. 10.1.4 Use case data exchange
    2. 10.2 University of Basel and Swiss Institute of Bioinformatics (SIB)
      1. 10.2.1 Business needs
  16. Chapter 11. Troubleshooting
    1. 11.1 Overview
      1. 11.1.1 Quick health check
    2. 11.2 Hardware
      1. 11.2.1 Tape library
      2. 11.2.2 Tape drives
      3. 11.2.3 Tape cartridge
    3. 11.3 Software
      1. 11.3.1 Linux
      2. 11.3.2 SNMP
      3. 11.3.3 IBM Spectrum Scale
      4. 11.3.4 IBM Spectrum Archive LE+ component
      5. 11.3.5 Hierarchical storage management
      6. 11.3.6 IBM Spectrum Archive EE logs
    4. 11.4 Recovering from system failures
      1. 11.4.1 Power failure
      2. 11.4.2 Mechanical failure
      3. 11.4.3 Inventory failure
      4. 11.4.4 Abnormal termination
  17. Chapter 12. Reference
    1. 12.1 Command-line reference
      1. 12.1.1 IBM Spectrum Archive EE commands
      2. 12.1.2 IBM Spectrum Scale commands
      3. 12.1.3 Tivoli Storage Manager for Space Management commands
    2. 12.2 Formats for IBM Spectrum Scale to IBM Spectrum Archive EE migration
    3. 12.3 System calls and IBM tools
      1. 12.3.1 Downloading the IBM Tape Diagnostic Tool
      2. 12.3.2 Using the IBM LTFS Format Verifier
    4. 12.4 IBM Spectrum Archive EE interoperability with IBM Spectrum Archive products
  18. Related publications
    1. IBM Redbooks
    2. Other publications
    3. Online resources
    4. Help from IBM
  19. Back cover