IBM Spectrum Archive Enterprise Edition V1.2.2: Installation and Configuration Guide

IBM Spectrum Archive Enterprise Edition V1.2.2: Installation and Configuration Guide

by Larry Coyne, Khanh Ngo, Illarion Borisevich, Wei Zheng Ong, Stefan Neff
Released January 2017
Publisher(s): IBM Redbooks
ISBN: 9780738442365

Read it now on the O’Reilly learning platform with a 10-day free trial.

O’Reilly members get unlimited access to books, live events, courses curated by job role, and more from O’Reilly and nearly 200 top publishers.

Start your free trial

Book description

This IBM® Redbooks® publication helps you with the planning, installation, and configuration of the new IBM Spectrum™ Archive (formerly IBM Linear Tape File System™ (LTFS)) Enterprise Edition (EE) V1.2.2.0 for the IBM TS3310, IBM TS3500, and IBM TS4500 tape libraries. IBM Spectrum Archive™ EE enables the use of the LTFS for the policy management of tape as a storage tier in an IBM Spectrum Scale™ (formerly IBM General Parallel File System (GPFS™)) based environment and helps encourage the use of tape as a critical tier in the storage environment. This is the third edition of IBM Spectrum Archive V1.2 (SG24-8333-00) although it is based on the prior editions of IBM Linear Tape File System Enterprise Edition V1.1.1.2: Installation and Configuration Guide, SG24-8143.

IBM Spectrum Archive EE can run any application that is designed for disk files on a physical tape media. IBM Spectrum Archive EE supports the IBM Linear Tape-Open (LTO) Ultrium 7, 6, and 5 tape drives in IBM TS3310, TS3500, and TS4500 tape libraries. Also, IBM TS1140 and IBM TS1150 tape drives are supported in TS3500 and TS4500 tape library configurations.

IBM Spectrum Archive EE can play a major role in reducing the cost of storage for data that does not need the access performance of primary disk. The use of IBM Spectrum Archive EE to replace disks with physical tape in tier 2 and tier 3 storage can improve data access over other storage solutions because it improves efficiency and streamlines management for files on tape. IBM Spectrum Archive EE simplifies the use of tape by making it transparent to the user and manageable by the administrator under a single infrastructure.

This publication is intended for anyone who wants to understand more about IBM Spectrum Archive EE planning and implementation. This book is suitable for IBM clients, IBM Business Partners, IBM specialist sales representatives, and technical specialists.

Table of contents

  1. Front cover
  2. Notices
    1. Trademarks
  3. Preface
    1. Authors
    2. Now you can become a published author, too!
    3. Comments welcome
    4. Stay connected to IBM Redbooks
  4. Summary of changes
    1. January 2017, Third Edition Version 1.2.2
    2. August 2016, Second Edition Version 1.2.1
    3. June 2016, First Edition, Version 1.2
    4. January 2015, Third Edition Version 1.1.1.2
    5. November 2014, Second Edition Version 1.1.1.1
  5. Chapter 1. IBM Spectrum Archive Enterprise Edition
    1. 1.1 Introduction
      1. 1.1.1 Operational storage
      2. 1.1.2 Active archive
    2. 1.2 IBM Spectrum Archive EE functions
    3. 1.3 IBM Spectrum Archive EE components
    4. 1.4 IBM Spectrum Archive EE cluster configuration introduction
    5. 1.5 The Linear Tape File System tape format
      1. 1.5.1 LTFS tape format compatibility
    6. 1.6 Data access by using the LTFS index
  6. Chapter 2. IBM Spectrum Archive overview
    1. 2.1 Introduction to IBM Spectrum Archive and LTFS
      1. 2.1.1 Tape partitions
      2. 2.1.2 Index
      3. 2.1.3 Tape media capacity with IBM Spectrum Archive
      4. 2.1.4 Filesystem in Userspace
      5. 2.1.5 XML schema
    2. 2.2 Comparison of the IBM Spectrum Archive products
      1. 2.2.1 IBM Spectrum Archive Single Drive Edition
      2. 2.2.2 IBM Spectrum Archive Library Edition
      3. 2.2.3 IBM Spectrum Archive EE
    3. 2.3 IBM Spectrum Scale
      1. 2.3.1 Overview
      2. 2.3.2 Storage pools
      3. 2.3.3 Policies and policy rules
      4. 2.3.4 Migration or premigration
    4. 2.4 Types of archiving
  7. Chapter 3. Planning
    1. 3.1 System requirements
    2. 3.2 Required software
    3. 3.3 Hardware and software setup
    4. 3.4 Sizing and settings
      1. 3.4.1 IBM Spectrum Scale block size
      2. 3.4.2 IBM Spectrum Archive EE metadata file system
      3. 3.4.3 Redundant copies
      4. 3.4.4 Performance
  8. Chapter 4. Installation
    1. 4.1 Installing IBM Spectrum Archive EE on a Linux system
    2. 4.2 Installation prerequisites for IBM Spectrum Archive EE
      1. 4.2.1 Installing the host bus adapter and device driver
      2. 4.2.2 IBM Spectrum Archive EE distribution of packages for Linux
      3. 4.2.3 Installing the IBM tape device driver
    3. 4.3 Installing IBM Spectrum Archive EE
      1. 4.3.1 Extracting binary rpm files from an installation package
      2. 4.3.2 Installing, upgrading, or uninstalling IBM Spectrum Archive EE
    4. 4.4 Upgrading the IBM tape library or tape drive firmware
      1. 4.4.1 Downloading operator guides for IBM tape libraries and drives
      2. 4.4.2 Upgrading the TS3500 tape library firmware
      3. 4.4.3 Upgrading IBM tape drive firmware
    5. 4.5 Creating a logical library and defining tape drives
      1. 4.5.1 Creating a logical library for IBM Spectrum Archive EE
      2. 4.5.2 Assigning tape drives to the IBM Spectrum Archive EE logical library
      3. 4.5.3 Assigning the control path tape devices
      4. 4.5.4 Assigning tape media for IBM Spectrum Archive EE within the logical library
    6. 4.6 Quick installation guide for IBM Spectrum Archive EE
  9. Chapter 5. Upgrading from version 1.1.x
    1. 5.1 Overview of the IBM Spectrum Archive EE upgrade from version 1.1.x
    2. 5.2 The ltfsee_config_save command
    3. 5.3 ltfsee_config_upgrade command
    4. 5.4 Upgrading from IBM Spectrum Archive Enterprise Edition version 1.1.x
      1. 5.4.1 Prerequisite tasks for the upgrade
      2. 5.4.2 Upgrading your operating system
      3. 5.4.3 Upgrading IBM Spectrum Archive Enterprise Edition
      4. 5.4.4 Post-upgrade tasks
    5. 5.5 Upgrade processing output examples
      1. 5.5.1 Example output from ltfsee_config_save
      2. 5.5.2 Example of creating and moving the upgrade_offline.lst in the home directory to <metadata_filesystem_name>/.ltfsee/upgrade
      3. 5.5.3 Example output from ltfsee_config_upgrade
  10. Chapter 6. Configuration
    1. 6.1 Configuration prerequisites
      1. 6.1.1 Configuration worksheet tables
      2. 6.1.2 Obtaining configuration information
      3. 6.1.3 Configuring key-based login with OpenSSH
      4. 6.1.4 Preparing the Spectrum Scale file system for Spectrum Archive EE
      5. 6.1.5 Enabling control paths in the logical library
    2. 6.2 Configuring IBM Spectrum Archive EE
      1. 6.2.1 The ltfsee_config utility
      2. 6.2.2 Configuring a single node cluster
      3. 6.2.3 Configuring a multiple-node cluster
      4. 6.2.4 Configuring a multiple-node cluster with two tape libraries
    3. 6.3 First-time start of IBM Spectrum Archive EE
  11. Chapter 7. Operations
    1. 7.1 Overview
      1. 7.1.1 IBM Spectrum Archive EE command summaries
      2. 7.1.2 Using the command-line interface
    2. 7.2 Status information
      1. 7.2.1 IBM Spectrum Scale
      2. 7.2.2 LTFS Library Edition Plus component
      3. 7.2.3 Hierarchical Space Management
      4. 7.2.4 IBM Spectrum Archive EE
    3. 7.3 Upgrading components
      1. 7.3.1 IBM Spectrum Scale
      2. 7.3.2 LTFS LE+ component
      3. 7.3.3 Hierarchical Space Management
      4. 7.3.4 IBM Spectrum Archive EE
    4. 7.4 Starting and stopping IBM Spectrum Archive EE
      1. 7.4.1 Starting IBM Spectrum Archive EE
      2. 7.4.2 Stopping IBM Spectrum Archive EE
    5. 7.5 Tape library management
      1. 7.5.1 Adding tape cartridges
      2. 7.5.2 Moving tape cartridges
      3. 7.5.3 Formatting tape cartridges
      4. 7.5.4 Removing tape drives
      5. 7.5.5 Adding tape drives
    6. 7.6 Tape storage pool management
      1. 7.6.1 Creating tape cartridge pools
      2. 7.6.2 Deleting tape cartridge pools
    7. 7.7 Migration
      1. 7.7.1 Managing file migration pools
      2. 7.7.2 Threshold-based migration
      3. 7.7.3 Manual migration
      4. 7.7.4 Replicas and redundant copies
      5. 7.7.5 Migration hints and tips
    8. 7.8 Premigration
      1. 7.8.1 Premigration with the ltfsee premigrate command
      2. 7.8.2 Premigration running the mmapplypolicy command
    9. 7.9 Preserving file system objects on tape
      1. 7.9.1 Saving file system objects with the ltfsee save command
      2. 7.9.2 Saving file system objects with policies
    10. 7.10 Restoring non-empty regular files and file system objects from tape
    11. 7.11 Recall
      1. 7.11.1 Transparent recall
      2. 7.11.2 Selective recall
      3. 7.11.3 Recalling files with the ltfsee recall command
      4. 7.11.4 The ltfsee recall_deadline command
      5. 7.11.5 Read Starts Recalls: Early trigger for recalling a migrated file
    12. 7.12 Repairing files to their resident state
    13. 7.13 Handling of write-failure tapes
    14. 7.14 Handling of read-failure tapes
    15. 7.15 Reconciliation
    16. 7.16 Reclamation
    17. 7.17 Checking and repairing
    18. 7.18 Importing and exporting
      1. 7.18.1 Importing
      2. 7.18.2 Exporting
      3. 7.18.3 Import/Export enhancements
    19. 7.19 Drive Role settings for job assignment control
    20. 7.20 Tape drive intermix support
    21. 7.21 Write Once Read Many support for IBM TS1140/TS1150 tape drives
    22. 7.22 Obtaining the location of files and data
    23. 7.23 Obtaining inventory, job, and scan status
    24. 7.24 Cleaning up a scan or session
    25. 7.25 Monitoring the system with SNMP
      1. 7.25.1 Configuring Net-SNMP
      2. 7.25.2 Starting and stopping the snmpd daemon
      3. 7.25.3 Example of an SNMP trap
  12. Chapter 8. Hints, tips, and preferred practices
    1. 8.1 Preventing migration of the .SPACEMAN and metadata directories
    2. 8.2 Maximizing migration performance with redundant copies
    3. 8.3 Changing the SSH daemon settings
    4. 8.4 Setting mmapplypolicy options for increased performance
    5. 8.5 Setting the inode size for the GPFS file system for increased performance
    6. 8.6 Determining the file states for all files within the GPFS file system
    7. 8.7 Memory considerations on the GPFS file system for increased performance
    8. 8.8 Increasing the default maximum number of inodes in IBM Spectrum Scale
    9. 8.9 Configuring IBM Spectrum Scale settings for performance improvement
    10. 8.10 Real world use cases for mmapplypolicy
      1. 8.10.1 Creating a traditional archive system policy
      2. 8.10.2 Creating active archive system policies
    11. 8.11 Capturing a core file on RHEL with abrtd
    12. 8.12 Antivirus considerations
    13. 8.13 Automatic email notification with rsyslog
    14. 8.14 Overlapping IBM Spectrum Scale policy rules
    15. 8.15 Storage pool assignment
    16. 8.16 Tape cartridge removal
      1. 8.16.1 Reclaiming tape cartridges before you remove or export them
      2. 8.16.2 Exporting tape cartridges before physically removing them from the library
    17. 8.17 Reusing LTFS formatted tape cartridges
      1. 8.17.1 Reformatting LTFS tape cartridges through ltfsee commands
    18. 8.18 Reusing non-LTFS tape cartridges
    19. 8.19 Moving tape cartridges between pools
      1. 8.19.1 Avoiding changing assignments for tape cartridges that contain files
      2. 8.19.2 Reclaiming a tape cartridge and changing its assignment
    20. 8.20 Offline tape cartridges
      1. 8.20.1 Do not modify the files of offline tape cartridges
      2. 8.20.2 Solving problems
    21. 8.21 Scheduling reconciliation and reclamation
    22. 8.22 License Expiration Handling
    23. 8.23 Reassigning physical tape cartridges to another logical tape library
    24. 8.24 Disaster recovery
      1. 8.24.1 Tiers of disaster recovery
      2. 8.24.2 Preparing IBM Spectrum Archive EE for a tier 1 disaster recovery strategy (offsite vaulting)
      3. 8.24.3 IBM Spectrum Archive EE tier 1 DR procedure
    25. 8.25 IBM Spectrum Archive EE problem determination
    26. 8.26 Collecting IBM Spectrum Archive EE logs for support
    27. 8.27 Backing up file systems that are not managed by IBM Spectrum Archive EE
      1. 8.27.1 Considerations
      2. 8.27.2 Backing up a GPFS or IBM Spectrum Scale environment
      3. 8.27.3 Backing up non IBM Spectrum Scale file systems
      4. 8.27.4 IBM TS4500 Automated Media Verification with IBM Spectrum Archive EE
  13. Chapter 9. Use cases
    1. 9.1 Use cases overview
      1. 9.1.1 Use case for archiving
      2. 9.1.2 Use case for backup
      3. 9.1.3 Use case for tiered and scalable storage
      4. 9.1.4 Use case data exchange
    2. 9.2 University of Basel and Swiss Institute of Bioinformatics (SIB)
      1. 9.2.1 Business needs
  14. Chapter 10. Troubleshooting
    1. 10.1 Overview
      1. 10.1.1 Quick health check
    2. 10.2 Hardware
      1. 10.2.1 Tape library
      2. 10.2.2 Tape drives
      3. 10.2.3 Tape cartridge
    3. 10.3 Recovering data from a write failure tape
    4. 10.4 Recovering data from a read failure tape
    5. 10.5 Handling export errors
    6. 10.6 Software
      1. 10.6.1 Linux
      2. 10.6.2 SNMP
      3. 10.6.3 IBM Spectrum Scale
      4. 10.6.4 IBM Spectrum Archive LE+ component
      5. 10.6.5 Hierarchical storage management
      6. 10.6.6 IBM Spectrum Archive EE logs
    7. 10.7 Recovering from system failures
      1. 10.7.1 Power failure
      2. 10.7.2 Mechanical failure
      3. 10.7.3 Inventory failure
      4. 10.7.4 Abnormal termination
  15. Chapter 11. Reference
    1. 11.1 Command-line reference
      1. 11.1.1 IBM Spectrum Archive EE commands
      2. 11.1.2 IBM Spectrum Scale commands
      3. 11.1.3 Tivoli Storage Manager for Space Management commands
    2. 11.2 Formats for IBM Spectrum Scale to IBM Spectrum Archive EE migration
    3. 11.3 System calls and IBM tools
      1. 11.3.1 Downloading the IBM Tape Diagnostic Tool
      2. 11.3.2 Using the IBM LTFS Format Verifier
    4. 11.4 IBM Spectrum Archive EE interoperability with IBM Spectrum Archive products
  16. Appendix A. Additional material
    1. Locating the web material
    2. Using the web material
  17. Related publications
    1. IBM Redbooks
    2. Other publications
    3. Online resources
    4. Help from IBM
  18. Back cover

Product information

  • Title: IBM Spectrum Archive Enterprise Edition V1.2.2: Installation and Configuration Guide
  • Author(s): Larry Coyne, Khanh Ngo, Illarion Borisevich, Wei Zheng Ong, Stefan Neff
  • Release date: January 2017
  • Publisher(s): IBM Redbooks
  • ISBN: 9780738442365