You are previewing Managing the Testing Process: Practical Tools and Techniques for Managing Hardware and Software Testing.
O'Reilly logo
Managing the Testing Process: Practical Tools and Techniques for Managing Hardware and Software Testing

Book Description

New edition of one of the most influential books on managing software and hardware testing

In this new edition of his top-selling book, Rex Black walks you through the steps necessary to manage rigorous testing programs of hardware and software. The preeminent expert in his field, Mr. Black draws upon years of experience as president of both the International and American Software Testing Qualifications boards to offer this extensive resource of all the standards, methods, and tools you'll need.

The book covers core testing concepts and thoroughly examines the best test management practices and tools of leading hardware and software vendors. Step-by-step guidelines and real-world scenarios help you follow all necessary processes and avoid mistakes.

  • Producing high-quality computer hardware and software requires careful, professional testing; Managing the Testing Process, Third Edition explains how to achieve that by following a disciplined set of carefully managed and monitored practices and processes

  • The book covers all standards, methods, and tools you need for projects large and small

  • Presents the business case for testing products and reviews the author's latest test assessments

  • Topics include agile testing methods, risk-based testing, IEEE standards, ISTQB certification, distributed and outsourced testing, and more

  • Over 100 pages of new material and case studies have been added to this new edition

If you're responsible for managing testing in the real world, Managing the Testing Process, Third Edition is the valuable reference and guide you need.

Table of Contents

  1. Cover
  2. Title Page
  3. Copyright
  4. About the Author
  5. Credits
  6. Acknowledgments
  7. Introduction
    1. The Focus of This Book
    2. Canon or Cookbook?
    3. The Tools You Need
    4. The Resources You Need
    5. On Context
    6. Using This Book
    7. What's New and Changed in the Third Edition?
  8. Chapter 1: Defining What's on Your Plate: The Foundation of a Test Project
    1. What You Might Test: The Extended Test Effort
    2. What You Should Test: Considering Quality
    3. What You Can Test: Schedule, Resources, and Budget
    4. Case Study
    5. Exercise
  9. Chapter 2: Plotting and Presenting Your Course: The Test Plan
    1. Why I Write Test Plans
    2. How Many Test Plans?
    3. Using Drafts to Stimulate Discussion
    4. Using a Test Plan Template
    5. The IEEE 829 Template: Compare and Contrast
    6. Selling the Plan
    7. Clarity, Pertinence, and Action
    8. Case Study
    9. Exercises
  10. Chapter 3: Test System Architecture, Cases, and Coverage
    1. Test System Architecture and Engineering
    2. It's Not Saint Paul's, But…Principles for Test System Architecture
    3. The Bricks and Mortar of the System: Test Cases
    4. Avoiding the Dreaded Test Escape: Coverage and Regression-Test Gaps
    5. “There's a Lesson to Be Learned Here…”: Test Case Incremental Improvement
    6. You Can't Do It All: Deciding What Not to Do
    7. Case Study
    8. Bonus Case Study
    9. Bonus Case Study
    10. Exercises
  11. Chapter 4: An Exciting Career in Entomology Awaits You: A Bug-Tracking Database
    1. Why Bother? The Case for a Formal Bug-Tracking System
    2. So, What Seems to Be the Problem? The Failure Description
    3. Flexible Reporting: Beginning to Construct a Database
    4. The Vital Few and the Trivial Many: Ranking Importance
    5. Putting the Tracking in Bug Tracking: Adding Dynamic Information
    6. Finishing Touches: Capturing Bug Data for Analysis
    7. The IEEE 829 Standard
    8. Extracting Metrics from the Bug-Tracking Database
    9. Managing Bug Tracking
    10. Case Study
    11. Exercises
  12. Chapter 5: Managing Test Cases: The Test Tracking Spreadsheet
    1. Building a Minimalist Test Tracking Spreadsheet
    2. Making Enhancements
    3. Putting the Test Tracking System in Motion
    4. The IEEE 829 Test Log
    5. Extracting Metrics from the Test Tracking Spreadsheet
    6. IEEE 829 Test Reporting: Interim, Level, and Master
    7. Case Study One
    8. Case Study Two
    9. Exercises
  13. Chapter 6: Tips and Tools for Crunch Mode: Managing the Dynamic
    1. Do Sweat the Details: Staying on Top of Everything
    2. A Spider's Web of Connections: Managing Test Hardware and Software Configuration Logistics
    3. Expect the Unexpected: A Change Management Database
    4. Case Study
    5. Exercises
  14. Chapter 7: Stocking and Managing a Test Lab
    1. Do You Need a Test Lab?
    2. Selecting and Planning a Lab Area
    3. The Test Lab Inventory
    4. Security and Tracking Concerns
    5. Managing Equipment and Configurations
    6. Keeping the Test Environment Clean
    7. Human Factors
    8. Case Study
    9. Exercises
  15. Chapter 8: Staffing and Managing a Test Team
    1. The Right Person for the Job: What Kind of People Make Good Test Engineers
    2. Defining the Test Team: How Many Whos Do What?
    3. Specialists or Project Resources? Organizational Models
    4. Hiring Testers
    5. Giving a Damn: Motivating Your Test Team
    6. Extending Your Talent: Using Temporary Experts and Implementers
    7. Case Study
    8. Exercises
  16. Chapter 9: The Triumph of Politics: Organizational Challenges for Test Managers
    1. Don Quixote, Champion of Quality: What's Your Job, Anyhow?
    2. Where You Fit: The Test Group in the Organization
    3. What Else Fits? Adding Other Functions to Test
    4. Working with Other Managers: Directions of Test Management
    5. Testing in the Dark: Should You Proceed without Documentation?
    6. Pink Slips: Layoffs and Liquidation
    7. Presenting the Results: The Right Message, Delivered Properly
    8. “You Can Tell the Pioneers…”: The Effect of Early Adoption on Test
    9. Exercises
  17. Chapter 10: Involving Other Players: Distributed Testing, Outsourcing, and Related Topics
    1. Choosing Your Partners
    2. Planning a Distributed Test Effort
    3. Managing a Distributed Test Effort
    4. How Outsourcing Affects Testing
    5. Case Study 1
    6. Case Study 2
    7. Bonus Case Study: People Are Not Widgets!
    8. Conclusion
    9. Exercises
  18. Chapter 11: Economics of Testing: Fiscal Context
    1. Is Quality Free? The Economic Justification for the Testing Investment
    2. Case Study
    3. Exercises
  19. Chapter 12: Testing Implications of Project and Process: Situational Context
    1. Where Testing Fits into the Project Life Cycle
    2. Process Improvement
    3. Improving Your Test Process
    4. Managing the Testing Process: A Retrospective Conclusion
    5. Case Study 1: Agile Testing Challenges
    6. Case Study 2: Maturity and ROI
    7. Exercises
  20. Appendices
    1. Appendix A: Hardware Testing Fundamentals: An Introduction for Software Testing Professionals
      1. Test Management
      2. Basic Functionality and Self Tests
      3. Electrical Testing
      4. Environmental Tests
      5. Mechanical Life
      6. Thermal Tests
      7. Reliability
      8. Packaging Tests
      9. Acoustics
      10. Safety
      11. Radiation
      12. Standards and Regulations
      13. Components and Subsystems
      14. Integrated Software
      15. Supplier Quality Engineering
      16. Pilot Testing
      17. Case Study
    2. Appendix B: Omninet: The Internet Everywhere Marketing Requirements Document
      1. 1 Scope
      2. 2 Required release date
      3. 3 Description of requirements
    3. Appendix C: Omninet: The Internet Everywhere System Requirements Document
      1. Functionality System Requirements
      2. Reliability System Requirements
      3. Usability System Requirements
      4. Efficiency System Requirements
      5. Maintainability System Requirements
      6. Portability System Requirements
      7. Design Models
    4. Appendix D: Bibliography, Related Readings, and Other Resources
      1. Bibliography and Related Readings
      2. Online and Hard-Copy Publications
      3. Contacting RBCS
  21. Glossary
  22. Index