You are previewing Improving the Test Process.
O'Reilly logo
Improving the Test Process

Book Description

This book covers the syllabus for the Improving the Test Process module of the International Software Testing Qualifications Board (ISTQB) Expert Level exam.

To obtain certification as a professional tester at the Expert Level, candidates may choose to take a course given by an ISTQB accredited training provider and then sit for the exam. Experience shows that many candidates who choose this path still require a reference book that covers the course. There are also many IT professionals who choose self-study as the most appropriate route toward certification.

This book can be used both as a preparation guide for those planning to take the ISTQB Expert Level certification exam and as a practical guide for experienced testing professionals who want to develop their skills in improving test processes.

Table of Contents

  1. Front Cover
  2. Half Title
  3. Title Page
  4. Copyright
  5. Contents
  6. Preface
  7. Acknowledgements
  8. 1 Introduction
    1. 1.1 About the Authors
      1. 1.1.1 Erik van Veenendaal
      2. 1.1.2 Graham Bath
    2. 1.2 Purpose of the Book
    3. 1.3 What Is an Expert?
    4. 1.4 Expectations and Business Outcomes
    5. 1.5 Career Paths for Testers
    6. 1.6 Syllabus Parts
    7. 1.7 The Certification Exam
    8. 1.8 Certification
  9. 2 The Context of Improvement
    1. 2.1 Why Improve Testing?
    2. 2.2 What Can Be Improved?
    3. 2.3 Views on Quality
    4. 2.4 The Generic Improvement Process
      1. 2.4.1 The Deming Cycle
      2. 2.4.2 The IDEAL Improvement Framework
      3. 2.4.3 Fundamental Concepts of Excellence
    5. 2.5 Overview of Improvement Approaches
      1. 2.5.1 Overview of Model-Based Approaches
      2. 2.5.2 Overview of Analytical Approaches
      3. 2.5.3 Hybrid Approaches
      4. 2.5.4 Other Approaches to Improving the Test Process
    6. 2.6 Exercises
  10. 3 Model-Based Improvement
    1. 3.1 Introduction to Test Process Improvement Models
      1. 3.1.1 Desirable Characteristics of Test Process Improvement Models
      2. 3.1.2 Using Models: Benefits and Risks
      3. 3.1.3 Categories of Models
    2. 3.2 Software Process Improvement (SPI) Models
      1. 3.2.1 Capability Maturity Model Integration (CMMI)
      2. 3.2.2 ISO/IEC 15504
      3. 3.2.3 Comparing CMMI and ISO/IEC 15504
    3. 3.3 Test Process Improvement Models
      1. 3.3.1 The Test Process Improvement Model (TPI NEXT)
      2. 3.3.2 Test Maturity Model integration (TMMi)
      3. 3.3.3 Comparing TPI NEXT to TMMi
      4. 3.3.4 Systematic Test and Evaluation Process (STEP)
      5. 3.3.5 Critical Testing Processes (CTP)
    4. 3.4 Comparing Process Models and Content Models
    5. 3.5 Suitability of SPI Models and Test Process Improvement Models
    6. 3.6 Exercises
  11. 4 Analytical-Based Improvement
    1. 4.1 Introduction
    2. 4.2 Causal Analysis
      1. 4.2.1 Selecting Items for Causal Analysis
      2. 4.2.2 Gathering and Organizing the Information
      3. 4.2.3 Identifying Root Causes
      4. 4.2.4 Drawing Conclusions
      5. 4.2.5 Causal Analysis with System Diagrams
      6. 4.2.6 Causal Analysis during Formal Reviews
      7. 4.2.7 Causal Analysis Lessons Learned
    3. 4.3 GQM Approach
      1. 4.3.1 Introduction
      2. 4.3.2 Paradigms
      3. 4.3.3 GQM Process
      4. 4.3.4 Supporting Tools and Techniques
      5. 4.3.5 Bottom-Up Improvement
    4. 4.4 Analysis Using Measures, Metrics, and Indicators
      1. 4.4.1 Test Effectiveness Metrics
      2. 4.4.2 Test Efficiency / Cost Metrics
      3. 4.4.3 Lead-Time Metrics
      4. 4.4.4 Predictability Metrics
      5. 4.4.5 Product Quality Metrics
      6. 4.4.6 Test Maturity Metrics
    5. 4.5 Exercises
  12. 5 Selecting Improvement Approaches
    1. 5.1 Selecting Test Process Improvement Approaches
    2. 5.2 Process Models
    3. 5.3 Content Models
    4. 5.4 Analytical Approaches
    5. 5.5 Mixed Approaches
    6. 5.6 Analytical Approaches and Improvement Models
      1. 5.6.1 Analytical-Based Improvement with CMMI
      2. 5.6.2 Analytical-Based Improvement with TPI NEXT
      3. 5.6.3 Analytical-Based Improvement with TMMi
      4. 5.6.4 Analytical-Based Improvement with CTP and STEP
    7. 5.7 Exercises
  13. 6 Process for Improvement
    1. 6.1 Introduction
      1. 6.1.1 IDEAL Process Improvement Framework
      2. 6.1.2 Test Policy
    2. 6.2 Initiating the Improvement Process
      1. 6.2.1 Identify Stimulus for Change
      2. 6.2.2 Set Objectives for Test Improvement
      3. 6.2.3 Set Context
      4. 6.2.4 Build Sponsorship
      5. 6.2.5 Charter Infrastructure
    3. 6.3 Diagnosing the Current Situation
      1. 6.3.1 Planning the Assessment
      2. 6.3.2 Assessment Preparation
      3. 6.3.3 Performing Interviews
      4. 6.3.4 Giving Feedback
      5. 6.3.5 Analyzing Results
      6. 6.3.6 Performing Solution Analysis
      7. 6.3.7 Recommending Improvement Actions
    4. 6.4 Establishing a Test Improvement Plan
      1. 6.4.1 Set Priorities
      2. 6.4.2 Develop an Implementation Approach
      3. 6.4.3 Planning the Improvements
    5. 6.5 Acting to Implement Improvement
      1. 6.5.1 Selecting and Executing a Pilot
      2. 6.5.2 Manage and Control the Implementation
    6. 6.6 Learning from the Improvement Program
    7. 6.7 Exercises
  14. 7 Organization, Roles, and Skills
    1. 7.1 Organization
      1. 7.1.1 The Test Process Group (TPG)
      2. 7.1.2 Test Improvement with Remote, Offshore, and Outsourced Teams
    2. 7.2 Individual Roles and Staffing
      1. 7.2.1 The Test Process Improver
      2. 7.2.2 The Lead Assessor
      3. 7.2.3 The Co-Assessor
    3. 7.3 Skills of the Test Process Improver/Assessor
      1. 7.3.1 Interviewing Skills
      2. 7.3.2 Listening Skills
      3. 7.3.3 Presentation and Reporting Skills
      4. 7.3.4 Analytical Skills
      5. 7.3.5 Note-Taking Skills
      6. 7.3.6 Skills of Persuasion
      7. 7.3.7 Management Skills
      8. 7.3.8 Summary
    4. 7.4 Exercises
  15. 8 Managing Change
    1. 8.1 Introduction
    2. 8.2 Overview
      1. 8.2.1 The Fundamental Change Process
      2. 8.2.2 The Satir Model
      3. 8.2.3 Tipping Points and Change
    3. 8.3 Prepare for Change
      1. 8.3.1 Establish the Need for Improvement
      2. 8.3.2 Create a Sense of Urgency
      3. 8.3.3 Establish the Improvement Team
    4. 8.4 Decide What to Change
      1. 8.4.1 Establish a Vision of the Future
      2. 8.4.2 Set Specific Objectives and Align to Business Goals
      3. 8.4.3 Decide on an Implementation Strategy
      4. 8.4.4 Balance Short-Term and Longer-Term Benefits
    5. 8.5 Making Change Happen
      1. 8.5.1 Communicating for Buy-In and Understanding
      2. 8.5.2 Anticipating Chaos
      3. 8.5.3 Managing the Chaos
      4. 8.5.4 Handling Resistance to Change
      5. 8.5.5 Climbing Out of Chaos: Developing Transforming Ideas
    6. 8.6 Making Change Stick
      1. 8.6.1 Rollout of New Ideas and Practices
      2. 8.6.2 Provide Lasting Support
      3. 8.6.3 Create a New Culture of Improvement
      4. 8.6.4 Practice Continuous Improvement Principles
    7. 8.7 Data Privacy
    8. 8.8 Exercises
  16. 9 Critical Success Factors
    1. 9.1 Critical Success Factors
      1. 9.1.1 Getting Started
      2. 9.1.2 Getting the Job Done
      3. 9.1.3 Critical Success Factors: A Case Study
    2. 9.2 Setting a Culture for Improvement
      1. 9.2.1 Defining “Improvement Culture”
      2. 9.2.2 Aspects of Improvement Culture
      3. 9.2.3 Test Process Improvement Manifesto
    3. 9.3 Exercises
  17. 10 Adapting to Different Life Cycle Models
    1. 10.1 Test Process Improvement with Different Life Cycles
    2. 10.2 Exercises
  18. Appendix A: Glossary
  19. Appendix B: Literature and References
    1. B.1 Books/Journals
    2. B.2 ISTQB Publications
    3. B.3 Standards
    4. B.4 Web References
  20. Appendix C: The Syllabus Parts
  21. Appendix D: The Exam
    1. D.1 General Exam Aspects
    2. D.2 Part 1 Exam: “Assessing Test Processes”
    3. D.3 Part 2 Exam: “Implementing Test Process Improvement”
    4. D.4 Tips
    5. D.5 Common Problems
  22. Appendix E: Summary of Cognitive Levels (K-Levels)
  23. Appendix F: Answers
  24. Index