You are previewing Evaluation Basics, 2nd Edition.
O'Reilly logo
Evaluation Basics, 2nd Edition

Book Description

Your training: Do they live it or just love it? How do training professionals show the impact their programs are making? Positive feedback only goes so far in confirming success. And entertainment value, while important, isn't the truest measure of your effectiveness. To find out whether your participants are applying what they’ve learned on the job, you need a good evaluation strategy—one that connects evaluation to performance, program design, and bottom-line value. Each chapter of Evaluation Basics focuses on a critical aspect of developing and implementing an evaluation plan for a face-to-face or virtual training program. You’ll not only delve into Kirkpatrick’s four levels of evaluation and the methods and instruments you can use, but you’ll also get help effectively communicating results. Part of ATD’s Training Basics series, the second edition of Evaluation Basics offers practical examples, worksheets, and new case studies to further your understanding.

Table of Contents

  1. Cover
  2. Title Page
  3. Copyright
  4. Contents
  5. About the Training Basics Series
  6. Preface
  7. 1. Evaluation for You and for Your Client
    1. How Evaluation Basics Can Help You
    2. What’s New in This Edition
    3. How This Book Is Organized
    4. Let’s Go!
    5. Getting It Done
  8. 2. An Overview of Evaluation
    1. What Is Evaluation?
    2. Purposes of Evaluation
    3. Benefits of Evaluation
    4. So, Why Doesn’t Everyone Do Evaluations?
    5. Reasons for Poor Training Evaluations
    6. Roles and Responsibilities for Evaluation
    7. Building on the Four Levels of Evaluation
    8. Getting It Done
  9. 3. Evaluation and the Design Process
    1. Criteria for Course Evaluation
    2. Key Concepts: Design and Evaluation
    3. Online and Virtual Classroom Training
    4. Internal Certification Programs and Evaluation
    5. The Integration of Evaluation and Design
    6. Developing the Evaluation Plan
    7. Instruments: Advantages and Disadvantages
    8. The Project Plan
    9. Getting It Done
  10. 4. Level 1: Audience Reaction
    1. Defining Level 1 Evaluation
    2. Reasons for Conducting Level 1 Evaluations
    3. Level 1: What It Includes and Excludes
    4. Advantages of Level 1 Evaluation
    5. Disadvantages of Level 1 Evaluation
    6. Guidelines for Level 1 Evaluation
    7. An Example of Level 1 Evaluation
    8. Common Errors in Level 1 Evaluation
    9. Improving Level 1 Evaluation
    10. Getting It Done
  11. 5. Level 2: Learning and Application During Training
    1. Defining Level 2 Evaluation
    2. Reasons for Conducting Level 2 Evaluation
    3. Level 2: What It Includes and Excludes
    4. Advantages of Level 2 Evaluation
    5. Disadvantages of Level 2 Evaluation
    6. Guidelines for Level 2 Evaluation
    7. Developing Tests and Testing
    8. Why Participants Resist Testing
    9. Types of Level 2 Assessments and Their Advantages and Disadvantages
    10. Getting It Done
  12. 6. Level 3: Transfer to the Job and the Environment
    1. A Working Definition of Transfer
    2. The Business Case for Transfer
    3. What Level 3 Evaluation Includes and Excludes
    4. Requirements for Transfer
    5. Guidelines for Transfer
    6. Barriers to Transfer
    7. Evaluation of the Design to Ensure Transfer
    8. Instruments and Methods to Support and Assess Transfer
    9. Make Transfer Part of Your Organization’s Processes
    10. The Effect of Environment
    11. Getting It Done
  13. 7. Level 4: Impact and ROI
    1. A Working Definition of Level 4 Evaluation
    2. The Challenges of Level 4
    3. Benefits of Conducting Level 4 Evaluations
    4. Questions Clients Ask
    5. Organizational Drivers for ROI
    6. Guidelines for Level 4 Evaluation
    7. Steps in Conducting an Impact and ROI Analysis
    8. Other Measures of Impact
    9. Getting It Done
  14. 8. Evaluation Biases and Communicating the Results
    1. Kinds and Implications of Bias
    2. Components of an Evaluation Report
    3. The Communication Plan
    4. Getting It Done
  15. 9. A Final Thought
    1. Design and Evaluation
    2. Demonstrating Value
    3. Readiness
    4. Getting It Done
  16. Appendix A: Rating Guides for Courseware and Facilitation
  17. Appendix B: Solutions to Case Studies
  18. References
  19. Additional Resources
  20. About the Author
  21. Back Cover