The ABCs of Evaluation: Timeless Techniques for Program and Project Managers, Third Edition

The ABCs of Evaluation: Timeless Techniques for Program and Project Managers, Third Edition

by John Boulmetis, Phyllis Dutwin
Released October 2011
Publisher(s): Jossey-Bass
ISBN: 9780470873540

Read it now on the O’Reilly learning platform with a 10-day free trial.

O’Reilly members get unlimited access to books, live events, courses curated by job role, and more from O’Reilly and nearly 200 top publishers.

Start your free trial

Book description

Thoroughly revised and updated, the third edition of bestselling The ABCs of Evaluation offers an introduction to program evaluation. This comprehensive textbook covers topics such as stakeholder relationships, program design, data collection and analysis, reporting results, and other important steps in the evaluation process. The ABCs of Evaluation shows how to select participants for the evaluation and how to deal with multiple goals and objectives—including those of the organization, the staff, and the client. The authors illustrate the circumstances under which each evaluation model can be used, and offer tips on identifying data sources and collecting the data. This revision includes substantially increased coverage of theory, methodological approaches, the business of evaluation, the evaluator's role and responsibilities, RFPs and the grants process, logic models, data analysis, and writing the evaluation report. Also included are new cases and scenarios from various evaluation realms in social sciences, education, health, and human services. Throughout the book, charts, graphs, models, and lists help organize, extend, and facilitate the understanding of each evaluation concept.

Praise for the Previous Edition of The ABCs of Evaluation

"A useful general overview of the evaluation process. I would recommend it to program or project managers wanting to know more about the process of evaluation." —American Journal of Evaluation

"All students (and practitioners) should have this in their library; they will use it frequently." —Patricia McGee, PhD, associate professor, University of Texas, San Antonio

Companion Web site: www.josseybass.com/go/Boulmetis

Table of contents

  1. Cover Page
  2. Title Page
  3. Copyright
  4. CONTENTS
  5. PREFACE
    1. Demonstrating Success
    2. Overview
    3. Using This Book
  6. THE AUTHORS
  7. CHAPTER 1: What Is Evaluation?
    1. Common Denominators
    2. Two Definitions of Evaluation
    3. Evaluating Efficiency, Effectiveness, and Impact
    4. Evaluating Alternatives
    5. Identifying Areas to Improve
    6. Other Levels
    7. Formal Reasons to Evaluate
    8. Practical Application
    9. Formative and Summative Evaluations
    10. Putting It All Together
    11. Key Words and Concepts
    12. Questions and Exercises
    13. Further Reading
  8. CHAPTER 2: Why Evaluate?
    1. Grants and Grantsmanship
    2. Benefits
    3. Limitations
    4. Considerations
    5. Putting It All Together
    6. Key Words and Concepts
    7. Questions and Exercise
    8. Further Reading
  9. CHAPTER 3: Decision Making: Whom to Involve, How, and Why?
    1. Program and Project Cycles
    2. Evaluation and Monitoring
    3. Program Planning Cycle and Evaluation
    4. Putting It All Together
    5. Key Words and Concepts
    6. Questions and Exercises
    7. Further Reading
  10. CHAPTER 4: Starting Point: The Evaluator's Program Description
    1. What an Evaluator's Program Description Can Do
    2. Developing an Evaluator's Program Description
    3. Putting It All Together
    4. Key Words and Concepts
    5. Questions and Exercises
    6. Further Reading
  11. CHAPTER 5: Choosing an Evaluation Model
    1. More Than One Way to Evaluate
    2. Four Evaluation Models
    3. Other Models
    4. Choosing the Right Model
    5. Evaluation Design Format
    6. Other Considerations
    7. Putting It All Together
    8. Key Words and Concepts
    9. Questions and Exercise
    10. Further Reading
  12. CHAPTER 6: Data Sources
    1. Starting Point
    2. Qualitative and Quantitative Data Sources
    3. Four Levels of Data
    4. Nature of Data Collection
    5. Existing Data
    6. Newly Collected Data
    7. Putting It All Together
    8. Key Words and Concepts
    9. Questions and Exercise
    10. Further Reading
  13. CHAPTER 7: Data Analysis
    1. Data Analysis
    2. Data
    3. Terms
    4. Levels of Data
    5. Putting It All Together
    6. Key Words and Concepts
    7. Questions and Exercise
    8. Further Reading
    9. Software for Personal Computers
  14. CHAPTER 8: Is It Evaluation or Is It Research?
    1. Determining Evaluation or Research from Intent
    2. Determining Evaluation or Research from Design
    3. Qualitative and Quantitative Characteristics
    4. Sampling
    5. Sampling and Surveys
    6. Putting It All Together
    7. Key Words and Concepts
    8. Questions and Exercise
    9. Further Reading
  15. CHAPTER 9: Writing the Evaluation Report
    1. Communicating Your Findings
    2. Evaluation Reports
    3. The Report Outline
    4. Putting It All Together
    5. Key Words and Concepts
    6. Questions and Exercise
    7. Further Reading
  16. CHAPTER 10: Evaluation as a Business
    1. Is There a Market for Program Evaluation?
    2. How Do You Find the Business?
    3. Proactive Resources
    4. Reactive Resources
    5. Emergency Resources
    6. How Do You Negotiate a Contract?
    7. Keeping the Business Alive
    8. Putting It All Together
    9. Key Words and Concepts
    10. Further Reading
  17. APPENDIX A: More On Data Analysis
    1. Analyses for Each Level
    2. Significance Testing
    3. Statistical and Practical Significance
  18. APPENDIX B: Sample Evaluation Report
  19. APPENDIX C: Sample Evaluation Contract
    1. Evaluation of the XYZ Training Project
  20. REFERENCES
  21. INDEX

Product information

  • Title: The ABCs of Evaluation: Timeless Techniques for Program and Project Managers, Third Edition
  • Author(s): John Boulmetis, Phyllis Dutwin
  • Release date: October 2011
  • Publisher(s): Jossey-Bass
  • ISBN: 9780470873540