You are previewing Evaluating Online Teaching: Implementing Best Practices.
O'Reilly logo
Evaluating Online Teaching: Implementing Best Practices

Book Description

Create a more effective system for evaluating online faculty

Evaluating Online Teaching is the first comprehensive book to outline strategies for effectively measuring the quality of online teaching, providing the tools and guidance that faculty members and administrators need. The authors address challenges that colleges and universities face in creating effective online teacher evaluations, including organizational structure, institutional governance, faculty and administrator attitudes, and possible budget constraints. Through the integration of case studies and theory, the text provides practical solutions geared to address challenges and foster effective, efficient evaluations of online teaching. Readers gain access to rubrics, forms, and worksheets that they can customize to fit the needs of their unique institutions.

Evaluation methods designed for face-to-face classrooms, from student surveys to administrative observations, are often applied to the online teaching environment, leaving reviewers and instructors with an ill-fitted and incomplete analysis. Evaluating Online Teaching shows how strategies for evaluating online teaching differ from those used in traditional classrooms and vary as a function of the nature, purpose, and focus of the evaluation. This book guides faculty members and administrators in crafting an evaluation process specifically suited to online teaching and learning, for more accurate feedback and better results. Readers will:

  • Learn how to evaluate online teaching performance

  • Examine best practices for student ratings of online teaching

  • Discover methods and tools for gathering informal feedback

  • Understand the online teaching evaluation life cycle

  • The book concludes with an examination of strategies for fostering change across campus, as well as structures for creating a climate of assessment that includes online teaching as a component. Evaluating Online Teaching helps institutions rethink the evaluation process for online teaching, with the end goal of improving teaching and learning, student success, and institutional results.

    Table of Contents

    1. Title Page
    2. Copyright
    3. Acknowledgments
    4. About the Authors
      1. Chapter One: Challenges in Evaluation of Online Teaching
        1. A Theoretical Foundation
        2. The “Traditional” Teaching-Evaluation Process
        3. Challenges for the Evaluation of Online Teaching
        4. Looking Ahead
        5. Conclusion
        6. A Thought Exercise
      2. Chapter Two: Context for Evaluating Online Teaching
        1. Developing an Evaluation System
        2. Getting Started
        3. Stakeholders for the Evaluation of Online Teaching
        4. Conclusion
        5. A Thought Exercise
      3. Chapter Three: Establishing a Foundation for Evaluating Online Teaching
        1. A Decision-Making Process
        2. Conclusion
        3. A Thought Exercise
      1. Chapter Four: Conducting Formative Reviews to Enhance Online Teaching
        1. The Value of Evaluation
        2. Comparing Summative and Formative Evaluation Approaches
        3. The Unique Nature of Formative Evaluation in the Online Classroom
        4. Making Room for Improvement along the Way
        5. Making the Most of Formative Feedback: The SCARF Loop
        6. The Sources of Formative Feedback: Self, Peers, and Students
        7. Conclusion
        8. A Thought Exercise
      1. Chapter Five: Student Ratings of Online Teaching
        1. What Good Are Student Reviews?
        2. Did You Know?
        3. What Are Students Qualified to Review?
        4. How Much Is Enough?
        5. The Classic Approach: Formal Student Surveys
        6. Increasing Student Rating Response Rates
        7. Making Room for Improvement along the Way
        8. A Look at Three Existing Tools
        9. Open-Ended Feedback
        10. So What Is the Right Mix for You?
        11. Conclusion
        12. A Thought Exercise
      2. Chapter Six: Administrative Evaluation of Online Teaching
        1. Administrators Today
        2. The Elephant in the Room
        3. Observational Bias
        4. Equivalence
        5. What is Unique about Administrator Evaluation?
        6. Looking Beyond the Administrator
        7. Conclusion
        8. A Thought Exercise
      3. Chapter Seven: Administrative Review Tools
        1. What Is Already Available?
        2. Checklist for Online Interactive Learning
        3. Quality Online Course Initiative (QOCI)
        4. Quality Matters (QM) Rubric
        5. The Online Instructor Evaluation System (OIES)
        6. Peer Review Guide for Online Teaching at Penn State
        7. Recommended Process for Faculty-Peer Review
        8. Conclusion
        9. A Thought Exercise
      4. Chapter Eight: Integrating Data Analytics in the Evaluation of Online Teaching
        1. Data Analytics: Moving beyond Student Learning
        2. Data Analytics Requires Data
        3. Integrating Prescriptive Analytics for Evaluating Online Teaching
        4. Making Data Meaningful
        5. Integrating Analytics for Evaluation of Online Teaching
        6. Understanding Big Data
        7. Conclusion
        8. A Thought Exercise
      1. Chapter Nine: From Tools to Processes: Creating a Holistic Evaluation Plan
        1. Scope and Scale of Data Recording
        2. Ability to Compare Performance Statistics
        3. Separating Teaching Behaviors from Content Design
        4. Moving from Instruments to a Holistic Evaluation Program
        5. What Observations Count?
        6. Applications of Evaluation Results
        7. Conclusion
        8. A Thought Exercise
      2. Chapter Ten: Implementing the Evaluation Process
        1. Step 1: Identify the Barriers
        2. Step 2: Bring Together Key Stakeholders
        3. Step 3: The Small-Step Approach
        4. What Can Administrators Do?
        5. What Can Faculty Members Do?
        6. Conclusion
        7. A Thought Exercise
      3. Chapter Eleven: The Online-Teaching Evaluation Life Cycle
        1. Integration of Evaluation
        2. Topic Ideas for Faculty Development in Online Teaching
        3. The Life Cycle of Evaluation of Online Teaching
        4. Conclusion
        5. A Thought Exercise
      4. Chapter Twelve: Next Steps
        1. Step 1: Establish Context
        2. Step 2: Establish Foundations
        3. Step 3: Design Formative Processes
        4. Step 4: Design Summative Processes
        5. Step 5: Create a Holistic Campus Plan
        6. Step 6: Implement and Cycle the Program
        7. The Last Word
    9. References
    10. Index
    11. End User License Agreement