7.9. IMPROVE TESTING

Few tests are perfect the first time out. With careful monitoring and revision, however, you can eliminate the most common problems.

7.9.1. Monitor results

One of the best ways to improve a course is to examine the log files after a reasonable number of learners have taken tests. Look for the symptoms of easily corrected problems, such as these:

Questions with higher or lower than normal success ratesThese questions may be too easy or too hard.
Questions that many learners skip.Learners may not understand these questions, they may take too long to read, or they may be too difficult to answer.
Large number of questions left unanswered on timed tests.If learners leave more than a few questions unanswered, you may need to increase the time or decrease the number of questions.

7.9.2. Solicit feedback from learners

Invite learners to comment on the tests. Request feedback from learners about a test, but only after the test has been graded. This delay gives learners time to calm down so their responses are more reasoned and less emotional. And learners respond based on the actual grade rather than the anticipated one. Learners can point out unclear or unfair questions.

7.9.3. Make tests fair to all learners

Sometimes learners may feel tests are unfair. They believe that tests ask improper questions or do not give all learners an equal chance to answer questions correctly. Common complaints include:

  • Questions not within the scope of stated objectives.

  • Questions that ...

Get Designing Web-Based Training: How to Teach Anyone Anything Anywhere Anytime now with the O’Reilly learning platform.

O’Reilly members experience books, live events, courses curated by job role, and more from O’Reilly and nearly 200 top publishers.