Few tests are perfect the first time out. With careful monitoring and revision, however, you can eliminate the most common problems.
One of the best ways to improve a course is to examine the log files after a reasonable number of learners have taken tests. Look for the symptoms of easily corrected problems, such as these:
|Questions with higher or lower than normal success rates||These questions may be too easy or too hard.|
|Questions that many learners skip.||Learners may not understand these questions, they may take too long to read, or they may be too difficult to answer.|
|Large number of questions left unanswered on timed tests.||If learners leave more than a few questions unanswered, you may need to increase the time or decrease the number of questions.|
Invite learners to comment on the tests. Request feedback from learners about a test, but only after the test has been graded. This delay gives learners time to calm down so their responses are more reasoned and less emotional. And learners respond based on the actual grade rather than the anticipated one. Learners can point out unclear or unfair questions.
Sometimes learners may feel tests are unfair. They believe that tests ask improper questions or do not give all learners an equal chance to answer questions correctly. Common complaints include:
Questions not within the scope of stated objectives.
Questions that ...