O'Reilly logo

Software Testing, 4th Edition by Paul C. Jorgensen

Stay ahead with the world's most comprehensive technology and business learning platform.

With Safari, you learn the way you learn best. Get unlimited access to videos, live online training, learning paths, books, tutorials, and more.

Start Free Trial

No credit card required

Chapter 21

Evaluating Test Cases

Quis custodiet ipsos custodes?

Juvenal (Satire VI, lines 347–8)

ca. late 1st century, a.d.

Just as the Roman satirist Juvenal asked who would guard the guards, no matter how carefully a set of tests is developed, software testers should ask how good are their test cases. Edsger Dykstra observed that testing can detect the presence of faults but can never assert their absence. Who tests the test cases? More precisely, how can a set of test cases be tested? One answer has been around for more than 30 years—mutation testing. A more recent addition, “fuzzing,” is closer to random testing. The idea that fishing creel counts as an estimate of test case success is both novel and successful. We take a brief look at all ...

With Safari, you learn the way you learn best. Get unlimited access to videos, live online training, learning paths, books, interactive tutorials, and more.

Start Free Trial

No credit card required