thirty-oneTOP TWELVE TIPS FOR RUNNINGA BETA TEST

TUESDAY, MARCH 2, 2004

Here are a few tips for running a beta test of a software product intended for large audiences—what I call "shrink-wrap." These apply for commercial or open source projects; I don't care whether you get paid in cash, eyeballs, or peer recognition, but I'm focused on products for lots of users, not internal IT projects.

  1. Open betas don't work. You either get too many testers (think Netscape), in which case you can't get good data from the testers, or you get too few reports from the existing testers.
  2. The best way to get a beta tester to send you feedback is to appeal to their psychological need to be consistent. You need to get them to say that they will send you feedback, ...

Get MORE JOEL ON SOFTWARE: Further Thoughts on Diverse and Occasionally Related Matters That Will Prove of Interest to Software Developers, Designers, and Managers, and to Those Who, Whether by Good Fortune or Ill Luck, Work with Them in Some Capacity now with the O’Reilly learning platform.

O’Reilly members experience books, live events, courses curated by job role, and more from O’Reilly and nearly 200 top publishers.