O'Reilly logo

Experiment!: Website conversion rate optimization with A/B and multivariate testing by Colin McFarland

Stay ahead with the world's most comprehensive technology and business learning platform.

With Safari, you learn the way you learn best. Get unlimited access to videos, live online training, learning paths, books, tutorials, and more.

Start Free Trial

No credit card required

3. On Method

A/B and Multivariate Testing

We’ve talked about an approach to experimentation. In this chapter, we’ll look at two methods you can use to actually run your experiments online: A/B testing and multivariate testing (MVT).

What are A/B and MVT?

A/B and MVT are methods for running controlled experiments online. Programmer Jesse Farmer describes it as a cage match: send in your champion against a challenger (or several challengers) and out comes a winner.

These methods let you compare alternative versions of the same page or element running simultaneously on your website by randomly assigning visitors to different groups, then comparing the data to see which version produces the best outcome for your goal, for example, increased conversion. ...

With Safari, you learn the way you learn best. Get unlimited access to videos, live online training, learning paths, books, interactive tutorials, and more.

Start Free Trial

No credit card required