Cover Page by Colin McFarland

Safari, the world’s most comprehensive technology and business learning platform.

Find the exact information you need to solve a problem on the fly, or go deeper to master the technologies and skills you need to succeed

Start Free Trial

No credit card required

O'Reilly logo

7. On Analysis

Trusting your findings

Understanding the results of your experiments can be a complicated affair. Luckily, there are a few simple methods to make sense of all the data your experiments accumulate and give you confidence in your findings.

Statistical significance

In your experiments, you attempt to hold all variables constant except the thing you want to investigate. The reality, of course, is that many variables are not constant. You’re comparing similar groups, but those groups themselves will have differences that introduce noise. That’s where statistical significance comes in (Figure 7.1).

Image

Figure 7.1. Statistical significance ...

Find the exact information you need to solve a problem on the fly, or go deeper to master the technologies and skills you need to succeed

Start Free Trial

No credit card required