3 min read
Statistical significance explained without any maths
What the number actually claims, what it doesn't, and the four sentences you need to read a result honestly without ever computing anything.
Everything we have published on Minimum detectable effect: guides, experiments and what we learned along the way.
6 articles
3 min read
What the number actually claims, what it doesn't, and the four sentences you need to read a result honestly without ever computing anything.
3 min read
Adding a third variant costs you a third of your sample and buys you a comparison you may not need. Three cases where it's worth it, and one very common case where it isn't.
3 min read
ICE and PIE were designed for teams running twenty tests a quarter. When you get twelve a year, the scoring model has to change.
4 min read
The honest answer has three inputs and no marketing spin. Here's how to calculate it for your own site, and what to do when the number comes back too big.
4 min read
Low traffic doesn't mean you can't experiment. It means you can only detect large effects — so you have to test the things capable of producing them.
2 min read
Sample size quietly ruins more experiments than any other factor. Learn the three variables behind it and how to know if your A/B test can actually reach a conclusion.