3 min read
More than two variants: when an A/B/C actually makes sense
Adding a third variant costs you a third of your sample and buys you a comparison you may not need. Three cases where it's worth it, and one very common case where it isn't.
Topic
Articles on Experimentation program
Everything we have published on Experimentation program: guides, experiments and what we learned along the way.
11 articles
3 min read
Traffic allocation: when to use 50/50 and when to use 90/10
An even split gets you the fastest answer. An uneven one limits how many customers see a change you're not sure about. You can't have both.
3 min read
Variant persistence: why a visitor must always see the same version
If someone sees variant B on Tuesday and variant A on Friday, you haven't run an experiment. You've run a bug that also produces numbers.
3 min read
Mutually exclusive tests: stopping two experiments from contaminating each other
Two experiments on the same funnel produce four combinations and one confused conclusion. Mutual exclusion is how you keep the answer readable.
4 min read
The minimum CRO team: one person and a platform that does the rest
Traditional CRO needs an analyst, a designer, a developer and a statistician. Here's which of those four jobs actually has to be human at a small brand.
3 min read
How to prioritise hypotheses when you can only run one test a month
ICE and PIE were designed for teams running twenty tests a quarter. When you get twelve a year, the scoring model has to change.
5 min read
How to build your first experimentation program as a new brand
You don't need a CRO team, a data warehouse or a statistician. You need a hypothesis, a segment and a way to measure. Here's the whole thing, from zero.
2 min read
How to Build a Culture of Experimentation in Your Company
Move from one-off tests to a continuous program. Learn how to break down barriers and democratize experiments without losing the rigor that makes them valuable.
2 min read
How to build an experimentation program with a small team
Experimentation isn't just for big teams with data scientists and dedicated devs. With a lightweight process, two or three people can keep a steady pace of learning.
2 min read
The hidden cost of waiting for a deploy on every change
Waiting for a deploy costs far more than the deploy itself: lost opportunities, slower learning and a team that stops proposing ideas. Here's the real bill.
2 min read
From idea to production experiment the same day
When the gap between an idea and a live experiment shrinks from weeks to a single session, you stop optimizing the ticket queue and start optimizing conversion.
KEEP EXPLORING
From reading to results
- AI CRO agentUnderstands your visitors, decides what to test or personalize, builds it on your site and measures whether it worked.Meet the agent
- Bixlow StudioA team of strategists and agents that runs your experimentation program end to end.Meet the Studio
- Book a demoWe show you Bixlow on your own website and propose your first three experiments.Book a demo