How this course works
The chapters and lessons below are the fixed course structure. When you start, LearnLive teaches each lesson interactively and adapts examples, pacing, and questions to you.
Complete syllabus
Every chapter and lesson
- 01
Chapter 1 · 3 lessons
Why Experiment at All
- 1.1
Correlation vs. causation
9 min · Quick check
- 1.2
What an A/B test really is
9 min · Quick check
- 1.3
When not to A/B test
8 min · Quick check
- 1.1
- 02
Chapter 2 · 3 lessons
Designing a Clean Test
- 2.1
Hypotheses & success metrics
9 min · Quick check
- 2.2
Randomisation & assignment
9 min · Quick check
- 2.3
Guardrail metrics
8 min · Quick check
- 2.1
- 03
Chapter 3 · 3 lessons
Sample Size & Power
- 3.1
Effect size & MDE
9 min · Quick check
- 3.2
Statistical power
9 min · Quick check
- 3.3
Calculating sample size
9 min · Quick check
- 3.1
- 04
Chapter 4 · 3 lessons
Reading the Results
- 4.1
p-values, the honest version
9 min · Quick check
- 4.2
Confidence intervals
9 min · Quick check
- 4.3
Significance vs. importance
9 min · Quick check
- 4.1
- 05
Chapter 5 · 3 lessons
Traps That Fool Smart Teams
- 5.1
Peeking & early stopping
9 min · Quick check
- 5.2
Multiple comparisons
9 min · Quick check
- 5.3
Novelty & sample-ratio bias
9 min · Quick check
- 5.1
- 06
Chapter 6 · 3 lessons
From Result to Decision
- 6.1
Segmenting results
9 min · Quick check
- 6.2
Writing the readout
9 min · Quick check
- 6.3
Ship, iterate or kill
9 min · Quick check
- 6.1