scenario
A PM wants to ship the moment p < 0.05
Experimentation & A/B Testing · Readouts & Pitfalls · medium · Company-context scenario · 12 min
A PM watches the experiment dashboard daily and wants to ship as soon as it crosses p < 0.05. Beyond saying 'that's peeking,' explain the statistical cost and give a concrete design that lets them stop early safely.
Evaluation criteria
- States a clear recommendation
- Supports it with the right metrics or test design
- Names the trade-offs and risks
Detailed grading feedback appears after you submit.
Source
Company-context scenario built from real product constraints. It is not represented as a verbatim interview question.
Your answer
You get one graded attempt here without an account. Create a free account for unlimited attempts, saved progress and community write-ups.
Answers stay hidden until you ask. Reveal the full model write-up when you are ready to compare.