Uplift

multiple choice

Why peeking inflates false positives

Experimentation & A/B Testing · Readouts & Pitfalls · easy · Original Uplift question · 5 min

A PM checks the experiment dashboard every morning and wants to ship as soon as p < 0.05. What is the main problem with this policy?

Evaluation criteria

  • Picks the option the reasoning in the prompt supports

Detailed grading feedback appears after you submit.

    Source

    Original Uplift question based on a common interview pattern.

    Your answer

    Options

    You get one graded attempt here without an account. Create a free account for unlimited attempts, saved progress and community write-ups.

    Answers stay hidden until you ask. Reveal the full model write-up when you are ready to compare.

    Community

    How other people solved this

    There is rarely one right query or one right framing. Read how others approached it, and share your own once you have submitted an answer.

    Reading is open to everyone. Sign in to share your approach or mark a write-up as helpful.

    Loading write-ups…