numeric

False-positive risk across four variants

Experimentation & A/B Testing · Design & Power · medium · Reported interview question · 10 min

You compare four independent treatment variants with one control. Each treatment-versus-control test uses alpha = 0.05, and assume the four tests are independent. Under the global null, what is the probability of at least one false positive? Give a percentage rounded to two decimals. Answer as a percentage, for example 12.34.

Evaluation criteria

  • Uses 1 minus the probability of zero false positives
  • Uses the correct method or distribution
  • Shows the calculation
  • Rounds as the prompt asks

Detailed grading feedback appears after you submit.

Source

Adapted from a publicly reported interview question on StrataScratch(opens in a new tab).

Your answer

%

Commas, currency symbols and a trailing percent sign are fine. Answers within ±0.15 % of the expected value are accepted.

You get one graded attempt here without an account. Create a free account for unlimited attempts, saved progress and community write-ups.

Answers stay hidden until you ask. Reveal the full model write-up when you are ready to compare.

Community

How other people solved this

There is rarely one right query or one right framing. Read how others approached it, and share your own once you have submitted an answer.

Reading is open to everyone. Sign in to share your approach or mark a write-up as helpful.

Loading write-ups…