Pro question

Wins in every segment, loses overall

Experimentation & A/B Testing · Readouts & Pitfalls · medium · Company-context scenario · 6 min

Your treatment beats control in BOTH the mobile segment and the desktop segment, yet loses when you pool all users together.

This question is part of Pro

The prompt, fixtures, grading criteria and model write-up stay on the server until your plan unlocks them.

Source

Company-context scenario built from real product constraints. It is not represented as a verbatim interview question.

Community

How other people solved this

There is rarely one right query or one right framing. Read how others approached it, and share your own once you have submitted an answer.

Reading is open to everyone. Sign in to share your approach or mark a write-up as helpful.

Loading write-ups…