scenario
Test a new shoppable-ad ranking model
Experimentation & A/B Testing · Design & Power · medium · Reported at Meta · 20 min
Meta has a new ranking model for shoppable-feed ads. Design an experiment to decide whether it is better than the current model. Choose the randomization unit, primary and guardrail metrics, sample-size inputs, and decision rule. Address interference across viewers and advertisers.
Evaluation criteria
- States a clear recommendation
- Supports it with the right metrics or test design
- Names the trade-offs and risks
Detailed grading feedback appears after you submit.
Source
Adapted from a reported Meta interview question on DataLemur(opens in a new tab).
Your answer
You get one graded attempt here without an account. Create a free account for unlimited attempts, saved progress and community write-ups.
Answers stay hidden until you ask. Reveal the full model write-up when you are ready to compare.