multiple choice

Choose the honest activation metric

Product Analytics & Metrics · Retention & Activation · easy · Reported interview question · 6 min

An onboarding change raises the percentage of signups completing setup from 40% to 60%, but the number of users completing the product's core action within seven days is unchanged and D28 retention is unchanged. Which conclusion is best?

Evaluation criteria

Picks the option the reasoning in the prompt supports

Detailed grading feedback appears after you submit.

Source

Adapted from a publicly reported interview question on DataLemur(opens in a new tab).

Your answer

A. Setup completion improved, but evidence of meaningful activation did not; investigate whether setup is only a proxyB. D28 retention is too delayed to matterC. Replace the denominator with setup completers to show the gainD. Activation improved by 50%, so ship globally

You get one graded attempt here without an account. Create a free account for unlimited attempts, saved progress and community write-ups.

Answers stay hidden until you ask. Reveal the full model write-up when you are ready to compare.

Choose the honest activation metric

Evaluation criteria

Source

Your answer

How other people solved this