multiple choice

Which success metric reflects the user's experience

AI Agents & Automation · LLM Product Metrics · easy · Company-context scenario · 6 min

An agent solves 70% of tasks on the first attempt and 90% within three attempts. For a user who just wants their task done (and will retry if needed), which framing best reflects their real experience — and what's the catch with the higher number?

Evaluation criteria

  • Picks the option the reasoning in the prompt supports

Detailed grading feedback appears after you submit.

Source

Company-context scenario built from real product constraints. It is not represented as a verbatim interview question.

Your answer

Options

You get one graded attempt here without an account. Create a free account for unlimited attempts, saved progress and community write-ups.

Answers stay hidden until you ask. Reveal the full model write-up when you are ready to compare.

Community

How other people solved this

There is rarely one right query or one right framing. Read how others approached it, and share your own once you have submitted an answer.

Reading is open to everyone. Sign in to share your approach or mark a write-up as helpful.

Loading write-ups…