Uplift

scenario

Metrics to judge a support agent rollout

AI Agents & Automation · LLM Product Metrics · medium · Original Uplift question · 15 min

Your company will roll out an AI support agent that answers billing questions. Choose the primary metric, two guardrails, and one leading indicator. Explain what result would make you roll it back.

Evaluation criteria

  • States a clear recommendation
  • Supports it with the right metrics or test design
  • Names the trade-offs and risks

Detailed grading feedback appears after you submit.

    Source

    Original Uplift question based on a common interview pattern.

    Your answer

    You get one graded attempt here without an account. Create a free account for unlimited attempts, saved progress and community write-ups.

    Answers stay hidden until you ask. Reveal the full model write-up when you are ready to compare.

    Community

    How other people solved this

    There is rarely one right query or one right framing. Read how others approached it, and share your own once you have submitted an answer.

    Reading is open to everyone. Sign in to share your approach or mark a write-up as helpful.

    Loading write-ups…