Pro question

Build a golden evaluation set for an agent

AI Agents & Automation · Agent Evaluation · medium · Company-context scenario · 15 min

You're standing up evaluation for a new AI coding/support agent.

This question is part of Pro

The prompt, fixtures, grading criteria and model write-up stay on the server until your plan unlocks them.

Source

Company-context scenario built from real product constraints. It is not represented as a verbatim interview question.

Community

There is rarely one right query or one right framing. Read how others approached it, and share your own once you have submitted an answer.

Reading is open to everyone. Sign in to share your approach or mark a write-up as helpful.

Loading write-ups…