Catalog
8 branches of analytics, product and AI interview questions
Explore eight skill tracks, called branches, filterable by subtopic, company, tool and difficulty. SQL questions run against sample tables, choice and numeric answers are checked instantly, and written cases are scored against evaluation criteria.
Filters (1)
Branches
Subtopics
Access
Free onlyQuestion type
Type to find a company, then pick it from the list below.
Tool
15 questions
Catching agent regressions before release
Prevent shipped updates from breaking tasks that used to work.
Quick check · Evaluation · 6 min · Easy
AI Agents & Automation · Original Uplift question
Cost per resolved ticket for an AI agent
Compute unit economics for an AI support agent.
Calculation · Product metrics · 5 min · Easy
AI Agents & Automation · Original Uplift question
Metrics to judge a support agent rollout
Choose the scoreboard for an AI support agent.
Written case · Product metrics · 15 min · Medium
AI Agents & Automation · Original Uplift question
Demo-day agent, churning users
ProDiagnose why a high-scoring agent loses real users.
Written case · Evaluation · Python · 20 min · Medium
AI Agents & Automation · Original Uplift question
Offline vs online evaluation
You're shipping an AI support agent.
Quick check · Evaluation · 6 min · Medium
AI Agents & Automation · Company-context scenario
Risks of using an LLM to grade your agent
ProYour team uses a strong LLM to automatically grade your agent's outputs ('LLM-as-judge') at scale.
Written case · Evaluation · 15 min · Medium
AI Agents & Automation · Company-context scenario
Build a golden evaluation set for an agent
ProYou're standing up evaluation for a new AI coding/support agent.
Written case · Evaluation · 15 min · Medium
AI Agents & Automation · Company-context scenario
Measuring groundedness in a RAG system
ProYour retrieval-augmented (RAG) assistant sometimes states facts not supported by the retrieved documents.
Quick check · Product metrics · 6 min · Medium
AI Agents & Automation · Company-context scenario
The scoreboard for a customer-facing agent
ProYou launched an AI agent that can take actions (issue refunds, change orders) for customers.
Written case · Product metrics · 15 min · Medium
AI Agents & Automation · Company-context scenario
Which success metric reflects the user's experience
An agent solves 70% of tasks on the first attempt and 90% within three attempts.
Quick check · Product metrics · 6 min · Easy
AI Agents & Automation · Company-context scenario
Design an AI travel-itinerary assistant
As the product manager at Booking.com, design a generative-AI assistant that creates personalized travel itineraries using destination, activity, and accommodation preferences.
Written case · Product metrics · 20 min · Medium
AI Agents & Automation · Reported at Booking.com
Choose one agent or a multi-agent system
ProYou are designing a research workflow that must search sources, extract evidence, draft a report, and verify citations.
Written case · Evaluation · 20 min · Hard
AI Agents & Automation · Reported interview question
Defend a tool-using agent from prompt injection
ProAn email assistant can read messages, search internal documents, draft replies, and create calendar events.
Written case · Evaluation · 22 min · Hard
AI Agents & Automation · Reported interview question
Choose the right approval boundary
A finance agent can read invoices, prepare payments, and submit them to the bank.
Quick check · Product metrics · 7 min · Easy
AI Agents & Automation · Reported interview question
Expected cost of an agent routing policy
ProAn agent handles 10,000 tasks per month.
Calculation · Product metrics · 12 min · Medium
AI Agents & Automation · Reported interview question