Catalog
8 branches of analytics, product and AI interview questions
Explore eight skill tracks, called branches, filterable by subtopic, company, tool and difficulty. SQL questions run against sample tables, choice and numeric answers are checked instantly, and written cases are scored against evaluation criteria.
Filters (2)
Branches
Subtopics
Access
Free onlyQuestion type
Type to find a company, then pick it from the list below.
Tool
9 questions
Metrics to judge a support agent rollout
Choose the scoreboard for an AI support agent.
Written case · Product metrics · 15 min · Medium
AI Agents & Automation · Original Uplift question
Demo-day agent, churning users
ProDiagnose why a high-scoring agent loses real users.
Written case · Evaluation · Python · 20 min · Medium
AI Agents & Automation · Original Uplift question
Offline vs online evaluation
You're shipping an AI support agent.
Quick check · Evaluation · 6 min · Medium
AI Agents & Automation · Company-context scenario
Risks of using an LLM to grade your agent
ProYour team uses a strong LLM to automatically grade your agent's outputs ('LLM-as-judge') at scale.
Written case · Evaluation · 15 min · Medium
AI Agents & Automation · Company-context scenario
Build a golden evaluation set for an agent
ProYou're standing up evaluation for a new AI coding/support agent.
Written case · Evaluation · 15 min · Medium
AI Agents & Automation · Company-context scenario
Measuring groundedness in a RAG system
ProYour retrieval-augmented (RAG) assistant sometimes states facts not supported by the retrieved documents.
Quick check · Product metrics · 6 min · Medium
AI Agents & Automation · Company-context scenario
The scoreboard for a customer-facing agent
ProYou launched an AI agent that can take actions (issue refunds, change orders) for customers.
Written case · Product metrics · 15 min · Medium
AI Agents & Automation · Company-context scenario
Design an AI travel-itinerary assistant
As the product manager at Booking.com, design a generative-AI assistant that creates personalized travel itineraries using destination, activity, and accommodation preferences.
Written case · Product metrics · 20 min · Medium
AI Agents & Automation · Reported at Booking.com
Expected cost of an agent routing policy
ProAn agent handles 10,000 tasks per month.
Calculation · Product metrics · 12 min · Medium
AI Agents & Automation · Reported interview question