AI Agent Evals FAQ: Methodology from 700+ Engineers
Hamel Husain and Shreya Shankar present a practical FAQ on AI agent evals, emphasizing discovering failures before building evaluation infrastructure. The guide, based on insights from over 700 engineers, challenges the mainstream narrative of focusing on dashboards and LLM-as-a-Judge.