AI Agent Tradeoffs: What Evals Catch and Reading Traces Reveal

Sergiy Dybskiy’s schedule assistant invented “Chris Hagen, Founder of Stability AI” as a speaker, then said the name came from a tool returning only track names. Every signal said the run was fine: 44 calls, 0 errors, under a cent. Evals catch known bugs; traces find the rest.