June 29 – July 2, 2026 · San Francisco, CA · imported from ai.engineer's public schedule feed

AI Engineer World's Fair 2026 — unofficial import demo

Unofficial demo. This programme was imported from the AI Engineer World's Fair's own public schedule feed to show vibeboard at real conference scale. Not affiliated with, or endorsed by, the organisers.

All sessions
AI Architects: Show my WorkflowSession

Your Agent Evolved. Your Evals Didn't.

Ameya Bhatawdekar

When
Tuesday, June 3011:10 AM – 11:30 AM · 20 min
Where
Leadership 2San Francisco, CA · imported from ai.engineer's public schedule feed
Google Calendar

About this session

Knowing which generation your agent is in, which failure modes your current evals are blind to, and what to build next is the difference between shipping with confidence and flying blind. Agent architectures have evolved through six generations; prompt, chain, ReAct loop, workflow graph, modern agent loop, AI harness. And each one quietly breaks the eval strategy of the generation before it. A prompt-quality rubric won't catch a bad tool call; a trace scorer won't catch memory poisoning. Using a single SRE incident response agent threaded through every generation, this talk shows exactly where each architecture outgrows its evals and what you need to close the gap.

Speaker

Ameya Bhatawdekar
Ameya Bhatawdekar

VP, Field CTO, Braintrust

Ameya Bhatawdekar is VP, Field CTO at Braintrust, where he helps teams evaluate and observe production AI systems. He previously led machine learning work at Dropbox and focuses on making AI-powered features reliable through evals and observability.

More in AI Architects: Show my Workflow