Your Agent Is Lying to You About Whether It Worked
Dat Ngo
- When
- Tuesday, June 3012:05 PM – 12:25 PM · 20 min
- Where
- Expo Stage 1 NESan Francisco, CA · imported from ai.engineer's public schedule feed
About this session
Every span is green, every tool call returned cleanly, and the agent still regenerated the same plan 27 times before giving up invisible to any outcome metric, obvious in the trajectory. We pull up a real trace where the outcome looks healthy and the path is a disaster, then show Signal, our agent, surfacing it automatically: sweeping the project, ranking it above the noise, and linking straight to the offending trace with debugging evidence attached. The live version of the trajectory-over-outcomes argument, with a one-click path from "something's wrong" to "here's exactly where."
Speaker
AI Architect, Arize AI
Dat Ngo is an AI Architect at Arize AI focused on agent harnesses, evaluation, observability, and scalable LLM-evaluation pipelines for production AI systems.
For developers: this programme is open data — JSON, iCal, schedule XML and an MCP endpoint.Show endpointsHide
- JSONEvery published session and speaker, in one request./aie-worldsfair-2026-import/feed.json
- iCalSubscribe in Google, Apple or Outlook Calendar./aie-worldsfair-2026-import/feed.ics
- Schedule XMLfrab / pentabarf — the format conference apps import./aie-worldsfair-2026-import/feed.xml
- MCP + RESTPoint Claude at the programme. OpenAPI 3.1 included./agents
No key, no signup, CORS open. Everything here is generated from the same data the organisers edit.