Perception Agents
Antje Barth
- When
- Wednesday, July 19:45 AM – 10:05 AM · 20 min
- Where
- Main StageSan Francisco, CA · imported from ai.engineer's public schedule feed
About this session
Human-agent collaboration is changing, becoming more visual. The agents most teams ship today still wait for us to type a paragraph to explain what we're looking at. They cannot see a screen, navigate a UI that changes, or recover when an application throws an unexpected modal. That is the architectural gap between agents that demo well and agents that work alongside real teams in real software. Perception agents close it. They see and use computers the way people do, reason about what they see, and act with clicks and keystrokes.
Speaker
Member of Technical Staff, Amazon AGI Lab
Member of Technical Staff at Amazon AGI, AI product leader, keynote speaker, and O'Reilly author. She also co-instructed Generative AI with Large Language Models with DeepLearning.AI.
More in Autoresearch
- Field Guide to FableWednesday, July 1 · 9:05 AM – 9:25 AM · Main Stage
- Research to Reality with Google DeepMindWednesday, July 1 · 10:05 AM – 10:25 AM · Main Stage
- Evals Track IntroWednesday, July 1 · 10:25 AM – 10:30 AM · Main Stage
- First Steps Toward Automated AI ResearchWednesday, July 1 · 10:45 AM – 11:05 AM · Main Stage
- Autoresearch for Dense Retrieval: Test-Time Compute with Frozen Embedding ModelsWednesday, July 1 · 11:10 AM – 11:30 AM · Main Stage
For developers: this programme is open data — JSON, iCal, schedule XML and an MCP endpoint.Show endpointsHide
- JSONEvery published session and speaker, in one request./aie-worldsfair-2026-import/feed.json
- iCalSubscribe in Google, Apple or Outlook Calendar./aie-worldsfair-2026-import/feed.ics
- Schedule XMLfrab / pentabarf — the format conference apps import./aie-worldsfair-2026-import/feed.xml
- MCP + RESTPoint Claude at the programme. OpenAPI 3.1 included./agents
No key, no signup, CORS open. Everything here is generated from the same data the organisers edit.