Build with Perception Agents
Emile Baizel, Shruti Arora
- When
- Monday, June 292:20 PM – 4:20 PM · 120 min
- Where
- Track 8San Francisco, CA · imported from ai.engineer's public schedule feed
About this session
Human-agent collaboration is changing, becoming more visual. Models can perceive, point, and verify, but most agents still rely on us typing a paragraph to explain what we're looking at. Meet perception agents: computer use agents that see screens how you see screens. They understand, reason, and verify their own work. They let you point, draw, and describe, just as people collaborate in real life. We call this shared perception, and at AGI Lab we just open-sourced the first two primitives of our perception agent harness: visual verification and visual annotation. In this workshop, you'll get hands-on with both, build one sample use case end-to-end, then take the primitives back to your day-to-day in a mini hackathon. Best ideas win prizes.
Speakers (2)
Amazon AGI Lab
Emile Baizel is with Amazon AGI Lab and is co-presenting the “Build with Perception Agents” workshop at AI Engineer World’s Fair 2026.
Member of Technical Staff and Customer Engagement, Amazon AGI Lab
Shruti Arora is with Amazon AGI Lab and is co-presenting the “Build with Perception Agents” workshop at AI Engineer World’s Fair 2026.
More in Workshops Day 1
- Cooking with CodexMonday, June 29 · 9:00 AM – 11:00 AM · Track 3
- The best SDLC is the one you build yourself: Why orchestration changes everythingMonday, June 29 · 9:00 AM – 11:00 AM · Track 4
- AI Security Engineer Foundations + CertificateMonday, June 29 · 9:00 AM – 11:00 AM · Track 5
- Total Recall: Agent Memory and Harness EngineeringMonday, June 29 · 9:00 AM – 11:00 AM · Track 6
- Open-Source Inference Engineering for the Agentic EraMonday, June 29 · 9:00 AM – 11:00 AM · Track 8
For developers: this programme is open data — JSON, iCal, schedule XML and an MCP endpoint.Show endpointsHide
- JSONEvery published session and speaker, in one request./aie-worldsfair-2026-import/feed.json
- iCalSubscribe in Google, Apple or Outlook Calendar./aie-worldsfair-2026-import/feed.ics
- Schedule XMLfrab / pentabarf — the format conference apps import./aie-worldsfair-2026-import/feed.xml
- MCP + RESTPoint Claude at the programme. OpenAPI 3.1 included./agents
No key, no signup, CORS open. Everything here is generated from the same data the organisers edit.