From RL to IRL
Gaurav Mishra
- When
- Wednesday, July 11:30 PM – 1:50 PM · 20 min
- Where
- Track 7San Francisco, CA · imported from ai.engineer's public schedule feed
About this session
Today's agents have to operate in a messy reality of flaky connections, ephemeral credentials, and irreversible actions. They need to navigate real software the way humans do: recovering from failures, learning from feedback, and making sound judgment calls. This talk is about the fundamental changes in RL required to make agents ready for IRL. We'll walk through what it takes for training environments to reflect the complexity of the real world, the perception primitives that let an agent see what a user sees, the harness pieces that help it survive contact with real applications, and the failure modes you only discover when you stop scoring and start shipping.
Speaker
Amazon AGI Lab
More in Computer Use
- Computer-use models will agentify the web, not APIsWednesday, July 1 · 10:45 AM – 11:05 AM · Track 7
- Computer Use at the Edge of the Statistical PrecipiceWednesday, July 1 · 11:10 AM – 11:30 AM · Track 7
- Bringing agents onto the world wide webWednesday, July 1 · 11:40 AM – 12:00 PM · Track 7
- The Dark Arts of Web Automation: Teaching Agents to Use Websites Like HumansWednesday, July 1 · 12:05 PM – 12:25 PM · Track 7
- The Rise of CaaS: Context-as-a-Service for Agentic AIWednesday, July 1 · 1:55 PM – 2:15 PM · Track 7
For developers: this programme is open data — JSON, iCal, schedule XML and an MCP endpoint.Show endpointsHide
- JSONEvery published session and speaker, in one request./aie-worldsfair-2026-import/feed.json
- iCalSubscribe in Google, Apple or Outlook Calendar./aie-worldsfair-2026-import/feed.ics
- Schedule XMLfrab / pentabarf — the format conference apps import./aie-worldsfair-2026-import/feed.xml
- MCP + RESTPoint Claude at the programme. OpenAPI 3.1 included./agents
No key, no signup, CORS open. Everything here is generated from the same data the organisers edit.