Computer-use models will agentify the web, not APIs
Dhruv Batra
- When
- Wednesday, July 110:45 AM – 11:05 AM · 20 min
- Where
- Track 7San Francisco, CA · imported from ai.engineer's public schedule feed
About this session
We are rushing towards a world where every single digital surface (email, calendar, messaging, …, every desktop app, every phone app, every web app) that was previously meant for humans is now managed by AI agents. Of course, there are technical challenges to be solved: - Model context windows haven’t increased in 2 years. And the digital world is OOMs bigger (the ultimate “big world hypothesis”) anyway, so how does one architect this? - A large part of the digital world (most of the web) does not have APIs available and requires agents to act like humans (consume pixels, output keyboard/mouse actions). - Human preferences and the digital world change, and require agents to maintain a dynamic memory and continually learn. But even if we could solve these problems, what does this world look like? - The digital world, particularly the web, was built for human consumption (and is often hostile to bots). - For a while to come, we will be sharing the digital roadways with these digital robots. - What does end-to-end encryption and privacy mean when the other “end” of the communication is an AI agent? The Yutori team has spent the last year building the world’s best computer use model (slightly better than Opus 4.6 and GPT 5.4 while being 2x faster and 4-5x cheaper on browser use tasks), converted the web into a webhook with Scouts (agents that monitor the web 24/7 for anything you care about), and are now releasing Yutori agent that expands from the open web to your most common digital surfaces. This talk will be grounded in Yutori’s learning from what it takes to build agents that are always on, taking us one step closer to the world where every digital surface is their playground.
Speaker
Co-founder & Chief Scientist, Yutori
Dhruv Batra is a co-founder and the Chief Scientist of Yutori, building web agents. Before this, he was a Senior Director at Meta leading FAIR Embodied AI, and an Associate Professor at Georgia Tech. He received the 2019 Presidential early career award for scientists and engineers (PECASE) from the White House for his work on explainable AI and neural network interpretability. He and his collaborators received the 2025 Mark Everingham Prize for their 2015 work on Visual Question Answering that established "a new strand of vision and language research.” He is a recipient of best paper awards/nominations in every area of AI (vision, NLP, ML, robotics).
More in Computer Use
- Computer Use at the Edge of the Statistical PrecipiceWednesday, July 1 · 11:10 AM – 11:30 AM · Track 7
- Bringing agents onto the world wide webWednesday, July 1 · 11:40 AM – 12:00 PM · Track 7
- The Dark Arts of Web Automation: Teaching Agents to Use Websites Like HumansWednesday, July 1 · 12:05 PM – 12:25 PM · Track 7
- From RL to IRLWednesday, July 1 · 1:30 PM – 1:50 PM · Track 7
- The Rise of CaaS: Context-as-a-Service for Agentic AIWednesday, July 1 · 1:55 PM – 2:15 PM · Track 7
For developers: this programme is open data — JSON, iCal, schedule XML and an MCP endpoint.Show endpointsHide
- JSONEvery published session and speaker, in one request./aie-worldsfair-2026-import/feed.json
- iCalSubscribe in Google, Apple or Outlook Calendar./aie-worldsfair-2026-import/feed.ics
- Schedule XMLfrab / pentabarf — the format conference apps import./aie-worldsfair-2026-import/feed.xml
- MCP + RESTPoint Claude at the programme. OpenAPI 3.1 included./agents
No key, no signup, CORS open. Everything here is generated from the same data the organisers edit.