Voice Agents Can Just Do Things
Charlie Guo
- When
- Tuesday, June 3011:40 AM – 12:00 PM · 20 min
- Where
- Track 6San Francisco, CA · imported from ai.engineer's public schedule feed
About this session
Too many voice AI integrations still treat speech as fancier chat: audio in, audio out. But we're at a point where speech can be a control plane for software, and most developers are unaware that voice has become a capability overhang. Current realtime models can understand intent, call tools, speak while work is underway, recover from corrections, and decide what the user actually needs to hear. As a result, we're seeing three practical patterns emerge: voice-to-action, systems-to-voice, and voice-to-voice. We’ll show how each pattern changes the architecture, where Realtime 2’s reasoning and tool-calling matter, and why chained STT / LLM / TTS systems start to break down as the interaction patterns become richer.
Speaker
Developer Experience Engineer, OpenAI
Charlie Guo is a Developer Experience Engineer at OpenAI, where he helps developers build with the OpenAI API. He is also the author of Artificial Ignorance, an AI publication at the intersection of engineering and intelligence. Before joining OpenAI, Charlie spent more than a decade building products and internal tools, including as a startup founder. He is based in Berkeley, California.
More in Voice & Realtime AI
- The New Primitives: Building AI-Native SoftwareTuesday, June 30 · 10:45 AM – 11:05 AM · Track 6
- Speech-to-Speech Model Research at Google DeepMindTuesday, June 30 · 11:10 AM – 11:30 AM · Track 6
- Tolan: Voice-First AI CompanionTuesday, June 30 · 1:30 PM – 1:50 PM · Track 6
- 5 Voice Agent Failure Modes You'll Hit in Week OneTuesday, June 30 · 1:55 PM – 2:15 PM · Track 6
- I Monitored Crime Audio. Voice Agents Scare Me More.Tuesday, June 30 · 2:25 PM – 2:45 PM · Track 6
For developers: this programme is open data — JSON, iCal, schedule XML and an MCP endpoint.Show endpointsHide
- JSONEvery published session and speaker, in one request./aie-worldsfair-2026-import/feed.json
- iCalSubscribe in Google, Apple or Outlook Calendar./aie-worldsfair-2026-import/feed.ics
- Schedule XMLfrab / pentabarf — the format conference apps import./aie-worldsfair-2026-import/feed.xml
- MCP + RESTPoint Claude at the programme. OpenAPI 3.1 included./agents
No key, no signup, CORS open. Everything here is generated from the same data the organisers edit.