5 Voice Agent Failure Modes You'll Hit in Week One
Venky B, Vyas A
- When
- Tuesday, June 301:55 PM – 2:15 PM · 20 min
- Where
- Track 6San Francisco, CA · imported from ai.engineer's public schedule feed
About this session
Building a voice agent that demos well is easy now. The hard part starts the second a real person calls it. Most voice agents today are basically a chatbot with a microphone bolted on, they listen, then think, then talk, one side at a time, like a walkie talkie. Real conversations don't work that way. People pause in the middle of a thought, they say "um" and "uh", they talk over you, they change their mind halfway through. The agent has to work out when you're actually done talking, when it should stop talking, and when you've said something it cannot afford to get wrong, like your phone number or email. None of this shows up when you test with text. All of it shows up in week one.
This talk is the five failures that hit every team in that first week, the ones we see again and again. For each case we will walk though examples and best practices for what actually breaks and what to do about it. If you're about to put a voice agent in front of real callers, or you already did and it's quietly falling apart, this is the talk that saves you the weeks everyone else burns figuring it out
Speakers (2)
Founder & CEO, Plivo
Founder and CEO of Plivo, a developer platform for building voice and messaging AI agents. Plivo powers thousands of businesses worldwide, from fast-growing startups to Fortune 500 enterprises.
Head of Product, Plivo
Leads Product at Plivo - the developer platform for building voice and messaging agents. His work spans product, growth and developer experience.
More in Voice & Realtime AI
- The New Primitives: Building AI-Native SoftwareTuesday, June 30 · 10:45 AM – 11:05 AM · Track 6
- Speech-to-Speech Model Research at Google DeepMindTuesday, June 30 · 11:10 AM – 11:30 AM · Track 6
- Voice Agents Can Just Do ThingsTuesday, June 30 · 11:40 AM – 12:00 PM · Track 6
- Tolan: Voice-First AI CompanionTuesday, June 30 · 1:30 PM – 1:50 PM · Track 6
- I Monitored Crime Audio. Voice Agents Scare Me More.Tuesday, June 30 · 2:25 PM – 2:45 PM · Track 6
For developers: this programme is open data — JSON, iCal, schedule XML and an MCP endpoint.Show endpointsHide
- JSONEvery published session and speaker, in one request./aie-worldsfair-2026-import/feed.json
- iCalSubscribe in Google, Apple or Outlook Calendar./aie-worldsfair-2026-import/feed.ics
- Schedule XMLfrab / pentabarf — the format conference apps import./aie-worldsfair-2026-import/feed.xml
- MCP + RESTPoint Claude at the programme. OpenAPI 3.1 included./agents
No key, no signup, CORS open. Everything here is generated from the same data the organisers edit.