June 29 – July 2, 2026 · San Francisco, CA · imported from ai.engineer's public schedule feed

AI Engineer World's Fair 2026 — unofficial import demo

Unofficial demo. This programme was imported from the AI Engineer World's Fair's own public schedule feed to show vibeboard at real conference scale. Not affiliated with, or endorsed by, the organisers.

All sessions
Voice & Realtime AISession

Act, Confirm, or Stop? Smarter behavior for AI assistants, wearables & robots

Amit Desai

When
Tuesday, June 303:45 PM – 4:05 PM · 20 min
Where
Track 6San Francisco, CA · imported from ai.engineer's public schedule feed
Google Calendar

About this session

Voice is our favorite way to command AI assistants and robots — and it is error-prone. The industry's reflex is to chase accuracy, but accuracy is only one knob: we can control system behavior in other ways to increase user satisfaction.

This talk shifts the lens from accuracy to user outcomes. Give the AI agent more than one move: besides acting, let it stop, reject, confirm, clarify, or disambiguate. The question stops being "how often are we right?" and becomes "what does each outcome cost the user?" Bad outcomes are not equally bad to users — so price them relatively, then have the AI system minimize that user cost. Call it OUCH: Outcome User Cost Heuristic; we optimize system behavior to minimize the OUCH. Same accuracy, lower user cost, greater user adoption.

We will walk through practical AI assistant examples illustrating this approach, then show how the same framework extends across AI environments — smart speakers, TVs, glasses, embodied AI, robots, wearables, and vehicles — by repricing outcomes and swapping the confirmation UI.

Why this matters now: the cost of voice-command errors is escalating as we move into AI assistants and embodied AI, where wrong actions can be more expensive and dangerous. Mainstream voice adoption will not come from chasing accuracy alone; we need systems to price in the cost of being wrong.

Speaker

Amit Desai
Amit Desai

Director, Voice & Assistant AI, Roku

Amit Desai is a domain expert in voice AI assistants who has led voice AI products at Alexa and Roku, founded startups in customer support AI, and created Top 5 mobile apps in the App Store. He works at the intersection of voice-interface intuition and AI technical approaches, with a current focus on safer voice interfaces for AI assistants, wearables, robotics, and vehicles.

More in Voice & Realtime AI