June 29 – July 2, 2026 · San Francisco, CA · imported from ai.engineer's public schedule feed

AI Engineer World's Fair 2026 — unofficial import demo

Unofficial demo. This programme was imported from the AI Engineer World's Fair's own public schedule feed to show vibeboard at real conference scale. Not affiliated with, or endorsed by, the organisers.

All sessions
InferenceSession

All the Things We Have to Do to Satisfy Your Insatiable Need for Tokens

Daniel Kim, Michelle Nguyen

When
Thursday, July 211:40 AM – 12:00 PM · 20 min
Where
Leadership 1San Francisco, CA · imported from ai.engineer's public schedule feed
Google Calendar

About this session

Every time the industry figures out how to serve tokens faster and cheaper, the appetite grows to match. Models get bigger, contexts get longer, agents start chaining thousands of calls together. The finish line keeps moving. This talk is a technical tour through everything the industry has done to keep up, led by two experts in high-performance inference. We'll start with the optimizations that made hardware work harder without changing the underlying architecture. Then we'll go up a level with techniques that work smarter across requests and across the model itself. And finally, a peek into the future with heterogeneous disaggregated inference, the architectural shift that splits prefill and decode across specialized hardware, and even more advanced forms of hardware specialization coming your way soon. Token demand is about to get a lot more insatiable. Let's see what the future has in store for us!

Speakers (2)

Daniel Kim
Daniel Kim

Head of Growth, Cerebras

Daniel Kim works on large-scale inference systems at Cerebras, which runs the world's fastest AI inference on the Wafer-Scale Engine (WSE-3), the largest chip ever built. More recently, Daniel has turned to building AI agents that accelerate Cerebras's own hardware and software development. Outside of work, you can find him relaxing in the park, eating spicy noodles, and recently running!

Michelle Nguyen
Michelle Nguyen

Co-Founder, Gimlet Labs

Michelle Nguyen is cofounder of Gimlet Labs, the first multi-silicon inference cloud to run agentic workloads across different types of hardware, where she leads engineering. She was the first engineer at Pixie Labs where she worked across the stack on projects ranging from Pixie's deployment mechanisms to its distributed query engine. Before Pixie, Michelle was at Trifacta helping build intuitive and interactive UIs. Michelle holds a MS and BS in EECS from UC Berkeley.

More in Inference