AI Engineer World's Fair 2026 — unofficial import demo

Bio

Harshul Jain is a Senior Software Engineer at Audible (Amazon) who builds ML and LLM infrastructure at scale — AI Search serving 10M users, a feature store processing 100K transactions per second, and LLM serving and evaluation systems powering GenAI in production. He is writing LLM Inference at Scale, a benchmark-driven handbook on GPU memory engineering, attention optimization, and production LLM serving backed by a companion repository that gained 100+ clones in its first week with zero promotion.

Sessions

• 2 hr deep dive on LLM Inference at Scale — Part 1 of 2Monday, June 29 · 12:10 PM – 1:10 PM · Track 3Workshops Day 1
• 2 hr deep dive on LLM Inference at Scale — Part 2 of 2Monday, June 29 · 1:15 PM – 2:15 PM · Track 3Workshops Day 1