All sessions
AI Architects: Show my WorkflowSession
When Will The Benchmaxxing Plague End?
Nick Heiner
- When
- Tuesday, June 302:50 PM – 3:10 PM · 20 min
- Where
- Track 9San Francisco, CA · imported from ai.engineer's public schedule feed
About this session
Model releases are heralded by a flourish of trumpets, a chorus of weeping angels, and often, inflated benchmark claims. Why do benchmarks so often not reflect real-world value? Is it intrinsic to the science of benchmarking, or just the consequence of our current practices? Is LM Arena a cancer on AI?
Speaker
Nick Heiner
VP of RL Environments, Surge AI
Nick Heiner is the Head of RL Environments at Surge AI, the post-training company founded and bootstrapped to $1B in revenue by CEO Edwin Chen, where he works directly with top labs to help shape frontier models.
More in AI Architects: Show my Workflow
- Your Agent Evolved. Your Evals Didn't.Tuesday, June 30 · 11:10 AM – 11:30 AM · Leadership 2
- The Last Human Code Review: Building Trust in AI-Generated CodeTuesday, June 30 · 11:40 AM – 12:00 PM · Leadership 2
- Prototyping as Leadership: How a CTO Ships with AI AgentsTuesday, June 30 · 12:05 PM – 12:25 PM · Leadership 2
- Serving 2 Million Models Without Melting: Scaling the Hugging Face HubTuesday, June 30 · 1:30 PM – 1:50 PM · Leadership 2
- IT Admin for the AI Workforce: Why Your AI Agents Will Need Their Own IT DepartmentTuesday, June 30 · 1:55 PM – 2:15 PM · Leadership 2
For developers: this programme is open data — JSON, iCal, schedule XML and an MCP endpoint.Show endpointsHide
- JSONEvery published session and speaker, in one request./aie-worldsfair-2026-import/feed.json
- iCalSubscribe in Google, Apple or Outlook Calendar./aie-worldsfair-2026-import/feed.ics
- Schedule XMLfrab / pentabarf — the format conference apps import./aie-worldsfair-2026-import/feed.xml
- MCP + RESTPoint Claude at the programme. OpenAPI 3.1 included./agents
No key, no signup, CORS open. Everything here is generated from the same data the organisers edit.