Vending-Bench: Long-Horizon Agent Evals for a Simulated Vending Business
Lukas Petersson
- When
- Wednesday, July 110:45 AM – 11:05 AM · 20 min
- Where
- Track 5San Francisco, CA · imported from ai.engineer's public schedule feed
About this session
Long-horizon agent evals via a simulated vending machine business, testing negotiation, pricing, and supplier management over 365 days.
Speaker
Co-Founder, Andon Labs
Lukas Petersson is co-founder of Andon Labs, testing AIs in the real world. Andon OS is our stack for letting AI agents run businesses safely without any humans in the loop. Today, we operate vending machines, retail stores, cafés, embroidery and software companies, but the list grows every day. Andon partners with all four frontier AI labs (Anthropic, OpenAI, Google, xAI) to test their AI models in real-world scenarios; its Project Vend collaboration with Anthropic was covered by WSJ, Time, and 60 Minutes, and its Vending-Bench benchmark runs at every major model release.
More in Evals
- From Signal to PR: Anatomy of a Self-Improving AgentWednesday, July 1 · 11:10 AM – 11:30 AM · Track 5
- Building Closed-Loop Evals for a Multimodal Agent at Uber ScaleWednesday, July 1 · 11:40 AM – 12:00 PM · Track 5
- From Agent Traces to Agent Simulations: The next era of agent evaluationWednesday, July 1 · 12:05 PM – 12:25 PM · Track 5
- Model Whisperers: How Evals and Prompts Shape Agent BehaviorWednesday, July 1 · 1:30 PM – 1:50 PM · Track 5
- Evaling Video SlopWednesday, July 1 · 1:55 PM – 2:15 PM · Track 5
For developers: this programme is open data — JSON, iCal, schedule XML and an MCP endpoint.Show endpointsHide
- JSONEvery published session and speaker, in one request./aie-worldsfair-2026-import/feed.json
- iCalSubscribe in Google, Apple or Outlook Calendar./aie-worldsfair-2026-import/feed.ics
- Schedule XMLfrab / pentabarf — the format conference apps import./aie-worldsfair-2026-import/feed.xml
- MCP + RESTPoint Claude at the programme. OpenAPI 3.1 included./agents
No key, no signup, CORS open. Everything here is generated from the same data the organisers edit.