Benchmarking VS Code with VSC-Bench: How to measure agent performance
Ross Wollman
- When
- Thursday, July 211:40 AM – 12:00 PM · 20 min
- Where
- Track MSan Francisco, CA · imported from ai.engineer's public schedule feed
About this session
"Agent quality in VS Code depends on a stack of variables: model, version, prompts, extensions, MCP servers, and more. Each one affects quality, tokens, and latency—and they interact in ways that are hard to reason about.
In this session, we’ll show how to benchmark different configurations using VSC-Bench so you can compare results side by side and understand what actually works. Instead of guessing which setup is better, you’ll learn how to measure tradeoffs and make data-driven decisions."
Speaker
More in Track M
- Get Started with Models in Microsoft Foundry to Build AI AppsMonday, June 29 · 9:00 AM – 10:15 AM · Track M
- From zero to deployed on Azure with AI agentsMonday, June 29 · 11:05 AM – 12:05 PM · Track M
- Observe, optimize and protect your hosted agents in Microsoft FoundryMonday, June 29 · 2:20 PM – 3:35 PM · Track M
- Build agents fast with GitHub Copilot (from idea to working app)Tuesday, June 30 · 10:45 AM – 11:05 AM · Track M
- Use Copilot across CLI, dev, and cloud workflows to move faster end-to-endTuesday, June 30 · 11:40 AM – 12:00 PM · Track M
For developers: this programme is open data — JSON, iCal, schedule XML and an MCP endpoint.Show endpointsHide
- JSONEvery published session and speaker, in one request./aie-worldsfair-2026-import/feed.json
- iCalSubscribe in Google, Apple or Outlook Calendar./aie-worldsfair-2026-import/feed.ics
- Schedule XMLfrab / pentabarf — the format conference apps import./aie-worldsfair-2026-import/feed.xml
- MCP + RESTPoint Claude at the programme. OpenAPI 3.1 included./agents
No key, no signup, CORS open. Everything here is generated from the same data the organisers edit.