Serving 2 Million Models Without Melting: Scaling the Hugging Face Hub
Arek Borucki
- When
- Tuesday, June 301:30 PM – 1:50 PM · 20 min
- Where
- Leadership 2San Francisco, CA · imported from ai.engineer's public schedule feed
About this session
Hugging Face hosts over 2 million public models, 500,000+ datasets, and serves 13 million users across 50,000+ organizations, including over 30% of the Fortune 500. That growth didn't come with a manual.In this talk, we'll pull back the curtain on the infrastructure decisions that kept the Hub fast and reliable as traffic grew by orders of magnitude. We'll dive into why we chose MongoDB Atlas as our core data layer, how its document model maps naturally to the messy reality of ML model metadata, and what it took to keep p99 latency low when every request hits a catalog of millions. We'll also cover the trade-offs we faced, the things that broke along the way, and what "lean operations" actually means when your platform serves a third of the Fortune 500. Expect real architecture decisions, real numbers, and lessons you can take back to your own stack.
Speaker
Machine Learning Platform & Database Engineer, Hugging Face
Arek Borucki is a Machine Learning Platform & Database Engineer at Hugging Face, where he helps keep the infrastructure behind one of the world's largest open-source AI platforms running at scale. He is the author of MongoDB in Action 8.0 and co-author of Mastering MongoDB 7.0. With over 10 years of experience in SRE, Kubernetes, AWS, GCP, and managing MongoDB in production, from 100TB+ sharded clusters to cloud-native deployments, he brings deep expertise in databases, platform engineering, and infrastructure at scale.
More in AI Architects: Show my Workflow
- Your Agent Evolved. Your Evals Didn't.Tuesday, June 30 · 11:10 AM – 11:30 AM · Leadership 2
- The Last Human Code Review: Building Trust in AI-Generated CodeTuesday, June 30 · 11:40 AM – 12:00 PM · Leadership 2
- Prototyping as Leadership: How a CTO Ships with AI AgentsTuesday, June 30 · 12:05 PM – 12:25 PM · Leadership 2
- IT Admin for the AI Workforce: Why Your AI Agents Will Need Their Own IT DepartmentTuesday, June 30 · 1:55 PM – 2:15 PM · Leadership 2
- The Era of Compound EngineeringTuesday, June 30 · 2:25 PM – 2:45 PM · Leadership 2
For developers: this programme is open data — JSON, iCal, schedule XML and an MCP endpoint.Show endpointsHide
- JSONEvery published session and speaker, in one request./aie-worldsfair-2026-import/feed.json
- iCalSubscribe in Google, Apple or Outlook Calendar./aie-worldsfair-2026-import/feed.ics
- Schedule XMLfrab / pentabarf — the format conference apps import./aie-worldsfair-2026-import/feed.xml
- MCP + RESTPoint Claude at the programme. OpenAPI 3.1 included./agents
No key, no signup, CORS open. Everything here is generated from the same data the organisers edit.