Video Has No Memory. Here's How We Built One.
James Le
- When
- Thursday, July 22:25 PM – 2:45 PM · 20 min
- Where
- Track 5San Francisco, CA · imported from ai.engineer's public schedule feed
About this session
Every video AI query today starts from scratch. There's no durable state, no entity continuity, no way to ask "what does this corpus know?" instead of "find me something like this." This talk is about fixing that by engineering a proper memory layer for video intelligence, grounded in what we shipped at TwelveLabs with Jockey. What this talk covers: 1 - Why video memory is categorically different from text memory: Video is temporal, multimodal, dense, ambiguous, and evidence-sensitive. Larger context windows don't solve this. The problem isn't retrieval bandwidth, it's that there's no durable representation to retrieve into. 2 - The context graph as a systems concept, not a database choice: I'll define what "context graph" actually means in practice: time-bounded moments, cross-video entity resolution, appearance tracking, and relationship mapping. This is infrastructure-level thinking, not a graph DB sales pitch. 3 - Five design principles that determine whether video intelligence is reusable infrastructure or a search wrapper with extra steps: + Ingest once, reason many times (move expensive understanding work into preparation) + Store primitives, not just answers (moments, entities, appearances, relationships) + Ground every claim to source video (a timestamp is a product requirement, not a safety footnote) + Let intent shape memory (brand safety and sports highlights need different primitives from the same footage) + Keep the memory layer composable and API-first 4 - What this unlocks for builders. Corpus digest, agentic search with grounded references, entity-centric workflows, timeline reconstruction, and compliance tooling, all built on the same durable substrate. The talk is concrete and demo-grounded. You'll leave with a specific mental model for memory architecture, actionable decisions for ingestion pipeline design and entity resolution, and a clear line between "search with extra steps" and actual video intelligence infrastructure.
Speaker
Head of Developer Experience, TwelveLabs
James Le is currently leading Developer Experience at Twelve Labs, a startup building foundation models for video understanding. Previously, he worked at MLOps startups including Superb AI, Snorkel AI, Weights & Biases, and taught production ML content with Full Stack Deep Learning.
More in Graphs
- Thinner Agents on a Smarter Substrate: The Ontology-based Semantic LayerThursday, July 2 · 10:20 AM – 10:30 AM · Main Stage
- CrabRAG: Why Automated Assistants Need Graph Memory, Not More TokensThursday, July 2 · 10:45 AM – 11:05 AM · Track 5
- Active Graph Agent Runtime (BabyAGI 4)Thursday, July 2 · 11:10 AM – 11:30 AM · Track 5
- Your Moat Is Your Data ModelThursday, July 2 · 11:40 AM – 12:00 PM · Track 5
- From Systems of Record to Systems of ContextThursday, July 2 · 12:05 PM – 12:25 PM · Track 5
For developers: this programme is open data — JSON, iCal, schedule XML and an MCP endpoint.Show endpointsHide
- JSONEvery published session and speaker, in one request./aie-worldsfair-2026-import/feed.json
- iCalSubscribe in Google, Apple or Outlook Calendar./aie-worldsfair-2026-import/feed.ics
- Schedule XMLfrab / pentabarf — the format conference apps import./aie-worldsfair-2026-import/feed.xml
- MCP + RESTPoint Claude at the programme. OpenAPI 3.1 included./agents
No key, no signup, CORS open. Everything here is generated from the same data the organisers edit.