Improving Agents is a Data Mining Problem
Vivek Trivedy
- When
- Wednesday, July 11:55 PM – 2:15 PM · 20 min
- Where
- Track 3San Francisco, CA · imported from ai.engineer's public schedule feed
About this session
Harness Engineering, Post-Training, Continual Learning...these all boil down to the same underlying substrate - Mining Agent Traces 1. I need to run my agents to collect Traces 2. Understand behaviors from Traces at scale 3. Filter data for "improvement" 4. Do an improvement step There's a reason why every continual learning platform ends up looking like an observability platform. It's because Traces are the lifeblood of agent improvement. The mechanism that we use to attempt improvement can vary - Harness Eng, SFT, etc. But without understanding the data agents produce, no algorithm will truly build better agents. The holy grail of Agent Improvement is Continual Learning. Consistently mining data and integrating it into the agent definition over infinitely long time horizons. Today, the easiest way to do that is to build an observability platform and constantly point agentic compute to understand the data that agents produce. We'll walk through the current methods of understanding traces at massive scale and choosing how to integrate them to improve agents across your personal agents, team agents, and entire company.
Speaker
Head of Applied Research, LangChain
Vivek leads Applied Research at LangChain Labs where he's focused on cracking Continual Learning & making it accessible to the world's agent builders. Previously he worked on the LangChain Deep Agents open-source agent harness, worked on his own startup around agents for visual reasoning, and did Health AI at AWS for ~4 years. His PhD was focused on representation learning in Computer Vision.
More in Memory & Continual Learning
- Beyond Static Intelligence: Evaluating Continual LearningWednesday, July 1 · 10:45 AM – 11:05 AM · Track 3
- Scaling up Continual LearningWednesday, July 1 · 11:10 AM – 11:30 AM · Track 3
- Memory Harnesses for Long-Running Research AgentsWednesday, July 1 · 11:40 AM – 12:00 PM · Main Stage
- Scaling Compute on ContextWednesday, July 1 · 11:40 AM – 12:00 PM · Track 3
- Intelligence + Continual Learning = ExpertiseWednesday, July 1 · 12:05 PM – 12:25 PM · Track 3
For developers: this programme is open data — JSON, iCal, schedule XML and an MCP endpoint.Show endpointsHide
- JSONEvery published session and speaker, in one request./aie-worldsfair-2026-import/feed.json
- iCalSubscribe in Google, Apple or Outlook Calendar./aie-worldsfair-2026-import/feed.ics
- Schedule XMLfrab / pentabarf — the format conference apps import./aie-worldsfair-2026-import/feed.xml
- MCP + RESTPoint Claude at the programme. OpenAPI 3.1 included./agents
No key, no signup, CORS open. Everything here is generated from the same data the organisers edit.