Why We Killed Our Multi-Agent Pipeline: Lessons From Pharma Commercial Intelligence
Subbiah Sethuraman, Abhilash Asokan
- When
- Thursday, July 23:45 PM – 4:05 PM · 20 min
- Where
- Track 5San Francisco, CA · imported from ai.engineer's public schedule feed
About this session
Key takeaways: A practical design principle for agentic systems in regulated, high-stakes domains: derive the architecture from agent behavior, don't impose it. Concrete patterns the audience can apply this week — domain knowledge graphs as agent context, deterministic preprocessing as a complement to agentic reasoning, reference-based context management. An honest case study from production: what worked, what didn't, and the open architectural questions we're still working on. Abstract : We lead the architecture and AI engineering org behind ZS Associates' commercial intelligence platform for pharmaceutical brand teams. The product has two surfaces: a proactive alert system that delivers signal-driven intelligence packets when a brand's KPIs move, and a conversational analytics chat where business users ask ad-hoc questions. A year ago we built both surfaces as separate V1 stacks. They broke in different ways. The diagnosis was the same: we had decided on the structure before we knew what the agent actually needed. This talk is about the design principle that came out of rebuilding both — and what it produced. The architecture is derived, not designed. We stopped trying to predict what scaffolding the agent would need and started designing the system around what the agent's behavior, on real production tasks, actually demanded. Tools, context, structure, and guardrails get introduced at the points where the agent's reasoning needs them — and nowhere else. What that produced is an architecture that's smaller than V1, not bigger. A single agent owns each investigation end-to-end across both surfaces, launching parallel sub-agents when the work needs them — not according to a pre-defined topology. A pharmaceutical commercial knowledge graph — HCPs, accounts, payers, territories, brands, KPIs and the relationships between them — gives the agent the domain context it needs without prompt-engineering heroics. Statistical signal detection runs deterministically before the agent wakes up, so the agent's job is to explain signals, not find them. Raw query results stay out of the context window through a reference-pattern that lets the agent reason over data without drowning in it. Each of those decisions came from watching an agent struggle on a real task and asking what does it need here? — not from sketching the architecture in a doc and forcing the agent into it. The patterns generalize. If you're shipping agents over messy enterprise data — finance, supply chain, claims, operations — the failure modes and the fixes will look familiar. We'll close with the open questions and the pieces we haven't solved yet.
Speakers (2)
Partner, ZS Associates
Subbiah leads the AI Engineering Practice at ZS, where he architects and scales enterprise AI systems spanning agentic and traditional ML. He has delivered enterpriseAI applications for leading pharmaceutical clients across R&D, Commercial, and Enterprise domains. His work centers on the engineering foundations that make agents work in the enterprise: semantic and knowledge layers, content authoring and virtual assistants that reason across millions of documents, agent development platforms and AgentOps and governance frameworks for orchestrating, observing, and controlling agentic systems in production. Before pharma, he built AI Engineering solutions across Retail, Manufacturing, and FinTech, and architected Apple's core big data analytics platform. A recognized thought leader, he is passionate about responsible AI and the engineering discipline behind reliable agentic systems.
More in Graphs
- Thinner Agents on a Smarter Substrate: The Ontology-based Semantic LayerThursday, July 2 · 10:20 AM – 10:30 AM · Main Stage
- CrabRAG: Why Automated Assistants Need Graph Memory, Not More TokensThursday, July 2 · 10:45 AM – 11:05 AM · Track 5
- Active Graph Agent Runtime (BabyAGI 4)Thursday, July 2 · 11:10 AM – 11:30 AM · Track 5
- Your Moat Is Your Data ModelThursday, July 2 · 11:40 AM – 12:00 PM · Track 5
- From Systems of Record to Systems of ContextThursday, July 2 · 12:05 PM – 12:25 PM · Track 5
For developers: this programme is open data — JSON, iCal, schedule XML and an MCP endpoint.Show endpointsHide
- JSONEvery published session and speaker, in one request./aie-worldsfair-2026-import/feed.json
- iCalSubscribe in Google, Apple or Outlook Calendar./aie-worldsfair-2026-import/feed.ics
- Schedule XMLfrab / pentabarf — the format conference apps import./aie-worldsfair-2026-import/feed.xml
- MCP + RESTPoint Claude at the programme. OpenAPI 3.1 included./agents
No key, no signup, CORS open. Everything here is generated from the same data the organisers edit.