The Unreasonable Effectiveness of Separating the Task from the Model
Maxime Rivest, Isaac Miller
- When
- Thursday, July 29:40 AM – 10:00 AM · 20 min
- Where
- Main StageSan Francisco, CA · imported from ai.engineer's public schedule feed
About this session
By declaring your task’s inputs and outputs without initially considering model capability, you create the space needed to figure out the model execution later. DSPy’s entire promise is that you should evaluate and execute your AI engineering at a level higher than a specific prompt template or a particular provider’s API shape: the Signature. However, models have evolved significantly over the last few years. How can the same input and output specifications still work in a world now filled with tools, RLMs, and Skills? By defining your task strictly through its inputs and outputs, the underlying implementation becomes completely flexible. You can experiment with different models, settings, weights, templating strategies, and output formats, all without touching your actual AI workflow. Consequently, you can leverage components built by others and focus entirely on your core AI task. In this talk we will present how dspy 3.5 makes it easier much easier. DSPy has its roots in prompt optimization, where we build efficient ways to conduct search and learning beneath the signature. In this talk we will give a preview of DSPy 4.0 where we use the fact that models have now passed a tipping point for two critical concepts we have always needed. First, we no longer need to limit the search space to a single instruction block per LLM call; models can now reliably write the code underneath a signature themselves—so they should. Second, traditional prompt optimization has always required a scalar metric, which is notoriously one of the hardest parts to get right. What if a DSPy program could learn directly from your interactions with users? Ultimately, all you care about is that the function you call respects the inputs and outputs of your signature. You can let the models figure out the rest.
Speakers (2)
Core Contributor, DSPy
Maxime builds tools and create content that make LLMs more accessible and powerful for everyone. He is a core contributor to DSPy and has built numerous open-source Python libraries to advance the ecosystem, including attachments, functai, ovllm, dspy-lm-auth, dspy-template-adapter, and mcp2py. Previously, he worked at Elsevier, building AI infrastructure and compound AI programs to cost effectively run on 100 million records weekly.
Lead Maintainer of DSPy; Co-Founder, cmpnd
Lead Maintainer of DSPy. Co-Founder at cmpnd. Building an OSS Framework to help you create self-improving, modular AI systems.
More in Harness Engineering
- In Code They Act, In Proof We TrustTuesday, June 30 · 4:50 PM – 5:10 PM · Main Stage
- The 2026 State of AI EngineeringThursday, July 2 · 9:00 AM – 9:20 AM · Main Stage
- How Anthropic Builds: Lessons from LabsThursday, July 2 · 10:00 AM – 10:20 AM · Main Stage
- Tokens Should Have JobsThursday, July 2 · 10:45 AM – 11:05 AM · Main Stage
- Harness Engineering: Building the Production Cage for Powerful Domain AgentsThursday, July 2 · 12:05 PM – 12:25 PM · Main Stage
For developers: this programme is open data — JSON, iCal, schedule XML and an MCP endpoint.Show endpointsHide
- JSONEvery published session and speaker, in one request./aie-worldsfair-2026-import/feed.json
- iCalSubscribe in Google, Apple or Outlook Calendar./aie-worldsfair-2026-import/feed.ics
- Schedule XMLfrab / pentabarf — the format conference apps import./aie-worldsfair-2026-import/feed.xml
- MCP + RESTPoint Claude at the programme. OpenAPI 3.1 included./agents
No key, no signup, CORS open. Everything here is generated from the same data the organisers edit.