June 29 – July 2, 2026 · San Francisco, CA · imported from ai.engineer's public schedule feed

AI Engineer World's Fair 2026 — unofficial import demo

Unofficial demo. This programme was imported from the AI Engineer World's Fair's own public schedule feed to show vibeboard at real conference scale. Not affiliated with, or endorsed by, the organisers.

All sessions
EvalsSponsor Session

Evals Driven-Development: Engineering a Mental Health AI Coach Ethically & Safely

Akele Reed, Dave Revere, Doug Keller

When
Wednesday, July 12:50 PM – 3:10 PM · 20 min
Where
Track 5San Francisco, CA · imported from ai.engineer's public schedule feed
Google Calendar

About this session

In the world of AI Mental Health, vibes can be dangerous with real consequences. Building Sondermind’s Mental Health AI Coach required us to invent a new playbook for Eval-Driven Development in order to balance effectiveness and safety. This session is for the builders who want to see how to handle the most difficult edge cases in the agentic world. We’ll show how we’ve built a Clinical Feedback Loop that turns human therapist insights into machine-readable evaluations in a production system with thousands of conversations. We’ll dive into: - The Ethics Engine: Building and calibrating modular guardrails that can be updated as clinical guidelines evolve. - Agentic Oversight: Why we moved from single-prompt agents to a closed-loop Supervisor/Executor/Evaluator pattern to ensure clinical adherence. - Human Oversight: How we monitor Sonder to ensure that we can improve safety and quality with clinical feedback.

Speakers (3)

Akele Reed
Akele Reed

Principal AI Engineer, Sondermind

Principal AI Engineer at SonderMind, Akele Reed leads the team behind the company's conversational AI mental health feature and has served as a primary architect of its guardrails and evaluations framework. Her work sits at the intersection of AI capability and responsibility, designing systems that earn trust through rigorous safety pipelines, human expert feedback loops, and continuous oversight in one of the highest-stakes domains in healthcare. Akele is passionate about making AI trustworthy not just in theory, but in production and building the infrastructure and culture that allow engineers and clinicians alike to confidently rely on AI-powered tools. She brings over nine years of experience in applied AI and model training, including her previous role at 23andMe, and holds a Master's degree in Computer Science from Georgia Tech. Away from the screens, she enjoys hiking, beekeeping, and baking.

Dave Revere
Dave Revere

Staff AI Engineer, SonderMind

Staff AI Engineer at SonderMind specializing in eval and guardrail pipelines for mental health AI. Dave builds the safety infrastructure behind SonderMind's AI products, including the clinical feedback loop that turns therapist annotations into automated regression tests and the modular guardrails system that evaluates every agent response before it reaches a user. He's passionate about making high-stakes AI systems safe enough to ship fast and rigorous enough to earn clinical trust.

Doug Keller
Doug Keller

Senior Staff AI Engineer, SonderMind

Doug is the lead architect of the agent platform powering SonderMind’s GenAI solutions and a core member of the team building Sonder, SonderMind’s mental health coach. With over a decade of full-stack systems experience, Doug brings a systems-first approach to agent architecture, grounding his work in engineering fundamentals while enabling the adaptability required in the rapidly evolving GenAI landscape.

More in Evals