What's next after RLHF?
Diogo Almeida
- When
- Wednesday, July 110:45 AM – 11:05 AM · 20 min
- Where
- Track 9San Francisco, CA · imported from ai.engineer's public schedule feed
About this session
RLHF was a massive commercial success: roughly 100% of LLM usage is through RLHF’d models - but it was in many ways also a research failure. Let’s talk about how it conquered the world, how it defied its creators expectations, why AI is in the bimodal state it’s in (is it a bubble or a machine god?), and how to make AI actually transform the economy.
Speaker
CEO, TypeSafe AI
Diogo Almeida is the Co-founder and CEO of TypeSafe AI, a company building a new class of large language models for true no-human-in-the-loop automation. Diogo brings a decade of deep AI research experience and was formerly at OpenAI and Google Brain. He played a foundational role in shaping the modern LLM landscape, credited with co-inventing InstructGPT, RLHF, ChatGPT, and GPT-4. His work at TypeSafe AI focuses on rethinking foundational LLM assumptions to prioritize reliability, latency, and cost, to build AI that can be embedded deep inside real systems.
More in Posttraining & Midtraining
- Building self-learning loops for your agentMonday, June 29 · 11:05 AM – 12:05 PM · Track 1
- Bugcrowd posttraining talkTuesday, June 30 · 12:05 PM – 12:25 PM · Track 9
- State of DataWednesday, July 1 · 11:10 AM – 11:30 AM · Track 9
- Learning on the job: the future of post-trainingWednesday, July 1 · 12:05 PM – 12:25 PM · Track 9
- Reinforcement Learning without Verifiable RewardsWednesday, July 1 · 1:30 PM – 1:50 PM · Track 9
For developers: this programme is open data — JSON, iCal, schedule XML and an MCP endpoint.Show endpointsHide
- JSONEvery published session and speaker, in one request./aie-worldsfair-2026-import/feed.json
- iCalSubscribe in Google, Apple or Outlook Calendar./aie-worldsfair-2026-import/feed.ics
- Schedule XMLfrab / pentabarf — the format conference apps import./aie-worldsfair-2026-import/feed.xml
- MCP + RESTPoint Claude at the programme. OpenAPI 3.1 included./agents
No key, no signup, CORS open. Everything here is generated from the same data the organisers edit.