Show Notes
Before 2022, there was a wall between AI and the real world — models could reason impressively, but couldn't look anything up, run code, or check whether anything they said was actually true. This episode traces the moment that wall came down, through two landmark papers: ReAct, which showed what happens when you interleave reasoning and action in a loop, and Toolformer, which taught models to decide *for themselves* when to reach for a tool. Plus: what MCP actually is, and why a hobbyist project called Open Claw became the fastest-growing open source project in history.
--- Website: https://lineardigressions.com Apple Podcasts: https://podcasts.apple.com/us/podcast/linear-digressions/id941219323 Spotify: https://open.spotify.com/show/1JdkD0ZoZ52KjwdR0b1WoT Substack: https://substack.com/@lineardigressions
More from Linear Digressions
As AI systems grow more powerful, they grow harder to understand — and that tradeoff has never mattered more. Most interpretability tricks give us approximations from the outside, but mechanistic interpretability takes a different approach: cracking open the model itself to trace *why* it behaves the way it does. This episode digs into what makes mechanistic interpretability fundamentally different from other explainability methods, and why it might be the most promising path toward actually understanding what's happening inside modern LLMs.
Labeled data is expensive, slow, and painfully hard to come by — and when you're trying to evaluate whether an AI workflow is actually doing what you want, the problem gets even messier. How do you judge whether a chatbot response was helpful, honest, or hallucination-free at scale? This episode digs into using LLMs as judges: letting the models themselves evaluate the quality of AI outputs, from simple chat exchanges all the way to complex multi-step agent behavior.
Originally aired on the Harvard Data Science Review podcast.