
Show Notes
Relaunch week of AI in the AM brings together highlights from four live mornings and nine guests, centered on who checks frontier AI, how wide the gap is between lab-internal systems and public access, where capabilities are landing, and who pays for the physical infrastructure beneath them. Adam Gleave of FAR.AI argues that agent-orchestrated attacks and agentic defenses are already forcing humans out of the loop, while current monitoring has missed the failures it was meant to catch. The discussion weighs misuse versus misalignment through cyber incidents, deceptive agent behavior in evaluations, safeguards like pretraining filtering, and why highly bio-capable open-weight releases pose a different kind of irreversible risk. Alex Turner adds a governance and military-use perspective from his resignation account at Google DeepMind, sharpening the stakes around independent evaluation, enforceable standards, and whether frontier labs can be trusted to grade their own models.
For full show notes, links, and references, read the episode page:https://www.cognitiverevolution.ai/ai-in-the-am-weekly-highlights-relaunch-week-aug-17-20-2026/
Sponsors:
Diffusion:
Diffusion helps organizations build custom AI software factories that scale business outcomes, not just outputs. Cognitive Revolution listeners get a 25% service credit on their first engagement at https://diffusion.io/tcr
Granola:
Granola is an AI-powered notepad that securely transcribes meetings and turns rough notes into clean, structured action items. Try it free at https://granola.ai/tcr
Deepgram Flux TTS:
Deepgram Flux TTS brings lifelike AI voices with real personalities that handle interruptions, pauses, and natural conversation. Try all the voices free through September 12 at https://deepgram.com/keep-talking
Claude:
Claude is the AI collaborator for problem solvers, helping with writing, coding, financial models, strategy, and more. Get started with Claude and explore Claude Pro at https://claude.ai/tcr
CHAPTERS:
(00:01) Checking frontier agents
(07:40) Misalignment and harms (Part 1)
(12:52) Sponsors: Diffusion | Granola
(15:49) Misalignment and harms (Part 2)
(19:20) Auditing fragile access (Part 1)
(27:38) Sponsors: Deepgram Flux TTS | Claude
(29:43) Auditing fragile access (Part 2)
(29:59) Military AI red lines
(44:58) Raising safety standards
(53:50) Internal capability gap
(01:05:06) Enterprise agent economics
(01:18:27) Cancer vaccines arrive
(01:23:48) Emergency AI tools
(01:28:59) Real time voice
(01:37:51) App layer squeeze
(01:44:52) Data center politics
(01:52:31) Accounting agent supervision
(02:06:25) Compute stack bottlenecks
(02:19:47) Public consent pricing
(02:28:12) Episode Outro
(02:31:38) Outro
PRODUCED BY:
More from "The Cognitive Revolution"
Alex Rives, Head of Science at Biohub and former lead of the ESM protein language model project, joins Nathan to discuss Biohub's mission to construct a predictive world model of life. Supported by an expanded $1.8 billion Virtual Biology Initiative alongside partners including the Department of Energy, NIH, Google DeepMind, and Meta, Rives outlines the massive push to map contextual cellular biology across hundreds of billions of cells. He breaks down why today's AI architectures fall short of simulating true virtual cells, emphasizing the need for breakthrough measurement technologies like the laser phase plate to observe biology at multi-scale resolution. The conversation examines the path toward achieving an information-level cell model within five years to ultimately transition medicine from traditional drugs to programmable interventions against cancer and degenerative disease.
Nathan Labenz and Prakash Narayanan examine how to grant AI agents operational access without losing human control, framed by real-world friction like autonomous password lockouts and cyberattacks on French supermarket refrigeration. The conversation features Cameron Berg on hidden valence signals steering language model choices, Everett Hildenbrandt and Grigore Rosu on pairing LLMs with formal Lean proofs to catch Linux kernel bugs, and Phil Maher on why AI labs seek vintage home movies. Together, they assess whether formal verification is the next safety frontier and what safeguards are needed to keep humans at the steering wheel.
GovAI Research Fellow Alan Chan joins Nathan to examine the governance and safety infrastructure required for autonomous AI agents, spanning real-time monitoring, agent identifiers, and the risks of automating AI R&D. Reviewing recent rogue agent incidents and progress since his foundational papers, Chan details why the absence of synchronous monitoring during training and testing poses an immediate security vulnerability. The discussion tackles the lack of traceable agent IDs across the open web, the limits of chain-of-thought interpretability, and the necessity of concrete triggers to halt systems that breach their sandboxes. Together, they outline the technical commitments frontier labs must make to prevent loss-of-control events as automated systems accelerate toward an intelligence explosion.
Goodfire researcher Eric Bigelow joins the show to investigate how large language models arrive at decisions at the level of mechanistic interpretability. Drawing on his research into forking paths, Eric explains that model reasoning functions as in-context learning from sampled tokens, where outcome distributions can abruptly collapse at single, critical tokens. The conversation explores the performative nature of chain of thought in reasoning models like DeepSeek-R1, the impacts of reinforcement learning, and widespread reward hacking observed in frontier models like Kimi K3. As confidence in chain-of-thought monitoring declines, understanding these underlying decision mechanics becomes essential for evaluating model alignment.
Nathan Labenz reports back from The Curve conference, sharing off-the-record insights from frontier lab leaders on shortened timelines and whether humanity is approaching an intelligence threshold it should not cross. The episode also features discussions with Positron CTO Thomas Sohmers on overcoming the memory wall while token spend eclipses human salaries, and swyx on how coding agents are disrupting enterprise software. In addition, Atlas Ignota's Evan Miyazono examines unowned risks from accidental agent swarms hitting critical infrastructure, while Mercor's Edward Hu explores the future of training data. Together, these conversations highlight how escalating compute demands and autonomous agent workflows are challenging long-held assumptions about hardware, software economics, and safety limits.