Show Notes
Will Petillo, onboarding team lead at PauseAI, joins me to discuss the grassroots movement advocating for a pause on frontier AI model development. We explore PauseAI's strategy, talk about common misconceptions Will hears, and dig into how diverse perspectives still converge on the need to slow down AI development. Will's Links Personal blog on AI His mindmap of the AI x-risk debate Game demos AI focused YouTube channel
(00:00) - Intro
(03:36) - What is PauseAI
(10:10) - Will Petillo's journey into AI safety advocacy
(21:13) - Understanding PauseAI
(31:35) - Pursuing a pause
(40:06) - Balancing advocacy in a complex world
(45:54) - Why a pause on frontier models?
(54:48) - Diverse perspectives within PauseAI
(59:55) - PauseAI misconceptions
(01:16:40) - Ongoing AI governance efforts (SB1047)
(01:28:52) - The role of incremental progress
(01:35:16) - Safety-washing and corporate responsibility
(01:37:23) - Lessons from environmentalism
(01:41:59) - Will's superlatives
LinksPauseAI PauseAI-US Related Kairos.fm Episodes Into AI Safety episode with Dr. Igor Krawczuk muckrAIkers episode on SB1047 Exclusionary Tendencies Jacobin article - Elite Universities Gave Us Effective Altruism, the Dumbest Idea of the Century SSIR article - The Elitist Philanthropy of So-Called Effective Altruism Persuasion blogpost - The Problem with Effective Altruism Dark Markets blogpost - What's So Bad About Rationalism? FEE blogpost - What’s Wrong With the Rationality Community? AI in Warfare Master's Thesis - The Evolution of Artificial Intelligence and Expert Computer Systems in the Army International Journal of Intelligent Systems article - Artificial Intelligence in the Military: An Overview of the Capabilities, Applications, and Challenges Preprint - Basic Research, Lethal Effects: Military AI Research Funding as Enlistment AOAV Article - ‘Military Age Males’ in US Drone Strikes The Conversation article - Gaza war: Israel using AI to identify human targets raising fears that innocents are being caught in the net 972 article - ‘Lavender’: The AI machine directing Israel’s bombing spree in Gaza IDF press release - The IDF's Use of Data Technologies in Intelligence Processing Lieber Institute West Point article - Israel–Hamas 2024 Symposium Verfassungsblog article - Gaza, Artificial Intelligence, and Kill Lists RAND research report - Dr. Li Bicheng, or How China Learned to Stop Worrying and Love Social Media Manipulation The Intercept article collection - The Drone Papers AFIT faculty publication - On Large Language Models in National Security Applications Nature article - Death by Metadata: The Bioinformationalisation of Life and the Transliteration of Algorithms to Flesh Legislation LegiScan page on SB1047 NY State Senate page on the RAISE Act Congress page on the TAKE IT DOWN Act The Gavernor FastCompany article - Big Tech may be focusing its lobbying push on the California AI safety bill’s last stop: Gavin Newsom POLITICO article - How California politics killed a nationally important AI bill Newsom's veto message Additional relevant lobbying documentation - [1], [2] Jacobin article - With Newsom’s Veto, Big Tech Beats Democracy Misc. Links FLI Open Letter on an AI pause Wikipedia article - Overton window Daniel Smachtenburger YouTube video - An Introduction to the Metacrisis VAISU website (looks broken as of 2025.06.19) AI Impacts report - Why Did Environmentalism Become Partisan?
More from Into AI Safety
Etienne Brisson and Allan Brooks, founder and program director of The Human Line Project, sat down with me to talk about AI-induced psychological harm, starting with their own experiences. Allan spent a month spiraling with ChatGPT, ending with him warning national security agencies about an encryption break that never happened. Etienne's uncle became convinced his chatbot was sentient and was hospitalized still messaging it from the back of a police car.
Dr. Evan Miyazono joins Jacob to talk about his path from quantum networking and Protocol Labs to founding Atlas Computing. They discuss why Atlas moved away from formal methods research and toward what Evan calls “field strategy”: identifying important problems, figuring out what interventions could actually address them, and finding the people best positioned to make them happen. The conversation also covers the resilience gap map, coordination failures, AI safety, "value alignment," and the question of how to decide what work is worth doing when there’s no obvious organization responsible for it. Check out the video version of this podcast on the Kairos.fm YouTube channel, or the extended version on Patreon! Chapters
What if the safest AI models weren't built by adding guardrails after training, but by shaping what gets learned in the first place? Ethan Roland, senior alignment researcher at AE Studio and first author on an ICML 2026 spotlight paper, joins Jacob to talk about gradient routing, a technique that routes dangerous capabilities into isolated parts of a model's architecture where they can be locked or removed entirely. They get into the absorption effect, KYC-style access control frameworks, and what it would actually take for frontier labs to adopt this kind of work before it's needed rather than after. Chapters
Today's episode does double duty as an interview and an announcement. Joe Williams, host of the new Kairos.fm show "Beyond the Paycheck: Reclaiming the Case for UBI in the Age of AI," joins Jacob to talk about his background as a freelance translator and how AI quietly dismantled his livelihood in 2025. From there the conversation expands into whether this moment is really different from past waves of automation, who exactly makes up the tech billionaire class, and why you should probably raise an eyebrow when someone like Elon Musk says he supports UBI. Go check out Reclaiming UBI! Chapters
Zainab Majid, co-founder of Asymmetric Security, joins Jacob for a conversation on the intersection between AI Safety and cybersecurity, as well as the future of digital forensics. Drawing from years of incident response work, she explains how cyber attacks actually unfold, why AI is changing both offense and defense, and how her team is building AI-native tools to investigate breaches faster and more effectively. Other topics explored in this episode include trust in the AI/cybersecurity industries, the realities behind cybersecurity hype, and the challenge of keeping humans meaningfully involved as these systems become more capable. Zainab also gives practical, actionable advice on how you can protect yourself. If you're interested in over 30 minutes of additional content, head on over to the Kairos.fm Patreon where you can become a subscriber for just $2 per month, which helps make this whole podcasting thing a bit more sustainable. Chapters