Show Notes
AI companies have been talking about superintelligent AI like it's inevitable, but recent safety incidents like OpenAI's Hugging Face breach are demonstrating the potential dangers of deploying AI systems that are more capable than humans. So what happens when we can't reliably control what these systems do?
On this episode of TechCrunch's Equity podcast, Rebecca Bellan is joined by Connor Leahy, an AI researcher, entrepreneur, and now the U.S. Executive Director of nonprofit ControlAI, which is pushing for a far more radical approach to AI safety: stopping companies from developing superintelligence altogether. Leahy explains why he thinks the risks have become too great to manage through alignment and containment alone, and how what sounded far-fetched six months ago is now being backed by a wave of new legislation.
Listen to the full episode to hear more about:
His take on the Sanders-Casar “Ban Superintelligence Act,” the parallel legislation in the U.K. that Control AI advised on, and why he thinks the U.S. bill may go further than necessary.
How he views frontier AI labs less as companies simply chasing returns and more as political actors, and what that means for the trillions of dollars being poured into data center buildouts.
Why Leahy thinks the real point of no return is when AI can build better AI, creating a potentially runaway cycle of self-improvement
The case for international “trust but verify” agreements, and why Leahy thinks it isn't actually in China's interest to build superintelligence.
Subscribe to Equity on YouTube, Apple Podcasts, Overcast, Spotify and all the casts. You also can follow Equity on X and Threads, at @EquityPod. Learn more about your ad choices. Visit megaphone.fm/adchoices
More from Equity
It seems like every big AI player is building a personal agent. Meta has Muse, OpenAI launched Dots, and a startup called Instinct recently raised $1 billion at a $10 billion valuation. But Eugenia Kuyda thinks the next generation of AI assistants needs to do more than book your restaurant reservations and find you hidden money in your Gmail.
Amulya Vishwanath, who spent seven years leading product marketing for NVIDIA’s robotics platforms, says robotics is currently in its “Lego era,” with the basic building blocks like actuators, robotic hands, software, and safety standards still being rebuilt.
The Equity crew was live at TechCrunch Disrupt 2026! Kirsten Korosec, Anthony Ha, and Sean O’Kane took over the Builders Stage Tuesday morning to tackle a growing challenge for the AI industry: what happens when AI agents go off-script, and who’s responsible for keeping them in check?
Amazon says it will stop using NDAs when negotiating data center deals with local governments, following a similar move from Microsoft earlier this year. Secrecy has fueled community backlash against AI infrastructure, with opposition leading to hundreds of proposed and enacted moratoriums from New York to San Francisco. Meanwhile, a wave of startups is betting that consumers will hand AI agents access to their inboxes, files, and credit cards — if they can get websites to let them in.
Tristan Walker and Brynn Putnam both built and sold major consumer companies. Now, they’re building products designed to bring people together.