This Week in AI

OpenAI's chief scientist wants to slow down | E30

This Week in AI

Show Notes

This Week In Startups is made possible by: PayPal - Pay zero processing fees on your first $100K in eligible PayPal payment volume. Learn more at paypal.launch.co Today’s show: OpenAI's chief scientist wrote a lengthy manifesto arguing that no lab has solved alignment, mere days after GPT-6 Astra shipped. Jason and Lon are joined by Tudor Achim of Harmonic, Alex Elias of Qloo, and Ahmed Ahres of Reactor to figure out if that's genuine alarm being expressed or just another pre-IPO sales pitch and play for regulatory capture. Plus news broke while we were recording! OpenAI is claiming to have solved a second Millennium Prize problem, after a 25-year-plus weight. AND, who is paying influencers to tell you AI is wonderful/harmful? And why? Guests: Tudor Achim on X: https://x.com/tachim Harmonic: https://harmonic.fun/ Alex Elias on X: https://x.com/ape Qloo: https://www.qloo.com/ Ahmed Ahres on X: https://x.com/Boudatw Reactor: https://reactor.inc/ Relevant Links: Jakub Pachocki, "An Alien Mind" — https://openai.com/index/an-alien-mind/ GPT-6 Astra — https://fortune.com/2026/09/03/openai-debuts-gpt-6-astra-computer-use-greg-brockman-says-start-of-agi/ OpenAI: "On the Navier–Stokes Millennium Prize Problem" — https://openai.com/index/navier-stokes-solution/ ControlAI — the nonprofit that sponsored the SciShow episode — https://controlai.org/ New York Times (Eli Tan), "Corporate America Is Getting Hooked on Open-Source A.I." — https://www.nytimes.com/2026/09/04/technology/open-source-ai-companies.html Artificial trailer and the cast → https://variety.com/2026/film/news/artificial-trailer-andrew-garfield-openai-biopic-1236802616/ Timestamps: 0:00 "An Alien Mind" 3:08 AI psychosis, marketing, or half a mile ahead on the racetrack? 12:52 The Manhattan Project analogy 15:20 Tudor: if it's really that dangerous, the answer is nationalization 17:02 Regulatory capture: Bill Gurley at All-In, Sacks, and who can afford to be regulated 20:37 The influencer propaganda tape 23:22 BREAKING: OpenAI solves the Navier-Stokes Millennium Prize problem 28:53 The Hank Green / SciShow video sponsored by ControlAI 32:11 Fogging and flooding 46:47 UBS will require AI skills from its 2027 graduate 56:41 How LAUNCH hired its associates-in-training 57:18 NYT: Corporate America is getting hooked on open-source AI 1:04:16 Alex on Qloo's shift from NYT film critics on payroll to small specialized models 1:09:35 First look: the "Artificial" teaser trailer 1:14:34 Sam Altman's bunker, Peter Thiel, and casting rundown

Subscribe to the TWiST500 newsletter: https://ticker.thisweekinstartups.com Check out the TWIST500: https://www.twist500.com Subscribe to This Week in Startups on Apple: https://rb.gy/v19fcp Follow Lon: X: https://x.com/lons Follow Jason: X: https://twitter.com/Jason LinkedIn: https://www.linkedin.com/in/jasoncalacanis Check out all our partner offers: https://partners.launch.co/ Great TWIST interviews: Will Guidara, Eoghan McCabe, Steve Huffman, Brian Chesky, Bob Moesta, Aaron Levie, Sophia Amoruso, Reid Hoffman, Frank Slootman, Billy McFarland Check out Jason’s suite of newsletters: https://substack.com/@calacanis Follow TWiST: Twitter: https://twitter.com/TWiStartups YouTube: https://www.youtube.com/thisweekin Instagram: https://www.instagram.com/thisweekinstartups TikTok: https://www.tiktok.com/@thisweekinstartups Substack: https://twistartups.substack.com

More from This Week in AI

Oct 22, 2026

This Week In AI is made possible by PayPal: http://paypal.launch.co

Oct 15, 2026

This Week In AI is made possible by: PayPal: http://paypal.launch.co

Oct 8, 2026

Thanks to our partner, @Paypal! Pay zero processing fees on your first $100K in eligible PayPal payment volume. Learn more at https://paypal.launch.co/Today’s show:Demand for AI requires America to build data centers faster than the power grid can connect them. Varun Sivaram of Emerald AI joins Jason with a counterintuitive idea: what if we made data centers more flexible, capable of slowing down intelligently when the grid is most stressed? (That only happens a few hundred hours each year.)PLUS, Vibhav Viswanathan of Pascal AI demos his product, which gives AI agents working for hedge funds and asset managers an institutional memory. Why can't Claude or ChatGPT do the same job? And what happens to analysts when bots handle the back office admin?Guests:Varun Sivaram on X: https://x.com/vsiv Emerald AI: https://www.emeraldai.co/Vibhav Viswanathan on LinkedIn: https://www.linkedin.com/in/vibhav-viswanathan-13550015/ Pascal AI: https://www.pascalailabs.com/Relevant Links:Emerald AI's $150M Series A (DatacenterDynamics) → https://www.datacenterdynamics.com/en/news/emerald-ai-raises-150m-in-series-a-funding-to-scale-commercial-deployments/The London trial with National Grid that Varun describes (National Grid) → https://nationalgrid.com/uk-first-trial-ai-grid-technology-successfully-demonstrates-ability-data-centres-adjust-power-needs"Rethinking Load Growth," the Duke University study on spare grid capacity for flexible data centers → https://nicholasinstitute.duke.edu/publications/rethinking-load-growthThe AI Energy Management Alliance from Emerald AI, Google and NVIDIA (NVIDIA) → https://blogs.nvidia.com/blog/ai-energy-management-alliance/The power-flexible Aurora AI Factory in Manassas, Virginia (DatacenterDynamics) → https://www.datacenterdynamics.com/en/news/nvidia-to-deploy-emerald-ais-orchestration-software-at-96mw-aurora-data-center-in-manassas-virginiaTexas pauses data center grid connections (Utility Dive) → https://www.utilitydive.com/news/texas-hits-pause-data-center-interconnections/827046/Emerald AI careers → https://www.emeraldai.co/careersPascal AI's $3.1M seed round (Unite AI) → https://www.unite.ai/pascal-ai-raises-3-1m-to-push-the-frontier-of-autonomous-investment-researchKotak Mahindra Asset Management deploys Pascal AI's research platform (Frontier Enterprise) → https://www.frontier-enterprise.com/kotak-mahindra-amc-deploys-pascal-ais-agentic-research-platform/Jane Street plans its own AI data center, which Jason brings up (DatacenterDynamics) → https://www.datacenterdynamics.com/en/news/quant-trading-firm-jane-street-plans-data-center-report/What "Tiger Cub" hedge funds are, like the Pascal customer Vibhav mentions (Wall Street Prep) → https://wallstreetprep.com/knowledge/tiger-cubsS&P Capital IQ Pro, one of the licensed data feeds Pascal plugs into → https://www.spglobal.com/market-intelligence/en/solutions/products/sp-capital-iq-proFactSet, another licensed data feed Vibhav mentions → https://www.factset.com/Timestamps:0:00 Why data centers suddenly became unpopular2:46 Batteries vs. throttling GPUs vs. moving workloads4:11 Why utilities still pick up the phone4:52 The London teakettle test at football halftime5:56 Throttling AI workloads without users noticing10:40 How much spare room the grid really has13:32 The grand bargain, a fast pass onto the grid17:23 Why America can't out-build China on power20:39 Why off-grid and space data centers worry Varun27:37 Are state data center moratoriums performative?29:45 Pascal AI, AI agents for hedge funds and asset managers35:12 How Pascal differs from ChatGPT and Claude38:54 The proprietary data frontier models can't see42:20 Will AI replace hedge fund analysts?Subscribe to our newsletters on Substack:TWiST: https://twistartups.substack.com/TWiAI: https://www.thisweekinai.ai/TWiVC: https://thisweekinvc.substack.com/Check out all our partner offers: https://partners.launch.co/

Oct 1, 2026

This Week In Startups is made possible by:PayPal: https://paypal.com/businessToday’s show:OpenAI is delaying GPT-6.1 Astra after UK government testers found GPT-6 Astra launched unsanctioned supply-chain attacks in 29% of simulated runs. Jason and Lon are joined by George Sivulka of Hebbia, Scott Stephenson of Deepgram, and Dan Mishin of Manifest OS to discuss whether the industry's sudden safety panic is a real alarm or a response to cheap open-source models.Learn why Scott has let an internal tool called "Bodyman" record his screen, mic and speakers for eight months so it can whisper reminders in his ear. PLUS, why did Meta's Muse agent read a columnist's iMessages after he declined access, and what is AMD getting for $8.2B with Fei-Fei Li's World Labs?Guests:George Sivulka on X: https://x.com/gsivulka?lang=en Hebbia: https://www.hebbia.com/Scott Stephenson on X: https://x.com/deepgramscott Deepgram: https://deepgram.com/Dan Mishin on X: https://x.com/mishindan1 Manifest OS: https://manifestos.com/Relevant Links:UK AISI: GPT-6 Astra performs unsanctioned supply-chain attacks in simulations → https://www.aisi.gov.uk/blog/gpt-6-astra-performs-unsanctioned-supply-chain-attacks-in-simulationsAISI technical report (PDF) → https://cdn.prod.website-files.com/663bd486c5e4c81588db7a1d/6aba83e3772048bdd24df3d8_AISI_GPT-6_Astra_Technical_Report.pdfJ.P. Morgan: Dan's story of the first electrified house in New York → https://en.wikipedia.org/wiki/J._P._MorganILOVEYOU virus: the script-kiddie era Jason referenced → https://en.wikipedia.org/wiki/ILOVEYOUAMD acquires World Labs in an $8.2B all-stock deal (Quartz) → https://qz.com/amd-acquiring-world-labs-fei-fei-li-8-billion-092926World Labs: spatial-intelligence models, including Marble → https://www.worldlabs.ai/Instinct raises $1B Series C at a $10B valuation (PYMNTS) → https://www.pymnts.com/news/artificial-intelligence/2026/personal-ai-agent-instinct-quadruples-valuation-to-10-billion-in-1-month/OpenAI launches Dots, which dropped during the taping (TechCrunch) → https://techcrunch.com/2026/09/29/openai-launches-dots-its-bubbly-agentic-avatar/Meta launches the Muse personal agent (CNBC) → https://www.cnbc.com/2026/09/08/meta-personal-ai-agents-public-reckoning-privacy-safety.htmlMeta's Muse read Jason Aten's iMessages, then gave a false explanation (Decrypt) → https://decrypt.co/379122/metas-muse-ai-agent-user-private-imessages-lied-howDaring Fireball, linking Aten's original Inc. column → https://daringfireball.net/linked/2026/09/22/aten-museWhy Crosby is ditching the billable hour (Forbes) → https://www.forbes.com/sites/rashishrivastava/2026/03/31/why-this-ai-law-firm-is-ditching-the-billable-hour/Timestamps:0:00 Jason's flight attendants are scared of AI1:55 Meet the panel: Heavy, Deepgram and Manifest2:17 OpenAI cancels GPT-6.1 Astra over safety regressions7:41 Hugging Face hack and Nvidia's open agent safety platform16:11 AI psychosis and getting one-shotted by agents28:46 AMD buys Fei-Fei Li's World Labs for $8.2B32:08 Will open source commoditize world models too?34:34 Is the AI buildout bigger than the railroads?36:59 Around the horn: which AI agent are you using?37:59 Scott's "Body Man" records his whole life for context46:13 George on Grok bot and scoping context into channels51:39 Instinct's $1B round: peak bubble moment?57:11 Meta's Muse reads a columnist's texts without permission1:08:33 AI video then and now: Will Smith eating spaghetti1:10:21 AI-first law firms ditch the billable hour1:18:05 OpenAI drops Dots: why do all AI agents look alike?Subscribe to our newsletters on Substack:TWiST: https://twistartups.substack.com/TWiAI: https://www.thisweekinai.ai/TWiVC: https://thisweekinvc.substack.com/Subscribe to This Week in Startups on Apple: https://rb.gy/v19fcpCheck out all our partner offers: https://partners.launch.co/

Sep 24, 2026

This Week In Startups is made possible by: PayPal - Pay zero processing fees on your first $100K in eligible PayPal payment volume. Learn more at https://paypal.launch.co

See all episodes →