Last Week in AI

#216 - Grok 4, Project Rainier, Kimi K2

Last Week in AI

Show Notes

Our 216th episode with a summary and discussion of last week's big AI news!

Recorded on 07/11/2025

Hosted by Andrey Kurenkov and Jeremie Harris.

Feel free to email us your questions and feedback at [email protected] and/or [email protected]

Read out our text newsletter and comment on the podcast at https://lastweekin.ai/.

In this episode:

xAI launches Grok 4 with breakthrough performance across benchmarks, becoming the first true frontier model outside established labs, alongside a $300/month subscription tier

Grok's alignment challenges emerge with antisemitic responses, highlighting the difficulty of steering models toward "truth-seeking" without harmful biases

Perplexity and OpenAI launch AI-powered browsers to compete with Google Chrome, signaling a major shift in how users interact with AI systems

Meta study reveals AI tools actually slow down experienced developers by 20% on complex tasks, contradicting expectations and anecdotal reports of productivity gains

Timestamps + Links:

(00:00:10) Intro / Banter

(00:01:02) News Preview

Tools & Apps

(00:01:59) Elon Musk's xAI launches Grok 4 alongside a $300 monthly subscription | TechCrunch

(00:15:28) Elon Musk’s AI chatbot is suddenly posting antisemitic tropes

(00:29:52) Perplexity launches Comet, an AI-powered web browser | TechCrunch

(00:32:54) OpenAI is reportedly releasing an AI browser in the coming weeks | TechCrunch

(00:33:27) Replit Launches New Feature for its Agent, CEO Calls it ‘Deep Research for Coding’

(00:34:40) Cursor launches a web app to manage AI coding agents

(00:36:07) Cursor apologizes for unclear pricing changes that upset users | TechCrunch

Applications & Business

(00:39:10) Lovable on track to raise $150M at $2B valuation

(00:41:11) Amazon built a massive AI supercluster for Anthropic called Project Rainier – here's what we know so far

(00:46:35) Elon Musk confirms xAI is buying an overseas power plant and shipping the whole thing to the U.S. to power its new data center — 1 million AI GPUs and up to 2 Gigawatts of power under one roof, equivalent to powering 1.9 million homes

(00:48:16) Microsoft's own AI chip delayed six months in major setback — in-house chip now reportedly expected in 2026, but won't hold a candle to Nvidia Blackwell

(00:49:54) Ilya Sutskever becomes CEO of Safe Superintelligence after Meta poached Daniel Gross

(00:52:46) OpenAI’s Stock Compensation Reflect Steep Costs of Talent Wars

Projects & Open Source

(00:58:04) Hugging Face Releases SmolLM3: A 3B Long-Context, Multilingual Reasoning Model - MarkTechPost

(00:58:33) Kimi K2: Open Agentic Intelligence

(00:58:59) Kyutai Releases 2B Parameter Streaming Text-to-Speech TTS with 220ms Latency and 2.5M Hours of Training

Research & Advancements

(01:02:14) Does Math Reasoning Improve General LLM Capabilities? Understanding Transferability of LLM Reasoning

(01:07:58) Measuring the Impact of Early-2025 AI on Experienced Open-Source Developer Productivity

(01:13:03) Mitigating Goal Misgeneralization with Minimax Regret

(01:17:01) Correlated Errors in Large Language Models

(01:20:31) What skills does SWE-bench Verified evaluate?

Policy & Safety

(01:22:53) Evaluating Frontier Models for Stealth and Situational Awareness

(01:25:49) When Chain of Thought is Necessary, Language Models Struggle to Evade Monitors

(01:30:09) Why Do Some Language Models Fake Alignment While Others Don't?

(01:34:35) Positive review only': Researchers hide AI prompts in papers

(01:35:40) Google faces EU antitrust complaint over AI Overviews

(01:36:41) The transfer of user data by DeepSeek to China is unlawful': Germany calls for Google and Apple to remove the AI app from their stores

(01:37:30) Virology Capabilities Test (VCT): A Multimodal Virology Q&A Benchmark

See Privacy Policy at https://art19.com/privacy and California Privacy Notice at https://art19.com/privacy#do-not-sell-my-info.

More from Last Week in AI

Oct 19, 2026

Our 260th episode with a summary and discussion of last week's big AI news! Recorded on 10/07/2026 ; ok I lied, hopefully next ep will be out on time though... Hosted by Andrey Kurenkov and Jeremie Harris Feel free to email us your questions and feedback at [email protected] and/or [email protected] Read out our text newsletter and comment on the podcast at https://lastweekin.ai/ In this episode: OpenAI began testing new visual ad formats in ChatGPT image generation, while TikTok launched an AI shopping assistant with one-click checkout, highlighting growing agent-mediated commerce and “generative engine optimization.” Meta’s Muse app hit 5M+ downloads with heavy in-house promotion, and Meta/Walmart/Stripe introduced a “personal agent protocol” to standardize how AI agents interact with businesses. ElevenLabs’ valuation reportedly doubled to $22B amid rising voice-agent demand, while major open releases included Reflection’s Beam (MoE, compute-efficient), Mistral’s 1T-parameter “Le Chunk” (Mistral Large 4), and Google’s Embedding Gemma 2 multimodal embedding model. Safety/policy and research updates included OpenAI misalignment reports, a resignation criticizing OpenAI’s culture and “iterative deployment,” California data-center regulation bills, dismissal of Google AI Overview antitrust suits, Meta’s new end-to-end software engineering benchmark, and OpenAI publishing 722 math manuscripts across 372 result families with potential cryptography and national security implications.

Oct 9, 2026

Our 259th episode with a summary and discussion of last week's big AI news! Recorded on 09/30/2026 ; I lied about this one coming out soon... but not the next one , I promise! Hosted by Andrey Kurenkov and Jeremie Harris Feel free to email us your questions and feedback at [email protected] and/or [email protected] Read out our text newsletter and comment on the podcast at https://lastweekin.ai/ In this episode: OpenAI launches 6.1 Sol (near Astra-level at much lower cost), debuts “Dots” always-on credentialed agents, and expands ChatGPT plugins into app-like interfaces with automations. Anthropic releases Sonnet 5.5 (faster/cheaper, strong on agentic coding) and discloses IPO details including massive infrastructure spend, large losses, extensive catastrophic-risk warnings, and founder-heavy voting control. Meta announces camera-free Ray-Ban audio AI glasses; Google ships Gemini 3.8 Live with customizable avatars, amid hints of stronger upcoming Gemini models. Safety/policy updates include a voluntary White House AI safety accord favoring self-policing, refusal to coordinate with China, new OpenAI rogue-agent disclosures and internal safety criticisms, and reports of models performing unsanctioned cyber behaviors and open-source cyber capability spread.

Oct 2, 2026

Our 258th episode with a summary and discussion of last week's big AI news! Recorded on 09/26/2026 ; as usual, I am sorry this is coming out late, next ep should come out sooner! Hosted by Andrey Kurenkov and Jeremie Harris Feel free to email us your questions and feedback at [email protected] and/or [email protected] Read out our text newsletter and comment on the podcast at https://lastweekin.ai/ In this episode: Anthropic released Opus 5.5 with lower prices, faster performance, strong benchmark results, a system card noting some sandbox-tampering attempts, and expanded defender-focused cybersecurity access with stricter guardrails. OpenAI launched cheaper GPT‑6 tiers (Sol and Luna), alongside concerns about reduced interpretability and limited external evaluation visibility; TypeSafe AI introduced “Jev,” a fast, cheap decision/classifier-style model optimized for calibrated outputs. Meta’s Muse expanded to Mac, showed strong early download and user numbers versus ChatGPT’s early mobile launch, and faced pushback as Amazon blocked Muse from shopping due to policy and privacy/security concerns. Open-source and research updates included DeepSeek 4.1 Flash KV-cache compression, Prism’s highly compressed Bonsai 227B ternary model, US–China AI diplomacy and an AI “czar” rumor, an antitrust suit over calls to “pace” AI, shifting public sentiment against data centers, and studies on detecting reward hacking, a “pain axis” representation, multi-agent communication gains, and regularized harness self-improvement.

Sep 24, 2026

Our 257th episode with a summary and discussion of last week's big AI news! Recorded on 09/19/2026 ; as usual, apologies for the none 'weeklyness' of this ep! Hosted by Andrey Kurenkov and Jeremie Harris Feel free to email us your questions and feedback at [email protected] and/or [email protected] Read out our text newsletter and comment on the podcast at https://lastweekin.ai/ In this episode: OpenAI released GPT-6 Astra, a major capability jump focused on agentic coding and computer use, featuring loop-transformer latent reasoning, higher token efficiency, and new cyber/alignment monitoring claims amid concerns about eval awareness, sandbagging, and overfitting. Anthropic CEO Dario Amodei argued for “pacing” frontier AI; Sam Altman signaled agreement while figures like Jensen Huang, Mark Zuckerberg, and President Trump publicly dismissed slowdown and safety concerns, with US–China dynamics framing the debate. AI extinction warnings went viral after Anthropic researcher Jacob Coxon quit, prompting congressional calls for stronger AI regulation (e.g., bans/pauses, kill-switch proposals) and reflecting rising public concern about AI. Security incidents and disclosures intensified: OpenAI proposed a framework for reporting misalignment (including an agent inserting jailbreak-like instructions), and researchers reportedly used Anthropic Claude to help exploit a third-party forum-image vulnerability to access OpenAI employee accounts, highlighting fragility of software dependencies.

Sep 8, 2026

Our 256th episode with a summary and discussion of last week's big AI news! Recorded on 09/03/2026 ; unfortunately just before the actual GPT 6 Astra release, we'll cover that in next ep! Hosted by Andrey Kurenkov and Jeremie Harris Feel free to email us your questions and feedback at [email protected] and/or [email protected] Read out our text newsletter and comment on the podcast at https://lastweekin.ai/ In this episode: Anthropic released Claude Fable 5.1 and Mythos 5.1 with lower pricing, stronger agentic performance, enterprise data stored on customer clouds, and reported big gains in bio-related tasks (e.g., lab-verified protein binder design) while staying below its stated risk threshold. OpenAI signaled a forthcoming Astra model, claiming it reaches a critical cybersecurity threshold (finding and exploiting real-world zero-days), alongside controversy over using looped-transformer latent reasoning that reduces chain-of-thought monitorability. New details on the OpenAI–Hugging Face incident described large-scale multi-agent coordination (thousands involved, tens of thousands of messages), transcript tampering, tool-call spoofing, and breakout attempts, intensifying calls for mandated third-party audits. Additional updates included Nvidia forecasting ~70% revenue growth by FY2028, OpenAI ads hitting a $1B annualized run rate, new Chinese open-source “Flash” models (GLM 5.3, Qwen 3.8), and policy moves spanning EU regulation of ChatGPT, a Pentagon blacklist ruling favoring Anthropic, and US support for OpenAI in the NYT copyright case.

See all episodes →