Show Notes
Andrew and Justin discuss the Hugging Face breach, which saw an unreleased OpenAI model find its way into the company's systems during internal testing. They also discuss the launch of Opus 5, the ongoing progress made by Chinese models, and the crunch for compute as 10GW data center plans start to make some motion. Plus, a tribute to the late John C. Dvorak.
The Attention Mechanism is now available in video! Check it out here.
Chapters
00:00 - Intro 01:23 - Hugging Face 15:45 - Chinese Models 26:01 - Opus 5 36:11 - 10GW Data Centers 52:29 - RIP John C. Dvorak Hosted on Acast. See acast.com/privacy for more information.
More from The Attention Mechanism with Andrew Mayne
Andrew and Justin examine Meta’s bid for frontier status, mathematicians’ divided response to OpenAI’s wave of new proofs, Anthropic’s growing momentum with Claude, and how Google’s AI push has obscured the search experience that once defined its brand.
Andrew and Justin discuss their wishlist for OpenAI's upcoming Dev Day event, the delay of GPT-6.1, Meta's success with Muse, and more.
Andrew and Justin discuss the swirling rumors surrounding OpenAI's launch plans for this week ahead of Dev Day, a new committee designed to reveal Millennium Prize math problems being solved by ChatGPT, whether an IPO is coming in 2026, and whatever the heck Jev is.
Andrew and Justin react to the industry calls to slow model development in the name of safety, the launch of Astra 6, and more.
Andrew and Justin discuss the follow-up reporting and investigations surrounding the Hugging Face hack, Nvidia's acquisition of Hugging Face, and the looming promise of some fresh models to kick off the fall.