Show Notes
Visit Mixture of Experts podcast page to get more AI content → https://www.ibm.com/think/podcasts/mixture-of-experts
This week on Mixture of Experts, our team of panelists talk about big infrastructure changes and small models. IBM is teaming up with Together AI on a multi-year deal to build a massive inference cluster on IBM Cloud, powered by NVIDIA's newest chips. The goal: cheaper, faster access to open-source AI models for enterprises, with the cluster expected to go live in early 2027.
Then there's Meta, which just open-sourced Muse Glimmer—a 30B-parameter model small enough to run locally on your laptop's GPU. Think coding, function calling, and agent tasks, all without needing the cloud. But as models get smaller, what does it mean for larger AI providers?
And finally, the story that's got everyone talking: OpenAI says its upcoming Astra model might be hitting "Critical" cybersecurity capability levels, meaning it could potentially find and exploit zero-days on its own. We dig into what that actually means and what guardrails OpenAI is putting up.
00:00 – Intro
1:03 - IBM AI Partnership
11:43 - Meta Muse Glimmer
24:10 - OpenAI’s Astra model
All that and more on Mixture of Experts.
"The opinions expressed in this podcast are solely those of the participants and do not necessarily reflect the views of IBM or any other organization or entity. AI tools may be used to transcribe this episode and support selected stages of the production process. All AI-assisted content is reviewed by the production team before publication."
More from Mixture of Experts
Visit Mixture of Experts podcast page to get more AI content → https://www.ibm.com/think/podcasts/mixture-of-experts What happens when an AI model can copy itself onto the devices in yout hoome?
Visit Mixture of Experts podcast page to get more AI content → https://www.ibm.com/think/podcasts/mixture-of-experts This week on Mixture of Experts, host David Zax is joined by Kaoutar El Maghraoui, Nick Gallagher, and Volkmar Uhlig. First, Microsoft, OpenAI, Perplexity, and Cloudflare follow TypeSafe’s Jev in building decision models, a new category of AI built to make fast, scored judgments. The panel debates whether these models are truly new or a more efficient application of existing technology, and whether better-calibrated confidence scores can help address the overconfidence problem in LLMs. Next, a new study finds that teams of AI agents can cost two to five times more than a single agent without consistently delivering better results. The panel discusses when multiple agents are worth the added cost and complexity. Finally, Anthropic updates its usage policy to prohibit “sustained and needless abusive or cruel behavior” toward its models, raising a bigger question: Is this about protecting AI, shaping human behavior, or something else entirely? The panel considers the ethical implications and whether the policy could also be a marketing play.
Visit Mixture of Experts podcast page to get more AI content → https://www.ibm.com/think/podcasts/mixture-of-experts
Visit Mixture of Experts podcast page to get more AI content → https://www.ibm.com/think/podcasts/mixture-of-experts
Visit Mixture of Experts podcast page to get more AI content → https://www.ibm.com/think/podcasts/mixture-of-experts