Show Notes
What’s the future of AI code generation? This week on Mixture of Experts, host Tim Hwang is joined by Chris Hay, Olivia Buzek and Gabe Goodhart to debrief the biggest AI use-case of 2025: AI-powered software engineering.
Claude Opus 4.5 solved a months-long optimization in under an hour but failed spectacularly at simple tasks. The barbell effect is real. Next, who's the architect—you or the model? We discuss agent orchestration, context windows and why tool performance varies wildly. Then, model differentiation: are OpenAI and Anthropic fundamentally different, or does agent architecture matter more? Finally, can open-source compete with closed ecosystems? We explore vertical integration, inference costs and the future of open models. All that and more on this week's Mixture of Experts.
00:00 – Introduction
01:11 – The barbell problem: AI coding wins and fails
03:46 – Claude Code cracks Apple Metal optimization
07:52 – Who's the architect: You or the AI?
11:44 – Model vs agent orchestration
20:44 – The future of unsupervised AI agents
24:30 – Open source vs proprietary tools
33:22 – The inference cost challenge
The opinions expressed in this podcast are solely those of the participants and do not necessarily reflect the views of IBM or any other organization or entity.
Subscribe for AI updates → https://www.ibm.com/account/reg/us-en/signup?formid=news-urx-52120
Visit Mixture of Experts podcast page to get more AI content → https://www.ibm.com/think/podcasts/mixture-of-experts
Learn more about AI code generation → https://www.ibm.com/think/topics/ai-code-generation
More from Mixture of Experts
Visit Mixture of Experts podcast page to get more AI content → https://www.ibm.com/think/podcasts/mixture-of-experts What happens when an AI model can copy itself onto the devices in yout hoome?
Visit Mixture of Experts podcast page to get more AI content → https://www.ibm.com/think/podcasts/mixture-of-experts This week on Mixture of Experts, host David Zax is joined by Kaoutar El Maghraoui, Nick Gallagher, and Volkmar Uhlig. First, Microsoft, OpenAI, Perplexity, and Cloudflare follow TypeSafe’s Jev in building decision models, a new category of AI built to make fast, scored judgments. The panel debates whether these models are truly new or a more efficient application of existing technology, and whether better-calibrated confidence scores can help address the overconfidence problem in LLMs. Next, a new study finds that teams of AI agents can cost two to five times more than a single agent without consistently delivering better results. The panel discusses when multiple agents are worth the added cost and complexity. Finally, Anthropic updates its usage policy to prohibit “sustained and needless abusive or cruel behavior” toward its models, raising a bigger question: Is this about protecting AI, shaping human behavior, or something else entirely? The panel considers the ethical implications and whether the policy could also be a marketing play.
Visit Mixture of Experts podcast page to get more AI content → https://www.ibm.com/think/podcasts/mixture-of-experts
Visit Mixture of Experts podcast page to get more AI content → https://www.ibm.com/think/podcasts/mixture-of-experts
Visit Mixture of Experts podcast page to get more AI content → https://www.ibm.com/think/podcasts/mixture-of-experts