High-Efficiency Diffusion Models for On-Device Image Generation and Editing with Hung Bui - #753
The TWIML AI Podcast (formerly This Week in Machine Learning & Artificial Intelligence)Show Notes
In this episode, Hung Bui, Technology Vice President at Qualcomm, joins us to explore the latest high-efficiency techniques for running generative AI, particularly diffusion models, on-device. We dive deep into the technical challenges of deploying these models, which are powerful but computationally expensive due to their iterative sampling process. Hung details his team's work on SwiftBrush and SwiftEdit, which enable high-quality text-to-image generation and editing in a single inference step. He explains their novel distillation framework, where a multi-step teacher model guides the training of an efficient, single-step student model. We explore the architecture and training, including the use of a secondary 'coach' network that aligns the student's denoising function with the teacher's, allowing the model to bypass the iterative process entirely. Finally, we discuss how these efficiency breakthroughs pave the way for personalized on-device agents and the challenges of running reasoning models with techniques like inference-time scaling under a fixed compute budget.
The complete show notes for this episode can be found at https://twimlai.com/go/753.
More from The TWIML AI Podcast (formerly This Week in Machine Learning & Artificial Intelligence)
AI agents need the institutional knowledge experienced employees rely on: why a system works a certain way, which policies apply, and what never made it into the documentation. Capturing that knowledge is hard. Keeping it useful as people and agents add more may be harder.
In this episode, Zoe Weil, co-founder and CEO of Sequen, joins us to discuss how ranking systems can use live behavioral signals to optimize for purchases rather than clicks or search relevance alone. Zoe explains why approaches developed at data-rich social platforms don’t necessarily translate to retailers and how Sequen uses scroll speed, hover duration, and other in-session interactions to infer shopper intent without relying on user identity.
In this episode, Diogo Almeida, co-founder and CEO of TypeSafe, joins us to discuss Jev, TypeSafe’s recently released model for bringing fast, reliable intelligence directly into software. We explore the idea of “machine-native intelligence” and why Diogo believes models optimized for generating text are poorly suited to many of the decisions required for real-world automation. He explains how Jev differs from traditional classifiers and LLM-based approaches, the role of reinforcement learning from calibrated decisions (RLCD), and why calibration and reliability are central to making AI useful as a software primitive. We also discuss the relationship between models and code, why Diogo believes AI systems should become more engineered rather than relying on a single model to do everything, and how Jev-like models could reshape agents, tool use, and the architecture of AI-powered software.
AI systems have gone from struggling with grade-school math to helping solve research problems that have resisted mathematicians for decades, including Navier-Stokes.
Voice AI has gotten remarkably good, but natural conversation remains a high bar. Small delays, awkward interruptions, or the wrong tone can quickly break the illusion—and adding vision and visual presence only raises the stakes.