Data Governance, Sovereignty, and the Enterprise AI Infrastructure Playbook - with Rodrigo Liang of Sambanova
AI in Infrastructure PodcastShow Notes
Enterprises are past asking whether LLMs work; the harder question is how to run them at scale without becoming dependent on a single model, cloud, or chip vendor — and without running out of power or data-center capacity in the process.
In this episode, Rodrigo Liang, Co-founder and CEO of SambaNova, examines why sovereignty and business continuity now anchor enterprise infrastructure strategy, why regulated firms are keeping customer data inside their own firewalls as a first step, and why the enterprises moving fastest are planning for 100% of the business to be AI-enabled rather than gating use cases one at a time, with host Daniel Faggella, Emerj CEO and Head of Research. Liang outlines the practical shifts underway: from single-vendor stacks toward breadth across models, clouds, and chip architectures, from black-box outputs toward agentic workflows with checkable steps, and from scattered pilots toward code generation as the first use case that reveals what AI at scale will cost. To go deeper on this topic and learn how leading organizations approach AI investment more like a venture portfolio, and why interdisciplinary collaboration is critical to defining the right data for AI success, download our free PDF report, "Beginning with AI," at emerj.com/aik4
More from AI in Infrastructure Podcast
AI agents can place new demands on existing infrastructure, from database traffic to permissions for accessing and modifying information. In this episode, Alistair Speirs, General Manager of Global Platforms in Microsoft's Azure business, joins Daniel Faggella, Emerj CEO and Head of Research, to examine how organizations can adapt their systems while reducing administrative work for employees. He discusses processing expense receipts through familiar chat tools, governing agent access, and preserving model and deployment options as infrastructure costs and business requirements evolve.
Mobile networks were built for predictable human behavior, not the nonstop demands of agentic and physical AI. In this episode, Pallavi Mahajan, Chief Technology and AI Officer at Nokia, examines why AI workloads demand deterministic connectivity rather than traditional reliability benchmarks, and how networks are shifting from passive transport to active participants in AI decision-making. The conversation covers the shift from over-provisioning to AI-native network intelligence, the move toward distributed compute at the edge, and new capabilities like integrated sensing and real-time translation built directly into network infrastructure.
AI pilots that perform flawlessly in testing often stall the moment they reach production, and enterprise leaders are left wondering why.
The enterprise shift at the center of this episode is the growing gap between AI ambition and the underlying data and context infrastructure required to run systems reliably at scale.
General‑purpose AI tools are hitting reliability and accuracy limits in professional workflows, forcing enterprises to rethink where these systems can truly deliver operational value.