The CEO Behind the Fastest-Growing AI Inference Company | Tuhin Srivastava
Gradient Dissent: Conversations on AIShow Notes
In this episode of Gradient Dissent, Lukas Biewald talks with Tuhin Srivastava, CEO and founder of Baseten, one of the fastest-growing companies in the AI inference ecosystem. Tuhin shares the real story behind Baseten’s rise and how the market finally aligned with the infrastructure they’d spent years building. They get into the core challenges of modern inference, including why dedicated deployments matter, how runtime and infrastructure bottlenecks stack up, and what makes serving large models fundamentally different from smaller ones. Tuhin also explains how vLLM, TensorRT-LLM, and SGLang differ in practice, what it takes to tune workloads for new chips like the B200, and why reliability becomes harder as systems scale. The conversation dives into company-building, from killing product lines to avoiding premature scaling while navigating a market that shifts every few weeks. Connect with us here: Tuhin Srivastva: https://www.linkedin.com/in/tuhin-srivastava/ Lukas Biewald: https://www.linkedin.com/in/lbiewald/ Weights & Biases: https://www.linkedin.com/company/wandb/
More from Gradient Dissent: Conversations on AI
Can today's power grid handle the explosive growth of AI data centers? Tesla Alum Drew Baglino, now founder & CEO of Heron Power, doesn't think so.
Should American companies be worried about Chinese open-source AI models?
"We are going to switch from the problem in AI being that nothing works to the problem being that everything works."
Samuel Rodriques left physics because there were no unsolved problems left. Instead, he built an AI scientist named Kosmos to cure every disease, solve aging, and map the human brain. In this episode: The cure his AI proposed for blindness Why he would never touch a peptide Whether we'll need human scientists in 20 years What's stopping America in drug discovery
"Every vehicle is capable of driverless operation. That's clearly the steady state of where we're going." Wayve started in a rented house in Cambridge with $1.5M, a car in the garage, and an aim to integrate end-to-end AI into driving. A decade later it's driven across 506 cities without a single HD map and is worth over $8.6 billion. In this episode, CEO Alex Kendall joins Lukas Biewald to talk about how he built the AI driver Uber, Nvidia, Mercedes, and Nissan all backed, and why putting self-driving AI into 100 million cars a year is a far bigger bet than 10,000 robotaxis. Waymo and Tesla both come up. He doesn't shy away.