
1003: Building an AI Data Center End to End, with Lightning AI’s Frank Basso
Super Data Science: ML & AI Podcast with Jon KrohnShow Notes
Frank Basso, VP of Infrastructure at Lightning AI, joins Jon Krohn for a rare ground-level tour of the one layer of the AI stack the show had never covered in over a thousand episodes: the physical data center. Frank explains how Lightning AI provisions its 35,000-plus GPUs through hyperscale co-location, why everything new is liquid-to-chip cooled, how GPUs talk to each other over ultra-fast east-west networks, and what it’s actually like to stand inside a 110-decibel AI data hall. He also debunks the most persistent myths about data-center water and electricity use, and makes the case for fuel cells, nuclear power, and 800-volt DC distribution as the path forward.
Additional materials: https://www.superdatascience.com/1003
Interested in sponsoring a SuperDataScience Podcast episode? Email [email protected] for sponsorship information.
In this episode you will learn:
(02:47) What actually makes an AI data center different from a traditional one
(06:04) How Lightning AI provisions its 35,000+ GPUs through hyperscale co-location
(24:01) Why liquid cooling doesn’t waste water, debunking the biggest data-center myth
(29:46) East-west vs. north-south networks, explained
(43:47) “Screaming banshees”: why AI data halls run at 105–110 decibels
(51:52) Why data centers don’t actually drive up your power bill
More from Super Data Science: ML & AI Podcast with Jon Krohn
In Episode #1037, Dr. Richard Socher (CEO and Co-Founder of Recursive) joins Jon Krohn to make the case for automating the scientific method itself. Richard’s startup came out of stealth this year with over half a billion dollars raised to build recursively self-improving superintelligence, and his new book, The Eureka Machine, is already a national bestseller. He also co-founded You.com and the venture firm AIX Ventures, was chief scientist at Salesforce, taught the first university course anywhere on neural networks for NLP, and helped build the ImageNet dataset. In this episode, he traces how AI keeps replacing hand-crafted expertise with scale, lays out the four pillars of his Eureka Machine, argues that hallucinations can be a feature for science, explains why recursive self-improvement within a year or two still rules out an overnight takeoff, and names the software and jobs he expects to endure.
In Episode #1036, Jon Krohn digs into the question parents and teachers keep asking: does AI stop children from learning? Drawing on a wave of new studies, he shows the answer turns entirely on how AI is used, as a shortcut that outsources the thinking, or as a tutor that explains and gives feedback. Along the way: a 30,000-student natural experiment in China, a striking tutoring result from Turkey, and three practical takeaways that apply just as much to adults using AI at work.
In Episode #1035, Carly Taylor (Founder of Rebel Data Science) returns to join Jon Krohn for a wide-ranging conversation about leading engineering teams when the ground keeps moving. Carly shipped nine Call of Duty titles in roughly five years at Activision, where she led game security, and has since been a director of engineering at Microsoft and Field CTO for gaming at Databricks. She is also one of the most entertaining people in data on LinkedIn, where more than 200,000 people follow posts she cheerfully calls unhinged. In this episode, she explains why obsessing over the future produces analysis paralysis, which fundamentals never change, how to tell AI slop from AI used well, what the Buddhist practice of inviting Mara to tea has to do with public speaking, and what the glass cliff means for women being promoted into leadership.
In ICYMI Episode #1034, Jon Krohn moves from what sits underneath AI systems to what it takes to live with them every day. Hear from Aishwarya Srinivasan, Luis Serrano, Katie Malone, Ish Shah and Dilani Kahawala, discussing why the bottleneck in shipping software has moved from execution to judgment, how a physicist recast attention in transformers as words bending space, why years of managing people may be the best preparation for managing AI agents, how one weekend side project burned through billions of tokens and which three problems are hardest to solve when a product has no user interface and never stops running.
In Episode #1033, Prof. Jeff Hancock (Professor of Communication at Stanford) and Dr. Kate Niederhoffer (Chief Scientist at BetterUp) join Jon Krohn to explain the hidden cost of AI-generated work. A year ago they coined "workslop" in a Harvard Business Review article that went viral and landed the term among Merriam-Webster’s words of the year: content that masquerades as real work but quietly shifts the burden onto whoever receives it. Their research finds that 40% of workers have been sent workslop and 53% admit to producing it, at a cost running to millions of dollars a year for a large organisation. In this episode, they separate workslop from ordinary sloppy work, name the organisational conditions that produce it, introduce their newer concept of relation slipping, and make the case that augmenting people with AI beats automating them away.