Super Data Science: ML & AI Podcast with Jon Krohn

1025: Word Gravity: How Transformers Bend Space, with Dr. Luis Serrano

Super Data Science: ML & AI Podcast with Jon Krohn

Show Notes

In Episode #1025, Dr. Luis Serrano (Founder of Serrano Academy) joins Jon Krohn to explain the paper he co-authored on the curved spacetime of transformer architectures, in which attention stops being a lookup table and becomes something closer to gravity: words bend the space around them, and the embedding of "bank" visibly curves toward "river" as it travels through the layers of the network. In this episode, he recreates Eddington’s 1919 eclipse experiment inside a transformer, draws the line between an LLM workflow and an actual agent, explains why agent evaluation is a step harder than evaluating an essay, and gives the cleanest account of GRPO you will hear.

Additional materials: ⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠https://www.superdatascience.com/1025⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠

Interested in sponsoring a SuperDataScience Podcast episode? Email [email protected] for sponsorship information.

In this episode you will learn:

(00:10:53) What changed, and what survived, between the two editions of Grokking Machine Learning

(00:27:48) Word gravity: how attention pulls "bank" toward "river"

(00:42:12) Why RAG is an LLM workflow rather than an agent

(00:51:23) The two-by-two that explains why GRPO powers reasoning models

More from Super Data Science: ML & AI Podcast with Jon Krohn

Oct 20, 2026

In Episode #1037, Dr. Richard Socher (CEO and Co-Founder of Recursive) joins Jon Krohn to make the case for automating the scientific method itself. Richard’s startup came out of stealth this year with over half a billion dollars raised to build recursively self-improving superintelligence, and his new book, The Eureka Machine, is already a national bestseller. He also co-founded You.com and the venture firm AIX Ventures, was chief scientist at Salesforce, taught the first university course anywhere on neural networks for NLP, and helped build the ImageNet dataset. In this episode, he traces how AI keeps replacing hand-crafted expertise with scale, lays out the four pillars of his Eureka Machine, argues that hallucinations can be a feature for science, explains why recursive self-improvement within a year or two still rules out an overnight takeoff, and names the software and jobs he expects to endure.

Oct 16, 2026

In Episode #1036, Jon Krohn digs into the question parents and teachers keep asking: does AI stop children from learning? Drawing on a wave of new studies, he shows the answer turns entirely on how AI is used, as a shortcut that outsources the thinking, or as a tutor that explains and gives feedback. Along the way: a 30,000-student natural experiment in China, a striking tutoring result from Turkey, and three practical takeaways that apply just as much to adults using AI at work.

Oct 13, 2026

In Episode #1035, Carly Taylor (Founder of Rebel Data Science) returns to join Jon Krohn for a wide-ranging conversation about leading engineering teams when the ground keeps moving. Carly shipped nine Call of Duty titles in roughly five years at Activision, where she led game security, and has since been a director of engineering at Microsoft and Field CTO for gaming at Databricks. She is also one of the most entertaining people in data on LinkedIn, where more than 200,000 people follow posts she cheerfully calls unhinged. In this episode, she explains why obsessing over the future produces analysis paralysis, which fundamentals never change, how to tell AI slop from AI used well, what the Buddhist practice of inviting Mara to tea has to do with public speaking, and what the glass cliff means for women being promoted into leadership.

Oct 9, 2026

In ICYMI Episode #1034, Jon Krohn moves from what sits underneath AI systems to what it takes to live with them every day. Hear from Aishwarya Srinivasan, Luis Serrano, Katie Malone, Ish Shah and Dilani Kahawala, discussing why the bottleneck in shipping software has moved from execution to judgment, how a physicist recast attention in transformers as words bending space, why years of managing people may be the best preparation for managing AI agents, how one weekend side project burned through billions of tokens and which three problems are hardest to solve when a product has no user interface and never stops running.

Oct 6, 2026

In Episode #1033, Prof. Jeff Hancock (Professor of Communication at Stanford) and Dr. Kate Niederhoffer (Chief Scientist at BetterUp) join Jon Krohn to explain the hidden cost of AI-generated work. A year ago they coined "workslop" in a Harvard Business Review article that went viral and landed the term among Merriam-Webster’s words of the year: content that masquerades as real work but quietly shifts the burden onto whoever receives it. Their research finds that 40% of workers have been sent workslop and 53% admit to producing it, at a cost running to millions of dollars a year for a large organisation. In this episode, they separate workslop from ordinary sloppy work, name the organisational conditions that produce it, introduce their newer concept of relation slipping, and make the case that augmenting people with AI beats automating them away.

See all episodes →