Show Notes
Jesse Hoogland is a research assistant at David Krueger's lab in Cambridge studying AI Safety. More recently, Jesse has been thinking about Singular Learning Theory and Developmental Interpretability, which we discuss in this episode. Before he came to grips with existential risk from AI, he co-founded a health-tech startup automating bariatric surgery patient journeys.
(00:00) Intro
(03:57) Jesse’s Story And Probability Of Doom
(06:21) How Jesse Got Into Singular Learning Theory
(08:50) Intuition behind SLT: the loss landscape
(12:23) Does SLT actually predict anything? Phase Transitions
(14:37) Why care about phase transition, grokking, etc
(15:56) Detecting dangerous capabilities like deception in the (devel)opment
(17:24) A concrete example: magnets
(20:06) Why Jesse Is Bullish On Interpretability
(23:57) Developmental Interpretability
(28:06) What Happens Next? Jesse’s Vision
(31:56) Toy Models of Superposition
(32:47) Singular Learning Theory Part 2
(36:22) Are Current Models Creative? Reasoning?
(38:19) Building Bridges Between Alignment And Other Disciplines
(41:08) Where To Learn More About Singular Learning Theory
Make sure I upload regularly: https://patreon.com/theinsideview
Youtube: https://youtu.be/713KyknwShA
Transcript: https://theinsideview.ai/jesse
Jesse: https://twitter.com/jesse_hoogland
Host: https://twitter.com/MichaelTrazzi
Patreon supporters:
- Vincent Weisser
- Gunnar Höglund
- Ryan Coppolo
- Edward Huff
- Emil Wallner
- Jesse Hoogland
- William Freire
- Cameron Holmes
- Jacques Thibodeau
- Max Chiswick
- Jack Seroy
- JJ Hepburn
More from The Inside View
Owain Evans is an AI Alignment researcher, research associate at the Center of Human Compatible AI at UC Berkeley, and now leading a new AI safety research group.
This is a special crosspost episode where Adam Gleave is interviewed by Nathan Labenz from the Cognitive Revolution. At the end I also have a discussion with Nathan Labenz about his takes on AI.
Ethan Perez is a Research Scientist at Anthropic, where he leads a team working on developing model organisms of misalignment.
Emil is the co-founder of palette.fm (colorizing B&W pictures with generative AI) and was previously working in deep learning for Google Arts & Culture.
Evan Hubinger leads the Alignment stress-testing at Anthropic and recently published "Sleeper Agents: Training Deceptive LLMs That Persist Through Safety Training".