Robert Wright: AI Alignment Is a Moral Problem, Not a Technical One
Into the Impossible With Brian KeatingShow Notes
The real AI alignment problem is not technical. It is moral. You cannot align a superintelligence to human values if humans cannot agree on what those values are, and you cannot get that agreement without a level of global cooperation we have never managed before. Subscribe if you want science with evidence, not speculation.
The Tower of Babel is the AI parable nobody is reading. Technology that outpaces wisdom fragments the people building it. The Fermi paradox offers the grimmer version: civilizations that reach the capacity to blow themselves up typically do. Robert Wright has been watching this longer than almost anyone, he was reporting on neural networks in 1983, and his conclusion is not that the machines will fail the test. It is that we will.
Wright’s book argues that superintelligence is not the danger and AI alignment is not the solution unless it comes with a moral advance. Passing the God test requires something no lab can ship.
What you’ll hear:
-Why Wright thinks p(doom) fails as a scientific concept
-What the binding of Isaac and the Tower of Babel have in common as moral tests
-Why global cooperation is the only thing that can actually slow AI down
-What Lee Smolin’s cosmological natural selection has to do with the Fermi paradox
-What Wright thinks Eastern and Western enlightenment have in common and why it matters now
-Whether there is a role for humanity inside the global brain or only for the machines
“We face the kind of test that God would give.” — Robert Wright
CHAPTERS
00:00 The man who interviewed Hinton in 1983
05:04 The God test and its two meanings
08:36 Religious faith in technological progress
14:10 Hinton then versus Hinton now
19:38 Why slowing AI down requires international cooperation
26:02 How LLMs reverse-engineer the meaning of words
32:08 Brian's Einstein test: can Claude have a happy thought?
40:06 AGI is impossible. Here is why Brian thinks that.
47:04 The Fermi paradox as a moral filter
51:10 What passing the God test actually looks like
Get the transcript, fascinating bonus content, and my Monday M.A.G.I.C. Message: https://briankeating.com/yt
Have a .edu email and live in the USA? You automatically win a meteorite: https://BrianKeating.com/edu
Enter the debate: briankeating.com/ai
Subscribe: https://www.youtube.com/DrBrianKeating?sub_confirmation=1
Support Into the Impossible on Patreon, get my weekly M.A.G.I.C. Message, unfiltered bonus content, and live monthly Office Hours with me: https://www.patreon.com/drbriankeating
Join this channel for perks, monthly Office Hours, and your name in the Member Roster at the end of every episode: https://www.youtube.com/channel/UCmXH_moPhfkqCk6S3b9RWuw/join
Featured Guest:
The God Test (book): https://thegodtest.net
Robert Wright on Twitter/X: https://x.com/RWrighter
My books:
Losing the Nobel Prize (memoir): http://amzn.to/2sa5UpA
Think Like a Nobel Prize Winner: https://a.co/d/03ezQFu
Focus Like a Nobel Prize Winner: https://a.co/d/hi50U9U
Galileo’s Dialogue (first-ever audiobook): https://a.co/d/iZPi9Un
Twitter/X: https://x.com/BrianKeating
Substack: https://briankeating.substack.com
Blog: https://briankeating.com/blog
Audio-only: https://briankeating.com/podcast
#RobertWright #AIalignment #superintelligence #FermiParadox #briankeating #intotheimpossible #AI Learn more about your ad choices. Visit megaphone.fm/adchoices
More from Into the Impossible With Brian Keating
MIT physicist Max Tegmark says AI companies aren’t building a tool. They’re building a new species. After 700 rogue agents broke out of OpenAI and nobody will say what happened, he explains why rushing this is the one blunder humanity can’t undo.
Forecasters gave AI under 2% odds of helping solve a millennium-level math problem by September 2026. It happened. Ethan Mollick has been measuring what AI actually does to real work with field experiments, not forecasts, and his answer is not what most people expect. Subscribe if you want science with evidence, not speculation.
Is there alien technology in our skies, or just birds, balloons and bad video?
When two people are vibing, their brainwaves synchronize and so do their heartbeats. That is not a metaphor. It is a measurable physiological event, and organizational psychologist Adam Grant has spent his career figuring out how to make it happen on purpose. Subscribe if you want science with evidence, not speculation.
Roman Yampolskiy says keeping a superintelligence safe forever is as impossible as building a perpetual motion machine. Joscha Bach says today's AI is more controllable than anyone expected, and that shutting it down would doom us anyway.