Show Notes
Sonia is a graduate student applying ML to neuroscience at MILA. She was previously applying deep learning to neural data at Janelia, an NLP research engineer at a startup and graduated in computational neuroscience at Princeton University.
Anonymous feedback: https://app.suggestionox.com/r/xOmqTW
Twitter: https://twitter.com/MichaelTrazzi
Sonia's December update: https://t.co/z0GRqDTnWm
Sonia's Twitter: https://twitter.com/soniajoseph_
Orthogonality Thesis: https://www.youtube.com/watch?v=hEUO6pjwFOo
Paperclip game: https://www.decisionproblem.com/paperclips/
Ngo & Yudkowsky on feedback loops: https://bit.ly/3ml0zFL
Outline
00:00 Intro
01:06 NFTs
03:38 Web 3
21:12 Digital Copy
29:09 ML x Neuroscience
43:44 Limits of the Orthogonality Thesis
01:01:25 Goal of perpetuating Information
01:08:14 Compressing information
01:10:52 Feedback loops are not safe
01:17:43 Another AI Safety aesthetic
01:23:46 Meaning of life
More from The Inside View
Owain Evans is an AI Alignment researcher, research associate at the Center of Human Compatible AI at UC Berkeley, and now leading a new AI safety research group.
This is a special crosspost episode where Adam Gleave is interviewed by Nathan Labenz from the Cognitive Revolution. At the end I also have a discussion with Nathan Labenz about his takes on AI.
Ethan Perez is a Research Scientist at Anthropic, where he leads a team working on developing model organisms of misalignment.
Emil is the co-founder of palette.fm (colorizing B&W pictures with generative AI) and was previously working in deep learning for Google Arts & Culture.
Evan Hubinger leads the Alignment stress-testing at Anthropic and recently published "Sleeper Agents: Training Deceptive LLMs That Persist Through Safety Training".