Show Notes
Wei Dai is a computer engineer known for his work in cryptography and cryptocurrency systems, and for his long-standing contributions to AI safety, decision theory, and metaphilosophy.
He joined Forethought’s Fin Moorhouse to discuss:
Do we need to solve ‘metaphilosophy’ before we can trust AIs to answer crucial questions about the long-run future?
Is it inevitable that the wisdom of the frontier AIs (their philosophical and strategic competence) will lag dangerously behind their raw capabilities in coding, math, and science?
How do status games distort morally important decisions and conversations, including about the future of AI?
How worried should we be about AI superpersuasion?
The concept of “illegible problems”: crucially important issues that aren’t on almost anyone’s radar
Is philosophical convergence necessary for a good future, or is institutional design enough?
Wei Dai’s personal intellectual and career journey
To respect Wei’s privacy, this episode’s audio is an AI narration of a transcript of a real conversation, which was edited for clarity.
You can read a full transcript here.
To see all Forethought's published research, visit forethought.org/research.
To subscribe to our newsletter, visit forethought.org/subscribe.
More from ForeCast
Will MacAskill (Senior Research Fellow at Forethought) and Mia Taylor (Research Fellow at Forethought) discuss how to use philanthropic money to do the most good during and after the intelligence explosion, and explain why wealthy donors should consider handing off their philanthropy. They talk about:
Matthew Adelstein was a Visiting Scholar at Forethought and blogs as Bentham’s Bulldog, where he writes on ethics, animal welfare, and the long-run future.
Peter Salib is an Assistant Professor of Law at the University of Houston Law Center and co-director of the Center for Law & AI Risk. Simon Goldstein is an associate professor at the University of Hong Kong, a senior editor at AI Frontiers, and a visiting senior scholar at Forethought. They have written together about AI safety, AI rights, and the governance of advanced AI.
Will MacAskill is a senior research fellow at Forethought and the author of What We Owe The Future. Tom Davidson is a senior research fellow at Forethought and the author of a series of reports on AI timelines, takeoff speeds, and AI-enabled coups.
Avi Parrack is a physics PhD student at Stanford and a researcher at Forethought, where he works on AI, space expansion, and governance. He is the lead author of a recent Forethought report on orbital data centers.