LessWrong posts by zvi

“The Extinction Risk Preference Cascade: Quotes” by Zvi

LessWrong posts by zvi

Show Notes

These are quotes from OpenAI, Anthropic and Google employees, in the wake of Jacob Coxon's warnings, in which the employees confirm that they think AI might soon kill everyone.

If more quotes come in over the next week or so, I will update this post accordingly.

Preference Cascade Statements At OpenAI: Tomek Korbak

Tomek Korbak (OpenAI): i’m late to the party but: from his time at OpenAI I remember Jacob as a very thoughtful researcher and he continues to be so in this thread. neither anthropic nor openai are on track to solve alignment to a degree sufficient for shipping superintelligence and we need to slow down

Vie McCoy

Vie McCoy (OpenAI): I think pacing progress and ensuring human enhancement is the only way that we don’t get out-evolved while retaining the dream of superintelligence.

In this context, I see two paths before us.

In the first, we race towards RSI without embedding human flourishing and human enhancement as a deep value within the models, and by and large either get left behind or suffer catastrophic losses.

In the second, we set the pace of progress, focus on embedding human flourishing [...] --- Outline: (00:27) Preference Cascade Statements At OpenAI: Tomek Korbak (00:55) Vie McCoy (03:46) Adam Majmudar (05:05) Aidan Clark (05:46) Mo Bavarian (07:32) Boaz Barak (08:20) Micah Carroll (09:15) Roon (12:55) Confirmations At OpenAI: Dean Ball (14:39) Leo Gao (14:57) Anthropic's Evan Hubinger Confirms His Stance (15:50) Preference Cascade at Anthropic: Samuel Marks (17:36) Anna Wang (18:22) Ethan Perez (18:59) Dima Krasheninnikov (19:27) EigenGender (Anon Account) (19:58) Joe Benton (20:07) Confirmation at Anthropic: Drake Thomas (21:28) Jan Lieke (22:07) Sluggy (22:29) Preference Cascade at Google (22:56) Andreas Kirsch (23:39) Neel Nanda (24:15) Victoria Krakovna (25:26) Vishal Maini (27:01) Joe (OpenAI, ex-Google) (28:21) Josh Engels (28:39) Geoffrey Irving (29:30) Alex Turner and Geoffrey Hinton: Classic Examples (29:45) #NotAllMembersOfTechnicalStaff: Ted Sanders ---

First published:

September 11th, 2026

Source:

https://www.lesswrong.com/posts/APGvWZtXEwkinvHDd/the-extinction-risk-preference-cascade-quotes

---

Narrated by TYPE III AUDIO.

--- Images from the article: Apple Podcasts and Spotify do not show images in the episode description. Try Pocket Casts, or another podcast app.

More from LessWrong posts by zvi

Oct 22, 2026

It was the probably worst day in cybersecurity history. So far. Not only is there a critical flaw in PHP that due to a leak was announced a day before the fix would be available, sending most of the internet scrambling for solutions and likely dooming a lot of long tail websites permanently, there were several other unrelated incidents. The floodgates seem to have been opened. I have a market on whether there will be an even worse day before the end of the year.

Oct 21, 2026

A lot of AIs were misaligned this week. A fun little survey.

Oct 20, 2026

Anthony Cimino offered the closest thing to an official response we have seen on the leaked Anthropic draft bill I covered on Saturday.

Oct 19, 2026

Nick Cammarata of Goodfire makes a bold claim: Neural Networks are Already Clean. This was his follow up after various resulting online discussions.

Oct 17, 2026

There is a newly leaked bill that Anthropic is purportedly shopping around is (if you assume its bugs get fixed).

See all episodes →