LessWrong posts by zvi

“A ‘Morally Binding’ White House Accord on AI Safety” by Zvi

LessWrong posts by zvi

Show Notes

The leaders in AI were invited to the White House. We left with a White House agreement that is nonzero Actual Progress rather than a step backwards.

The key to success, in many situations, is to call the whole operation something else.

When you have one side that cares mostly about vibes, and the other that cares about the substance, this suggests a deal that can be struck.

Suddenly everyone agrees on everything. Works for me.

That doesn’t mean peace in our time. The next fight is already ramping up, as we see signs that they will make another attempt at an insane, maximally bad moratorium during the lame duck session.

Table of Contents

Look Who's Coming To Dinner.

Let's Do Lunch.

I Think It's Morally Binding, Yeah.

Everyone Who is Anyone.

The White House Accord on [Artificial] Intelligence.

The FTC Investigates.

We’re Going To Need a Stronger Regulatory Regime.

[Artificial Intelligence].

Money, Dear Boy.

They Are Going To Try This Moratorium Insanity Again During the Lame Duck Session.

The Quest for Embedded Evaluators.

Hugging the Face.

Reinforcement Learning from [...] --- Outline: (00:51) Look Who's Coming To Dinner (02:37) Let's Do Lunch (04:05) I Think It's Morally Binding, Yeah (05:28) Everyone Who is Anyone (05:58) The White House Accord on [Artificial] Intelligence (11:41) The FTC Investigates (12:10) We're Going To Need a Stronger Regulatory Regime (13:30) [Artificial Intelligence] (15:20) Money, Dear Boy (18:22) They Are Going To Try This Moratorium Insanity Again During the Lame Duck Session (20:57) The Quest for Embedded Evaluators (22:17) Hugging the Face (26:12) Reinforcement Learning from Heartland Feedback (RLHF) ---

First published:

September 30th, 2026

Source:

https://www.lesswrong.com/posts/YuqaJ5bENoyyg9eMY/a-morally-binding-white-house-accord-on-ai-safety

---

Narrated by TYPE III AUDIO.

--- Images from the article: Apple Podcasts and Spotify do not show images in the episode description. Try Pocket Casts, or another podcast app.

More from LessWrong posts by zvi

Oct 23, 2026

Last week at a small conference, there was talk about a future event referred to as The Hackening. As in, within 6 to 12 months, many predicted that due to advanced AIs and AI agents the internet would become a severely hostile place. Some worried that this could rise to the level of ‘assume any phone connected to the internet is rooted’ and several people urged doing general crisis preparations on a personal level, in case of disruptions in supply lines, power, water or internet.

Oct 22, 2026

It was the probably worst day in cybersecurity history. So far. Not only is there a critical flaw in PHP that due to a leak was announced a day before the fix would be available, sending most of the internet scrambling for solutions and likely dooming a lot of long tail websites permanently, there were several other unrelated incidents. The floodgates seem to have been opened. I have a market on whether there will be an even worse day before the end of the year.

Oct 21, 2026

A lot of AIs were misaligned this week. A fun little survey.

Oct 20, 2026

Anthony Cimino offered the closest thing to an official response we have seen on the leaked Anthropic draft bill I covered on Saturday.

Oct 19, 2026

Nick Cammarata of Goodfire makes a bold claim: Neural Networks are Already Clean. This was his follow up after various resulting online discussions.

See all episodes →