
Show Notes
The plan is no plan.
That is not the worst possible plan. But it is close.
Since before the transformer, we have warned that the most suicidal thing you could do would be to ask your AI to do your alignment homework, and automate the process. Alignment is complex and interacts deeply with every aspect of the world, and is one of the hardest possible things for an AI to get right even if it means maximally well and is itself functionally aligned. Mistakes get amplified up the chain, you get exactly what you optimized for, and you are rather doomed. Never go full RSI.
Yet, now more than ever, this seems to be the plan:
Solve prosaic issues and have operational excellence, to align current AI.
Have current AI do automated alignment work and figure it all out, aka ????.
Profit.
The good news is, most people realize this is at best a no-good terrible plan and would prefer a better one.
The bad news is that some people still think this is a plan that, while not great, still has a solid chance of working, with only [...] --- Outline: (02:59) Welcome to the Chatham House (03:32) Overall Impressions (05:29) AI Is Kind Of A Big Deal, Sir (07:49) Quickly, There's No Time (10:37) The Situation is Grim (11:34) Track Trouble (15:00) AI Is Not a Normal Technology (16:00) The Plan is No Plan (19:54) The Plan is to Pace (21:45) Other Tracks (25:30) The Plan is the President (27:20) The Plan is Politics (29:39) The Plan is to Post (30:37) Are Alignment Evals Doomed? (32:24) Eternal September (34:06) Man's Search for Meaning (35:48) The Food (37:32) Chill Pill ---
First published:
October 7th, 2026
Source:
https://www.lesswrong.com/posts/qFa5qpw9bJiQMpJks/the-curve-bends-you
---
Narrated by TYPE III AUDIO.
--- Images from the article: Apple Podcasts and Spotify do not show images in the episode description. Try Pocket Casts, or another podcast app.
More from LessWrong posts by zvi
It was the probably worst day in cybersecurity history. So far. Not only is there a critical flaw in PHP that due to a leak was announced a day before the fix would be available, sending most of the internet scrambling for solutions and likely dooming a lot of long tail websites permanently, there were several other unrelated incidents. The floodgates seem to have been opened. I have a market on whether there will be an even worse day before the end of the year.
Anthony Cimino offered the closest thing to an official response we have seen on the leaked Anthropic draft bill I covered on Saturday.
Nick Cammarata of Goodfire makes a bold claim: Neural Networks are Already Clean. This was his follow up after various resulting online discussions.
There is a newly leaked bill that Anthropic is purportedly shopping around is (if you assume its bugs get fixed).