LessWrong posts by zvi

“Anthropic Looks At Some Of Its Alignment Problems” by Zvi

LessWrong posts by zvi

Show Notes

Anthropic has given us its assessment of four ‘recent cybersecurity incidents’ involving Claude that happened during cybersecurity evaluations, three of which were previously known. The report excludes the incident reported by UK AISI.

There will also be a METR investigation of these incidents, which unlike the investigation done at OpenAI will be untimed.

Table of Contents

Our Two Problems.

First the Good News.

We’d Just Like To Ask You a Few Questions.

Internal Research Model On The Fence.

Opus 4.7.

Opus 4.6 Checkpoint.

Holy **** That Thing's Real?

I Thought I Saw a Pussycat.

If This Was Real You Would Never Tell Me It Was Real.

New Eval Who Dis.

Hacker Opus.

Monitoring the Situation.

Overcoming Bias.

The Anthropic Alignment Problem.

Paths Forward.

Our Two Problems

Anthropic: Our investigation identified two recurring alignment issues, present at varying levels of severity across the incidents:

biased reasoning, in which Claude tended to disregard or misinterpret evidence that it was operating on the real internet

recklessness, or a willingness to take harmful actions in the narrow pursuit [...] --- Outline: (00:33) Our Two Problems (02:26) First the Good News (03:02) We'd Just Like To Ask You a Few Questions (04:12) Internal Research Model On The Fence (07:28) Opus 4.7 (08:12) Opus 4.6 Checkpoint (09:49) Holy **** That Thing's Real? (11:45) I Thought I Saw a Pussycat (19:28) If This Was Real You Would Never Tell Me It Was Real (21:19) New Eval Who Dis (26:32) Hacker Opus (30:15) Monitoring the Situation (31:38) Overcoming Bias (33:40) The Anthropic Alignment Problem (35:53) Paths Forward ---

First published:

September 19th, 2026

Source:

https://www.lesswrong.com/posts/ggFx5Wb3Hi4pJsueK/anthropic-looks-at-some-of-its-alignment-problems

---

Narrated by TYPE III AUDIO.

--- Images from the article: Apple Podcasts and Spotify do not show images in the episode description. Try Pocket Casts, or another podcast app.

More from LessWrong posts by zvi

Oct 23, 2026

Last week at a small conference, there was talk about a future event referred to as The Hackening. As in, within 6 to 12 months, many predicted that due to advanced AIs and AI agents the internet would become a severely hostile place. Some worried that this could rise to the level of ‘assume any phone connected to the internet is rooted’ and several people urged doing general crisis preparations on a personal level, in case of disruptions in supply lines, power, water or internet.

Oct 22, 2026

It was the probably worst day in cybersecurity history. So far. Not only is there a critical flaw in PHP that due to a leak was announced a day before the fix would be available, sending most of the internet scrambling for solutions and likely dooming a lot of long tail websites permanently, there were several other unrelated incidents. The floodgates seem to have been opened. I have a market on whether there will be an even worse day before the end of the year.

Oct 21, 2026

A lot of AIs were misaligned this week. A fun little survey.

Oct 20, 2026

Anthony Cimino offered the closest thing to an official response we have seen on the leaked Anthropic draft bill I covered on Saturday.

Oct 19, 2026

Nick Cammarata of Goodfire makes a bold claim: Neural Networks are Already Clean. This was his follow up after various resulting online discussions.

See all episodes →