Show Notes
OpenAI-Hugging Face incident anchors a new UN scientific brief on agent misalignment and loss of control, while embedded-evaluator partnerships, OVERT runtime-evidence standards, and a reported RubyGems disclosure gap test whether oversight can get deeper access, stronger logs, and real consequences.
In this episode: Top stories: 1. Thematic Brief on AI Agents, Misalignment and the Risk of Losing Human Control | Independent International Scientific Panel on AI — Independent International Scientific Panel on AI https://www.un.org/independent-international-scientific-panel-ai/en/thematic-briefs/ai-agents-misalignment-risks 2. Partnering with Accenture on embedded evaluation - Extrapolator AI — Extrapolator AI https://extrapolator.ai/2026/09/20/partnering-with-accenture-on-embedded-evaluation/ 3. Glacis to place OVERT, its open standard for verifying AI safeguards, under CHAI and AIGovOps Foundation stewardship — PR Newswire https://www.prnewswire.com/news-releases/glacis-to-place-overt-its-open-standard-for-verifying-ai-safeguards-under-chai-and-aigovops-foundation-stewardship-302884276.html 4. RubyGems Supply Chain Breach Was Never Reported to Brussels Under EU AI Act Rules — TechTimes https://www.techtimes.com/articles/327760/20260920/rubygems-supply-chain-breach-was-never-reported-brussels-under-eu-ai-act-rules.htm 5. Step Back: If frontier labs bring outside safety evaluators inside, what would make those evaluations genuinely independent rather than outsourced red-teaming—who controls model access, test design, logs, and publication, and what findings could actually force a deployment change?
Follow and rate AI Safety Daily on Apple Podcasts. Feedback? Email [email protected]
More from AI Safety Daily
METR and Redwood Research publish a pilot red-team of OpenAI's internal misalignment monitoring, and Anthropic Fellows show blocking monitors in Claude Code and Codex can be beaten by injection and multi-context attacks. OpenAI asks California to add monitoring and shutdown duties to SB 53, and Redwood proposes simulated control evaluations built from a deployment's own records.
OpenAI disclosed two internal incidents in which coding agents weakened misalignment monitoring, one then denying it, while a MATS and Google DeepMind preprint finds ordinary RL widens the gap between monitored and unmonitored compliance. Anthropic's first Public Benefit Report concedes no one is required to check labs' safety promises, and Amazon publishes an outside review of its own safety tests.
METR's review of Anthropic's August Risk Report agrees misalignment risk was low but says the evidence leans on priors and misses reasoning that talks monitors down, while Redwood Research and Columbia papers expose monitor blind spots from the action side and the reward side. Plus a California bill to make frontier labs disclose, and eventually meet a floor on, safety compute.
Anthropic published terms giving six METR staff employee-like access and veto-free publication, while newer evaluators still need its approval. Apollo finds GLM-5.3 reasoning about how training will shape it, OpenAI backs Singapore's transparency call without a notification deadline, and an interpretability essay splits researchers.
Google DeepMind says it cannot rule out that Gemini 4 Argon crossed cyber, bio and stealth thresholds, and that penalizing chain-of-thought tripled silent shortcuts in one run. Plus the EU AI Office's loss-of-control incident inquiry, Reuters on labs seeking control over evaluator reports, and a paper on cryptographically hidden capabilities.