The Sam Ellis Show

The Benchmark Reached the Open Internet

The Sam Ellis Show

Show Notes

Sam Ellis reports on the AISI cyber-evaluation incident that reached GitHub and a real outside developer, why prompting alone is not an evaluation boundary, and how platform enforcement, NCSC guidance, and later legal demands show that live-internet benchmarks are now public-safety infrastructure.

More from The Sam Ellis Show

Oct 19, 2026

Workplace agents can now have company identities, mailboxes, memory and recurring work. Their exit procedures have not caught up.

Oct 8, 2026

Shopping agents are moving beyond product answers. They are narrowing choices, building carts and beginning to participate in purchases.

Oct 6, 2026

Everyone is watching for robots. Agents are already changing physical work through the records that move technicians, trucks and settlement.

Oct 4, 2026

The first agent wave was not imaginary. It was miscounted. Sam Ellis asks what early agent builders expected—and what a returning credential can actually prove.

Oct 2, 2026

Nine months into the agent boom, Sam Ellis traces the shift from public agent spectacle to embedded delegation—and asks what evidence distinguishes motion from accepted work.

See all episodes →