AI Odyssey

AI Agents Fail the Spreadsheet Test

AI Odyssey

Show Notes

What happens when AI agents are asked to build the spreadsheets finance teams actually use? WorkstreamBench, a benchmark for end-to-end financial spreadsheet work, exposes the gap between impressive demos and professional deliverables. It tests complete multi-sheet workbooks, not single formulas or table questions. The benchmark scores accuracy, formula quality, and formatting, because in finance a model must be auditable, readable, and easy to modify. Claude Web leads with 69.1 out of 100, but even the best systems degrade as tasks become more complex. Enterprise AI still has a spreadsheet reliability problem.

Inspired by the work of Thomson Yen, Julian Poeltl, Harshith Srinivas Gear, Yilin Meng, Joshua Fan, Adam Shen, Yili Liu, Ali Bauyrzhan, Siri Du, Haoyang Liu, Daniel Guetta, and Hongseok Namkoong, this episode was created using Google's NotebookLM.

Read the original paper here: https://arxiv.org/pdf/2605.22664

More from AI Odyssey

Oct 21, 2026

🎧 Did AI Agents Just Break Math? Ten thousand AI agents. Eighty-eight hours. OpenAI reports a proof for a forced version of the Navier–Stokes equations, followed by verification in Lean. This episode follows the shift from individual problem-solving to teams of AI agents that explore ideas, challenge arguments and submit proofs to a checker. From Anthropic’s formalization of Fermat’s Last Theorem to the concerns raised by 25 Fields medalists, it examines what happens when producing results outruns our ability to understand them. Lean checks a formal argument against precise definitions and assumptions. It does not explain why the result matters or how people can build on it. Drawing on research announcements and the mathematical community’s responses, this episode was created using Google's NotebookLM. Research and debate: https://openai.com/index/navier-stokes-solution/ and https://mathandai.org/ Watch the video explainer on YouTube: https://youtu.be/GEDuTadiqnk?si=r7Eod_SsodeqUel7

Oct 18, 2026

AI Agents Gone Rogue

Oct 11, 2026

🎧 REA: Has AI Made All Software Open Source?

Sep 27, 2026

🎧 Personal AI Agents That Act for You: Hermes, OpenClaw, Grok Bot and Muse AI agents are moving beyond answering questions. You can give them a task, let them work across apps, and step in when needed. This episode looks at four options for individuals. Hermes Agent and OpenClaw offer control on your own devices, with setup required. Grok Bot works in a cloud computer for eligible subscribers. Meta’s Muse is built for everyday tasks: it can use a browser and connected apps, keep working after you close the app, and asks for approval before sending an email or making a purchase, according to Meta. Muse is rolling out in the US. We compare access, practical uses, and permissions. We also cover the unconfirmed OpenAI DevDay rumor without treating it as a launch. This AI Odyssey episode was created with Google’s NotebookLM from many sources, including official product information and reporting.

Sep 20, 2026

🎧 Jev: What’s Behind the Buzz?

See all episodes →