AI Odyssey

When Agents Remember Their Mistakes: The End of AI Amnesia

AI Odyssey

Show Notes

What if an AI agent could learn from every single failure, every clumsy workaround, every brilliant recovery, and feed that experience back into its own future performance? Today’s LLM-powered agents suffer from a fundamental flaw: amnesia. They repeat the same mistakes, miss the same shortcuts, and rediscover the same solutions over and over. A new framework from IBM Research changes that by mining agent execution trajectories for three types of actionable knowledge: strategy tips from clean successes, recovery tips from failure-and-fix sequences, and optimization tips from tasks completed inefficiently. On the AppWorld benchmark, agents equipped with this learned memory improved scenario goal completion by up to 14.3 percentage points on unseen tasks, and by a staggering 28.5 points on complex multi-step challenges. That is a 149% relative increase, with zero model changes. Inspired by the work of Gaodan Fang, Vatche Isahagian, K. R. Jayaram, Ritesh Kumar, Vinod Muthusamy, Punleuk Oum, and Gegi Thomas, this episode was created using Google’s NotebookLM. Read the original paper here: https://arxiv.org/abs/2603.10600

More from AI Odyssey

Oct 21, 2026

🎧 Did AI Agents Just Break Math? Ten thousand AI agents. Eighty-eight hours. OpenAI reports a proof for a forced version of the Navier–Stokes equations, followed by verification in Lean. This episode follows the shift from individual problem-solving to teams of AI agents that explore ideas, challenge arguments and submit proofs to a checker. From Anthropic’s formalization of Fermat’s Last Theorem to the concerns raised by 25 Fields medalists, it examines what happens when producing results outruns our ability to understand them. Lean checks a formal argument against precise definitions and assumptions. It does not explain why the result matters or how people can build on it. Drawing on research announcements and the mathematical community’s responses, this episode was created using Google's NotebookLM. Research and debate: https://openai.com/index/navier-stokes-solution/ and https://mathandai.org/ Watch the video explainer on YouTube: https://youtu.be/GEDuTadiqnk?si=r7Eod_SsodeqUel7

Oct 18, 2026

AI Agents Gone Rogue

Oct 11, 2026

🎧 REA: Has AI Made All Software Open Source?

Sep 27, 2026

🎧 Personal AI Agents That Act for You: Hermes, OpenClaw, Grok Bot and Muse AI agents are moving beyond answering questions. You can give them a task, let them work across apps, and step in when needed. This episode looks at four options for individuals. Hermes Agent and OpenClaw offer control on your own devices, with setup required. Grok Bot works in a cloud computer for eligible subscribers. Meta’s Muse is built for everyday tasks: it can use a browser and connected apps, keep working after you close the app, and asks for approval before sending an email or making a purchase, according to Meta. Muse is rolling out in the US. We compare access, practical uses, and permissions. We also cover the unconfirmed OpenAI DevDay rumor without treating it as a launch. This AI Odyssey episode was created with Google’s NotebookLM from many sources, including official product information and reporting.

Sep 20, 2026

🎧 Jev: What’s Behind the Buzz?

See all episodes →