Show Notes
As product lead at Anthropic, Jess has a first-hand look at how Anthropic teams are moving from prompting AI to building long-running agents that work overnight. In our episode, Jess showed me how to build a Claude analytics agent from scratch, then covered how Anthropic PMs use agents internally to understand the codebase, monitor customer feedback, and make better product decisions.
Jess and I talked about:
(00:00) AI agents that work while you sleep (03:46) Claude Managed Agents help for long-running tasks (05:22) Demo: Building a Claude analyst agent from scratch (09:28) Traces: How to see where an agent got stuck (15:08) Evals: How agents grade their own work (20:16) 5 ways in which Anthropic PMs use agents internally (28:06) Processing a 4,000-company waitlist with agents (32:47) To build your first agent, focus on helping one person (36:47) What changes when agents can work overnight
Thanks to our sponsors: Linear: The AI agent platform for modern teams https://linear.app/behind-the-craft Wispr Flow: 4x faster than typing with your voice https://ref.wisprflow.ai/peteryang Riverside: All-in-one AI studio for podcasts and video https://creators.riverside.com/PeterYang
📌 Get the takeaways: https://creatoreconomy.so/p/inside-anthropics-bet-on-claude-agents-jess-yan
📌 Get my personal AI operating system with all my skills and prompts: https://www.behindthecraft.com/
Where to find Jess: X: https://x.com/jess__yan Website: https://platform.claude.com/docs/en/managed-agents/overviewSubscribe to this channel - more interviews coming soon!
More from Behind the Craft
Pomp and I worked together at Facebook a decade ago before he became an investor, best-selling author, and public company CEO with an audience of 3.3M. We had a great chat about how to build an extraordinary career and life and how he's building Silvia, an AI CFO for independent investors, to take on the AI labs.
Micky is a full-stack engineer who has taught 100K+ people how to build with AI. In our episode, he walked me through his 4-step agentic engineering workflow to avoid pumping out slop: Isolate every task, build to a clear structure, prove via validation loops, and ship after agents review your PRs or escalate to you for a manual look.
Sam is the co-founder of Granola, the AI meeting notes app now valued at $1.5B. Granola has helped me survive (and even enjoy) countless meetings, so I was excited to learn how Sam uses AI to show up prepared. We also talked about building an AI-native company without the 996 grind and what design means when agents skip your app entirely.
Copy my best AI workflows to save time and automate busywork: https://www.behindthecraft.com 🤝 Subscribe to my practical AI newsletter read by 150K+ professionals: https://creatoreconomy.so
Ethan is the product lead for ChatGPT Finances at OpenAI. He previously co-founded Digit, which helped more than 10 million people save over $9 billion. In our interview, he shared six practical ways to use ChatGPT to find wasted spending, save money on taxes, maximize credit card rewards, and model major financial decisions. I’m confident at least one of these use cases will save you money today.