The CTO Playbook

109: Your Agents Are Held to a Lower Standard Than Your Engineers

The CTO Playbook

Show Notes

Most CTOs think adopting AI means picking the right tools, but Sumeet argues the real work is closing the accountability gap between agents and engineers.

Build your own CTO Playbook at www.theCTOplaybook.com - the leadership platform built for the full CTO journey. Coaching, podcast, and community to help you lead with clarity, confidence, and strategic impact.

My guest this week is Sumeet Vaidya, co-founder and CEO of Crafting, who spent years at Facebook, Uber, and Discord before building the infrastructure enterprise engineering teams now use to put agents to work safely.

His perspective matters because he sees what CTOs say publicly, and what their teams are actually doing internally, and the gap is bigger than most leaders want to admit.

Roughly 80% of enterprise engineering orgs, he estimates, are doing close to nothing meaningful with AI. The rest are either reacting to hype or trying to build something durable, and the difference is not the tools they pick.

One partner running 3,000 agents against 250 engineers changed how he thinks about capacity entirely. That number is where his six diagnostic questions come from and where the cracks appear first: brittle CI/CD, accountability gaps for agents, and a hiring pattern that's storing up debt for the next downturn.

If you're under pressure to show AI gains while cutting token spend, this one is aimed at you.

You'll Learn:

[0:00] Introduction [2:25] The disconnect between what companies say and what teams do [4:38] Why 80% of enterprises watch and wait on agents [9:31] Chasing the latest model as a vanity metric [14:14] Resilient cultures survive shocks that short-term thinking cannot [15:46] The engineering cultures that shaped Sumeet's career [28:51] Silicon Valley is not the whole world [33:02] What breaks if you 10X the team today [42:31] Hiring only senior engineers stores up hidden debt [47:11] Turning engineers from code writers into builders

Find more from Sumeet Vaidya on LinkedIn, X, or explore the Crafting Website.

Find more from Adam on LinkedIn and YouTube, and explore coaching, cohorts, and how you can stay up to date at theCTOplaybook.com, helping you build your own playbook for your path at your pace.

More from The CTO Playbook

Oct 20, 2026

Most leaders treat impostor syndrome as something they need to overcome. But what if the belief that you're not good enough is actually serving a purpose?

Oct 13, 2026

AI has made building software dramatically faster. The problem is that the rest of the engineering system hasn’t caught up.  AI agents can now produce code, tests, documentation, migrations, and pull requests at a pace most engineering organisations weren’t designed to handle. But when everything around code review accelerates, review becomes the bottleneck. Pull requests pile up, reviewers spend more time reconstructing intent, and experienced engineers can end up reduced to repeatedly saying yes or sending work back for fixes.

Oct 6, 2026

AI adoption is getting easier for everyone. The harder question is whether you're using it to optimise the game you're already in, or to build a position that changes the game.

Sep 29, 2026

AI isn't just changing how engineers work. It's forcing technology leaders to rethink what makes management valuable.

Sep 22, 2026

Quantum computing may not be breaking your security today, but the decisions you make now could determine how exposed your organization is when it does. Conor Deegan explains why CTOs need to start preparing before Q Day arrives.

See all episodes →