AI Hype vs. Reality. Real Stats from Laura Tacho, CTO of DX
Agentic DevOps : AI Engineering for InfrastructureShow Notes
Bret and Nirmal are joined by Laura Tacho, CTO at DX and long-time friend of the show, to discuss AI usage and success in teams adopting AI and Agents to generate code and perform tasks.
😇 My new GitHub Security workshop has launched! A free 2-hour workshop with hands-on labs to harden your repos and your workflows from common supply chain attacks. I'll cover how attackers are getting in, and then we'll lock down a sample repo so you know what needs to be done to protect your code. You'll leave with a deep understanding of risks and mitigations as well as a list of helpful tools to keep your repos safe, including my new "gasa" tool for scanning your repos and orgs.
We finally have some real data on this topic, and Laura Tacho in her role at DX, the developer experience company, has been studying AI successes and failures in the industry and has released a framework to measure AI impact in an orgs software lifecycle. Check out the video podcast version here: https://www.youtube.com/watch?v=0G_TWLHkj7U ★Show Links★ AI Measurement Framework DX Core 4 Framework Applying the Core 4 Framework
Creators & Guests
Bret Fisher - Host
Beth Fisher - Producer
Cristi Cotovan - Editor
Nirmal Mehta - Host
Laura Tacho - Guest
(00:00) - Teaser
(03:05) - Welcome
(04:58) - AI Measurement Framework
(07:40) - Distilling Fact from Fiction with AI
(23:42) - Skepticism and Adoption of AI Tools
(26:20) - Measuring AI Impact on Developer Work
(47:30) - Assisted vs Agentic
(54:22) - More Gains from Training Humans on AI
(01:02:59) - Measuring AI's Impact
(01:08:38) - Context Switching
(01:12:03) - Navigating AI Hype and Reality
You can also support this podcast by subscribing to my YouTube channel and my weekly newsletter at bret.news! Grab the best coupons for my Docker and Kubernetes courses on Udemy. Join my cloud native DevOps community on Discord. Grab some merch at Bret's Loot Box Homepage bretfisher.com
★ Support this podcast on Patreon ★
More from Agentic DevOps : AI Engineering for Infrastructure
The OpenAI Hugging Face hack. The Anthropic testing failures. Listen to the security and ops experts, not lab researchers. I walk you through the production failures that allowed OpenAI’s models to access the internet, and what we can learn from the last few months on how to protect our systems and data. Let’s stop debating imaginary outcomes and start working through that security backlog in our infrastructure. I agree with the labs needing to slow down, but not because I believe AI will do uncontrollable harm on humans, but because the labs clearly need better production security and ops teams and more advanced lab infrastructure that’s been properly hardened. They also need to become a production ops security innovator and share that knowledge far and wide. Watch the video of this episode.
Luke Hinds, co-founder of nolabs Inc. and the nono project, joins me to dig into AI agent sandboxing with the nono CLI. It's been my go-to sandboxing tool for local agent use, but I know there are more features I should be using, like secure secrets injection and egress URL path control. Watch the video of this episode.
My friend Mike Rollins joins me for a chat about what it’s like leading a software engineering team that doesn’t read code anymore. Click here to watch a video of this episode.
A deep dive into GitHub’s Agentic Workflows feature, with Don Syme of GitHub Next & Peli de Halleux of Microsoft Research. Check out the video podcast version here: https://youtu.be/zmM8VISTOwo
Bret’s joined by the Anyshift.io co-founders, Roxane Fischer and Stephane Jourdan to discuss how an always-on SRE agent can help you proactively find risks and avoid incidents.