Show Notes
Master the art of building AI agents and powerful AI teammates with Diamond Bishop, Director of Engineering and AI at Datadog. In this deep dive, we explore crucial strategies for creating self-improving agent systems, from establishing robust evaluations (evals) and observability to designing effective human-in-the-loop escape hatches. Learn the secrets to building user trust, deciding between prompt engineering and fine-tuning, and managing data sets for peak performance. Diamond shares his expert insights on architecting agents, using LLM as a judge for quality control, and the future of ambient AI in DevSecOps. If you're looking to build your own AI assistant, this episode provides the essential principles and practical advice you need to get started and create systems that learn and improve over time.
Guest: Diamond Bishop, Director of Engineering and AI at Datadog Learn more about Bits AI SRE: https://www.datadoghq.com/blog/bits-ai-sre/ Datadog MCP Server for Agents: https://www.datadoghq.com/blog/datadog-remote-mcp-server/
Sign up for A.I. coaching for professionals at: https://www.anetic.co
Get FREE AI tools pip install tool-use-ai
Connect with us https://x.com/ToolUseAI https://x.com/MikeBirdTech https://x.com/diamondbishop
00:00:00 - Intro 00:03:55 - When To Use an Agent vs a Script 00:05:44 - How to Architect an AI Agent 00:08:07 - Prompt Engineering vs Fine-Tuning 00:11:29 - Building Your First Eval Suite 00:26:06 - The Unsolved Problem in Agent Building 00:31:10 - The Future of Local AI Models & Privacy
Subscribe for more insights on AI tools, productivity, and agents.
Tool Use is a weekly conversation with AI experts brought to you by Anetic.
More from Tool Use - AI Conversations
Check out www.ToolUsePodcast.com Are AI web browsers falling short of the hype? Enter Rover, a revolutionary open-source AI agent that unlocks full autonomous workflows directly on your website with just a single script tag. In this episode, Arjun and Bhavani from rtrvr return to dive deep into how Rover uses a unique DOM-only approach to navigate, click, and type with subsecond latency. This innovative method completely bypasses slow screenshot-based models and outdated playwright or puppeteer scripts. We discuss the engineering secrets behind building smart DOM trees, why they crushed web benchmarks, and how Rover provides a powerful alternative to Google's Web MCP by keeping users engaged on your site instead of handing traffic over to external AI tools. Plus, learn how you can trigger complex agentic workflows via simple URL queries and why open-sourcing this technology is a massive win for the developer community. Rover links:https://x.com/rtrvrairover.rtrvr.ai Github: https://github.com/rtrvr-ai/rover Rover Deep dive: https://www.rtrvr.ai/blog/10-billion-proof-point-every-website-needs-ai-agent Benchmark: https://www.rtrvr.ai/blog/web-bench-results Connect withus https://x.com/ToolUsePodcast https://x.com/MikeBirdTech https://x.com/rtrvrai 00:00:00 - Intro 00:03:05 - The DOM-Only Approach vs Screenshots for AI Agents 00:06:00 - Parsing HTML vs Markdown for Reliable LLM Data 00:11:47 - Handling Modals, iFrames, and Canvas Elements 00:15:32 - Implementing AI Guardrails and Extracting User Intent Data 00:28:04 - Rover vs Google Web MCP for Website Automation 00:31:25 - Triggering Autonomous AI Workflows via URL Queries Subscribe for more insights on AI tools, productivity, and web automation. Join the Tool Use Discord: https://discord.gg/PnEGyXpjaX Tool Use is a weekly conversation with the top AI experts.
Join the Tool Use Discord: https://discord.gg/PnEGyXpjaX
Join the Tool Use Discord: https://discord.gg/PnEGyXpjaX
Join the Tool Use Discord: https://discord.gg/PnEGyXpjaX