A.I. Builder Tips: Voice Control, Fast Orchestration, MCP Integration (Ft Jason Kneen)
Tool Use - AI ConversationsShow Notes
Join the Tool Use Discord: https://discord.gg/PnEGyXpjaX
Discover the future of front-end development with Cluso, an AI-powered web inspector and browser designed for "vibe coding." In this episode, Jason Kneen returns to demonstrate how to build bespoke AI tools that go beyond simple transcription. We dive deep into implementing voice control with context-aware agents, mastering the Model Context Protocol (MCP) for tool integration, and building fast orchestration layers to route requests between local models and cloud agents like Claude and Gemini. Whether you are interested in Electron app development, context splicing, or multi-view mobile testing, this conversation covers how top builders are creating their own workflows.
Cluso: https://cluso.app/
Connect with us https://x.com/ToolUsePodcast https://x.com/MikeBirdTech https://x.com/jasonkneen
00:00:00 - Intro 00:07:54 - Building Voice Control for AI Agents 00:15:20 - Leveraging MCP for Better Tooling 00:19:42 - Fast Orchestration & Model Routing 00:25:06 - Multi-Model Agent Architecture 00:31:13 - Cluso Demo & Workflow
Subscribe for more insights on AI tools, productivity, and modern software development.
More from Tool Use - AI Conversations
Check out www.ToolUsePodcast.com Are AI web browsers falling short of the hype? Enter Rover, a revolutionary open-source AI agent that unlocks full autonomous workflows directly on your website with just a single script tag. In this episode, Arjun and Bhavani from rtrvr return to dive deep into how Rover uses a unique DOM-only approach to navigate, click, and type with subsecond latency. This innovative method completely bypasses slow screenshot-based models and outdated playwright or puppeteer scripts. We discuss the engineering secrets behind building smart DOM trees, why they crushed web benchmarks, and how Rover provides a powerful alternative to Google's Web MCP by keeping users engaged on your site instead of handing traffic over to external AI tools. Plus, learn how you can trigger complex agentic workflows via simple URL queries and why open-sourcing this technology is a massive win for the developer community. Rover links:https://x.com/rtrvrairover.rtrvr.ai Github: https://github.com/rtrvr-ai/rover Rover Deep dive: https://www.rtrvr.ai/blog/10-billion-proof-point-every-website-needs-ai-agent Benchmark: https://www.rtrvr.ai/blog/web-bench-results Connect withus https://x.com/ToolUsePodcast https://x.com/MikeBirdTech https://x.com/rtrvrai 00:00:00 - Intro 00:03:05 - The DOM-Only Approach vs Screenshots for AI Agents 00:06:00 - Parsing HTML vs Markdown for Reliable LLM Data 00:11:47 - Handling Modals, iFrames, and Canvas Elements 00:15:32 - Implementing AI Guardrails and Extracting User Intent Data 00:28:04 - Rover vs Google Web MCP for Website Automation 00:31:25 - Triggering Autonomous AI Workflows via URL Queries Subscribe for more insights on AI tools, productivity, and web automation. Join the Tool Use Discord: https://discord.gg/PnEGyXpjaX Tool Use is a weekly conversation with the top AI experts.
Join the Tool Use Discord: https://discord.gg/PnEGyXpjaX
Join the Tool Use Discord: https://discord.gg/PnEGyXpjaX
Join the Tool Use Discord: https://discord.gg/PnEGyXpjaX