Show Notes
Join the Tool Use Discord: https://discord.gg/PnEGyXpjaX
Are you looking to optimize your AI applications with the best open source Large Language Models? This week, we explore open source AI, rapid model switching, and local self-hosting with Nathan Break, a Machine Learning Engineer at Mozilla AI and the creator of Any-LLM. Any-LLM is an open-source Python SDK that allows developers to seamlessly talk to any LLM provider through a single, unified interface.
Nathan demonstrates how developers can instantly swap between cloud-hosted AI providers and local models like Llamafile by changing just a single line of code. We dive into the growing capabilities of smaller, cost-effective models, how to reduce your API expenses, and the security benefits of running local AI on your own hardware. Nathan also introduces the Any-LLM Platform, a secure vault for managing API keys that tracks your token usage and enforces budget limits without ever accessing your prompt data. Finally, we check out Porch Songs, Nathan's open-source application that leverages LLMs to rewrite the lyrics of popular songs while maintaining their original rhyme schemes and chord charts.
Check out the projects mentioned in this episode: Any-LLM GitHub: https://github.com/mozilla-ai/any-llm Any-LLM Platform: https://any-llm.ai Mozilla AI Blog Post: https://blog.mozilla.ai/introducing-any-llm-a-unified-api-to-access-any-llm-provider Porch Songs GitHub: https://github.com/njbrake/porchsongs
Connect with us https://x.com/ToolUsePodcast https://x.com/MikeBirdTech
00:00:00 - Intro 00:01:25 - What is Any-LLM? Unified API for Open Source AI 00:05:32 - Benefits of Rapid Model Switching & Open Weight Models 00:11:06 - Any-LLM Python SDK Demo: Mistral Image Recognition 00:19:51 - Best Local AI Models: Llamafile, LM Studio & Local LLMs 00:24:38 - Any-LLM Platform Vault & Porch Songs App Demo 00:34:45 - AI Coding Agents, Claude Code & LLM Evaluations
Subscribe for more insights on AI tools, productivity, and open source development.
Tool Use is a weekly conversation with the top AI experts.
More from Tool Use - AI Conversations
Check out www.ToolUsePodcast.com Are AI web browsers falling short of the hype? Enter Rover, a revolutionary open-source AI agent that unlocks full autonomous workflows directly on your website with just a single script tag. In this episode, Arjun and Bhavani from rtrvr return to dive deep into how Rover uses a unique DOM-only approach to navigate, click, and type with subsecond latency. This innovative method completely bypasses slow screenshot-based models and outdated playwright or puppeteer scripts. We discuss the engineering secrets behind building smart DOM trees, why they crushed web benchmarks, and how Rover provides a powerful alternative to Google's Web MCP by keeping users engaged on your site instead of handing traffic over to external AI tools. Plus, learn how you can trigger complex agentic workflows via simple URL queries and why open-sourcing this technology is a massive win for the developer community. Rover links:https://x.com/rtrvrairover.rtrvr.ai Github: https://github.com/rtrvr-ai/rover Rover Deep dive: https://www.rtrvr.ai/blog/10-billion-proof-point-every-website-needs-ai-agent Benchmark: https://www.rtrvr.ai/blog/web-bench-results Connect withus https://x.com/ToolUsePodcast https://x.com/MikeBirdTech https://x.com/rtrvrai 00:00:00 - Intro 00:03:05 - The DOM-Only Approach vs Screenshots for AI Agents 00:06:00 - Parsing HTML vs Markdown for Reliable LLM Data 00:11:47 - Handling Modals, iFrames, and Canvas Elements 00:15:32 - Implementing AI Guardrails and Extracting User Intent Data 00:28:04 - Rover vs Google Web MCP for Website Automation 00:31:25 - Triggering Autonomous AI Workflows via URL Queries Subscribe for more insights on AI tools, productivity, and web automation. Join the Tool Use Discord: https://discord.gg/PnEGyXpjaX Tool Use is a weekly conversation with the top AI experts.
Join the Tool Use Discord: https://discord.gg/PnEGyXpjaX
Join the Tool Use Discord: https://discord.gg/PnEGyXpjaX
Join the Tool Use Discord: https://discord.gg/PnEGyXpjaX