Sovereign AI: Using LLMs Without Sacrificing Privacy - The Sovereign Computing Show (SOV013)
The Sovereign Computing ShowShow Notes
AI assistants like ChatGPT and Claude are powerful tools, but they come with significant privacy trade-offs. In this episode, Jordan Bravo and Stephen DeLorme explore practical approaches to using AI without surrendering your data to big tech companies. They compare privacy-focused third-party services that use confidential computing (like Maple) and local storage options (like Venice.AI) before diving into running open-source models entirely on your own hardware with tools like Ollama, GPT4All, and LM Studio. They also reveal how your Smart TV might take screenshots of what you're watching through Automatic Content Recognition (ACR) and share steps to disable this intrusive tracking.
Show Notes: https://atlbitlab.com/podcast/sovereign-ai-using-llms-without-sacrificing-privacy
00:00 Introduction to The Sovereign Computing Show 00:42 ATL BitLab Sponsorship Information 01:45 Welcome and Show Contact Information 02:09 Smart TVs and Automatic Content Recognition (ACR) 03:58 How ACR Surveillance Works in Smart TVs 05:23 The Creepy Reality of TV Screenshot Tracking 08:33 Solutions for Smart TV Privacy Concerns 10:47 Unplugging Your Smart TV from the Internet 11:51 Main Topic: Using AI and LLMs Privately 12:44 Understanding LLMs vs. Other Generative AI 14:51 The Privacy Problem with Major LLM Providers 16:44 Private Third-Party AI Providers 16:44 Maple and Confidential Computing 22:32 Venice.AI with Local Storage 27:28 Kagi AI's Privacy Trade-offs 30:49 The Privacy Spectrum of AI Services 33:38 Self-Hosting LLMs and Local Models 34:22 Ollama for Running Local Models 37:25 Running Models Without Internet Connection 38:43 OpenWebUI for Graphical Interface 41:35 GPT4All for User-Friendly Local AI 43:03 LM Studio with Integrated Interface 44:55 Hardware Limitations for Local LLMs 46:15 Local Image Generation 46:47 Stable Diffusion Web UI 48:09 ComfyUI for Artist-Friendly Workflows 51:50 ATL BitLab AI Meetup Information 53:11 Conclusion and Contact Information 53:40 Show Outro and Support Details
More from The Sovereign Computing Show
Start9 CEO Matt Hill joins Jordan Bravo to discuss the evolution of sovereign computing and the upcoming StartOS 0.4.0 release. Learn about Start9's mission to democratize server administration, their revolutionary new networking capabilities, plans for an open-source router, and innovative community programs for scaling support and development. Plus: why dignity matters as much as privacy and security in computing. Show Notes: https://atlbitlab.com/podcast/sov-022-matt-hill-start9 00:00 Opening Quote: Sovereign Computing Definition
Google is making Android more like iOS by blocking "sideloading" of unverified apps starting next year. Jordan Bravo breaks down why "sideloading" is a psyop term designed to make normal software installation seem dangerous, how Google's new developer KYC requirements will kill freedom tech, and why this gradual "boiling of the frog" approach threatens projects like GrapheneOS. Plus a chilling reminder from former NSA/CIA director Michael Hayden: "We kill people based on metadata."
Not all "free" software is actually free - you're often paying with your data, privacy, or through deceptive subscription traps. In this episode, Jordan Bravo and Stephen DeLorme break down the business models behind the software you use daily, from ethical freemium approaches like Tailscale to exploitative data harvesting like Gmail. They explore managed hosting models, the pros and cons of subscriptions versus one-time payments, and expose dark patterns that trick users into unwanted charges. Plus updates on Jordan's private SIM card journey and news about Google's forced Android changes and Linux desktop growth.
Not all software is created equal when it comes to digital sovereignty. In this episode, Jordan Bravo and Stephen DeLorme break down their framework for evaluating software that respects your freedom and privacy. They cover why open source isn't always a guarantee, how to spot healthy vs abandoned projects on GitHub, the importance of data export capabilities, and sustainable business models that won't disappear overnight. Plus, news about Samsung killing bootloader unlocks, EU age verification requirements, and reviews of new authenticator apps from Proton and Ente.
Your location data is one of the most sensitive pieces of information you share, but are you trusting Google and Apple with every place you go? In this episode, Jordan Bravo and Stephen DeLorme explore private alternatives to mainstream navigation apps that don't track your movements. They cover privacy-focused options like Magic Earth and Organic Maps built on Open Street Maps, reveal how to use Waze on GrapheneOS without Google Play Services, and discuss the ultimate privacy solution: standalone Garmin GPS devices. Plus, news about Proton's new AI assistant Lumo and the company's concerning move away from Switzerland due to emerging surveillance laws.