Show Notes
Can AI really out-compress PNG and FLAC? 🤔 Or is it just another overhyped tech myth? In this episode of Data Science at Home, Frag dives deep into the wild claims that Large Language Models (LLMs) like Chinchilla 70B are beating traditional lossless compression algorithms. 🧠💥 But before you toss out your FLAC collection, let's break down Shannon's Source Coding Theorem and why entropy sets the ultimate limit on lossless compression. We explore: ⚙️ How LLMs leverage probabilistic patterns for compression 📉 Why compression efficiency doesn’t equal general intelligence 🚀 The practical (and ridiculous) challenges of using AI for compression 💡 Can AI actually BREAK Shannon’s limit—or is it just an illusion? If you love AI, algorithms, or just enjoy some good old myth-busting, this one’s for you. Don't forget to hit subscribe for more no-nonsense takes on AI, and join the conversation on Discord! Let’s decode the truth together. Join the discussion on the new Discord channel of the podcast https://discord.gg/4UNKGf3
Don't forget to subscribe to our new YouTube channel https://www.youtube.com/@DataScienceatHome
References Have you met Shannon? https://datascienceathome.com/have-you-met-shannon-conversation-with-jimmy-soni-and-rob-goodman-about-one-of-the-greatest-minds-in-history/
More from Data Science at Home
DHH told Rails World that hand-written code is over, that HEY's backend is being AI-rewritten in Rust ("amazing, as long as you never look at it"), and that developer happiness no longer matters. This episode checks his statements.
Fifty years ago Fred Brooks showed why adding more people to a late project makes it later. Today we do the same thing with tokens — more context, more autonomy, same myth, different currency. Struggling with AI and Software? Here is my new book available for purchase on https://mythicaltokenmonth.com/ Come have a chat on our Discord Channel: https://discord.gg/4UNKGf3 Buy me a coffeehttps://ko-fi.com/datascience Check my company Amethix Technologies https://amethix.com References https://mythicaltokenmonth.com/
A 2025 solo-author paper on non-generative decision models, a 2026 frontier-lab launch that looks a lot like it, and what these fast, non-autoregressive models can and can't actually do. Struggling with AI and Software? Here is my new book available for purchase on https://mythicaltokenmonth.com/ Come have a chat on our Discord Channel: https://discord.gg/4UNKGf3 Buy me a coffeehttps://ko-fi.com/datascience Check my company Amethix Technologies https://amethix.com References https://typesafe.ai/https://arxiv.org/pdf/2503.23303https://huggingface.co/spaces/convaiinnovations/laya-demo ✨ Connect with us!Personal newsletter: https://defragzone.substack.com📩 Newsletter: https://datascienceathome.substack.com🎙 Podcast: Available on Spotify, Apple Podcasts, and more.🐦 Twitter: @DataScienceAtHome📘 LinkedIn: https://www.linkedin.com/in/fragadaleta/Instagram: https://www.instagram.com/datascienceathome/Facebook: https://www.facebook.com/datascienceAHLinkedIn: https://www.linkedin.com/company/data-science-at-home-podcast NEW TO DATA SCIENCE AT HOME?Welcome! Data Science at Home explores the latest in AI, data science, and machine learning. Whether you’re a data professional, tech enthusiast, or just curious about the field, our podcast delivers insights, interviews, and discussions. Learn more at https://datascienceathome.com SEND US MAIL!We love hearing from you! Send us mail at:[email protected]’t forget to like, subscribe, and hit the 🔔 for updates on the latest in AI and data science!
Three rival AI CEOs never agree on anything, until now. I break down the Sanders-Casar bill, the timing, and why "too dangerous" might be the best pitch deck line money can buy. Struggling with AI and Software? Here is my new book available for purchase on https://mythicaltokenmonth.com/ Come have a chat on our Discord Channel: https://discord.gg/4UNKGf3 Buy me a coffeehttps://ko-fi.com/datascience Check my company Amethix Technologies https://amethix.com References https://defragzone.substack.com/p/techs-dumbest-mistake-why-firing ✨ Connect with us!Personal newsletter: https://defragzone.substack.com📩 Newsletter: https://datascienceathome.substack.com🎙 Podcast: Available on Spotify, Apple Podcasts, and more.🐦 Twitter: @DataScienceAtHome📘 LinkedIn: https://www.linkedin.com/in/fragadaleta/Instagram: https://www.instagram.com/datascienceathome/Facebook: https://www.facebook.com/datascienceAHLinkedIn: https://www.linkedin.com/company/data-science-at-home-podcast NEW TO DATA SCIENCE AT HOME?Welcome! Data Science at Home explores the latest in AI, data science, and machine learning. Whether you’re a data professional, tech enthusiast, or just curious about the field, our podcast delivers insights, interviews, and discussions. Learn more at https://datascienceathome.com SEND US MAIL!We love hearing from you! Send us mail at:[email protected]’t forget to like, subscribe, and hit the 🔔 for updates on the latest in AI and data science!
What is the state of AI and videogames? Who is considering it? What are the big fails so far? This and much more is covered in this 1st episode of AI and videogames.