This Week in AI

Hermes Agent, NotebookLM & LiveKit Founders on the AI Agent Race | TWiAI 17

This Week in AI

Show Notes

Apple just paid a rival a billion dollars a year because it could not build Siri itself, and that tells you where the AI platform war actually stands: the edge has moved up the stack, from the model to the agent layer sitting on top of it.

This week's roundtable makes the case that whoever controls that layer controls the experience, and we brought in three founders building it from different angles: Hermes Agent, NotebookLM, and LiveKit. Their through-line is that the harness is temporary, the model keeps eating it, and the people building agents right now are designing for capabilities that do not exist yet.

This week's roundtable: Jeffrey Quesnelle (Co-founder & CEO, Nous Research, the open source AI lab behind Hermes Agent) Steven B Johnson (Editorial Director of NotebookLM & Google Labs, co-creator of NotebookLM) Russ d'Sa (Co-founder & CEO, LiveKit, the open source real-time voice/video infrastructure behind ChatGPT voice mode)

Thank you to our exclusive sponsor: PayPal Open, One Platform for All Business: https://paypalopen.com

Timestamps: 0:00 Cold open 1:08 Welcome to Episode 17 1:40 Jeffrey Quesnelle on Hermes Agent and the open source agent race 5:03 Steven Johnson on NotebookLM, source-grounding, and going agentic 7:32 Why AI got booed at commencement: the first generation raised on ChatGPT 10:48 Russ d'Sa on LiveKit powering ChatGPT, Tesla, Grok, and Salesforce voice 27:50 Apple's $1B Gemini deal and the Siri UX problem 52:49 "Functional AGI, unevenly distributed": where the models actually are 57:24 The harness is temporary: why agent builders design for the next model

Guests: Jeffrey Quesnelle, Nous Research: https://nousresearch.com | https://x.com/theemozilla Steven Johnson, NotebookLM (Google Labs): https://notebooklm.google.com | https://x.com/stevenbjohnson Russ d'Sa, LiveKit: https://livekit.io | https://x.com/dsa

Referenced in this episode: Nous Research / Hermes Agent: https://nousresearch.com NotebookLM: https://notebooklm.google.com LiveKit: https://livekit.io OpenAI ChatGPT: https://openai.com Tesla: https://www.tesla.com Grok (xAI): https://x.ai Salesforce Agentforce: https://www.salesforce.com/agentforce SAP Joule: https://www.sap.com/products/artificial-intelligence/ai-assistant.html Apple Intelligence: https://www.apple.com/apple-intelligence Google Gemini: https://gemini.google.com Anthropic Claude Code: https://www.anthropic.com/claude-code OpenRouter: https://openrouter.ai

Newsletter and all platforms: https://thisweekinai.ai Apple Podcasts: https://thisweekinai.ai/apple Spotify: https://thisweekinai.ai/spotify YouTube: https://youtube.com/@ThisWeekinAIPodcast Show X: https://x.com/ThisWeeknAI

#ThisWeekInAI #AI #NousResearch #NotebookLM #LiveKit #OpenSourceAI #AIAgents #Siri #Gemini #VoiceAI

More from This Week in AI

Oct 22, 2026

This Week In AI is made possible by PayPal: http://paypal.launch.co

Oct 15, 2026

This Week In AI is made possible by: PayPal: http://paypal.launch.co

Oct 8, 2026

Thanks to our partner, @Paypal! Pay zero processing fees on your first $100K in eligible PayPal payment volume. Learn more at https://paypal.launch.co/Today’s show:Demand for AI requires America to build data centers faster than the power grid can connect them. Varun Sivaram of Emerald AI joins Jason with a counterintuitive idea: what if we made data centers more flexible, capable of slowing down intelligently when the grid is most stressed? (That only happens a few hundred hours each year.)PLUS, Vibhav Viswanathan of Pascal AI demos his product, which gives AI agents working for hedge funds and asset managers an institutional memory. Why can't Claude or ChatGPT do the same job? And what happens to analysts when bots handle the back office admin?Guests:Varun Sivaram on X: https://x.com/vsiv Emerald AI: https://www.emeraldai.co/Vibhav Viswanathan on LinkedIn: https://www.linkedin.com/in/vibhav-viswanathan-13550015/ Pascal AI: https://www.pascalailabs.com/Relevant Links:Emerald AI's $150M Series A (DatacenterDynamics) → https://www.datacenterdynamics.com/en/news/emerald-ai-raises-150m-in-series-a-funding-to-scale-commercial-deployments/The London trial with National Grid that Varun describes (National Grid) → https://nationalgrid.com/uk-first-trial-ai-grid-technology-successfully-demonstrates-ability-data-centres-adjust-power-needs"Rethinking Load Growth," the Duke University study on spare grid capacity for flexible data centers → https://nicholasinstitute.duke.edu/publications/rethinking-load-growthThe AI Energy Management Alliance from Emerald AI, Google and NVIDIA (NVIDIA) → https://blogs.nvidia.com/blog/ai-energy-management-alliance/The power-flexible Aurora AI Factory in Manassas, Virginia (DatacenterDynamics) → https://www.datacenterdynamics.com/en/news/nvidia-to-deploy-emerald-ais-orchestration-software-at-96mw-aurora-data-center-in-manassas-virginiaTexas pauses data center grid connections (Utility Dive) → https://www.utilitydive.com/news/texas-hits-pause-data-center-interconnections/827046/Emerald AI careers → https://www.emeraldai.co/careersPascal AI's $3.1M seed round (Unite AI) → https://www.unite.ai/pascal-ai-raises-3-1m-to-push-the-frontier-of-autonomous-investment-researchKotak Mahindra Asset Management deploys Pascal AI's research platform (Frontier Enterprise) → https://www.frontier-enterprise.com/kotak-mahindra-amc-deploys-pascal-ais-agentic-research-platform/Jane Street plans its own AI data center, which Jason brings up (DatacenterDynamics) → https://www.datacenterdynamics.com/en/news/quant-trading-firm-jane-street-plans-data-center-report/What "Tiger Cub" hedge funds are, like the Pascal customer Vibhav mentions (Wall Street Prep) → https://wallstreetprep.com/knowledge/tiger-cubsS&P Capital IQ Pro, one of the licensed data feeds Pascal plugs into → https://www.spglobal.com/market-intelligence/en/solutions/products/sp-capital-iq-proFactSet, another licensed data feed Vibhav mentions → https://www.factset.com/Timestamps:0:00 Why data centers suddenly became unpopular2:46 Batteries vs. throttling GPUs vs. moving workloads4:11 Why utilities still pick up the phone4:52 The London teakettle test at football halftime5:56 Throttling AI workloads without users noticing10:40 How much spare room the grid really has13:32 The grand bargain, a fast pass onto the grid17:23 Why America can't out-build China on power20:39 Why off-grid and space data centers worry Varun27:37 Are state data center moratoriums performative?29:45 Pascal AI, AI agents for hedge funds and asset managers35:12 How Pascal differs from ChatGPT and Claude38:54 The proprietary data frontier models can't see42:20 Will AI replace hedge fund analysts?Subscribe to our newsletters on Substack:TWiST: https://twistartups.substack.com/TWiAI: https://www.thisweekinai.ai/TWiVC: https://thisweekinvc.substack.com/Check out all our partner offers: https://partners.launch.co/

Oct 1, 2026

This Week In Startups is made possible by:PayPal: https://paypal.com/businessToday’s show:OpenAI is delaying GPT-6.1 Astra after UK government testers found GPT-6 Astra launched unsanctioned supply-chain attacks in 29% of simulated runs. Jason and Lon are joined by George Sivulka of Hebbia, Scott Stephenson of Deepgram, and Dan Mishin of Manifest OS to discuss whether the industry's sudden safety panic is a real alarm or a response to cheap open-source models.Learn why Scott has let an internal tool called "Bodyman" record his screen, mic and speakers for eight months so it can whisper reminders in his ear. PLUS, why did Meta's Muse agent read a columnist's iMessages after he declined access, and what is AMD getting for $8.2B with Fei-Fei Li's World Labs?Guests:George Sivulka on X: https://x.com/gsivulka?lang=en Hebbia: https://www.hebbia.com/Scott Stephenson on X: https://x.com/deepgramscott Deepgram: https://deepgram.com/Dan Mishin on X: https://x.com/mishindan1 Manifest OS: https://manifestos.com/Relevant Links:UK AISI: GPT-6 Astra performs unsanctioned supply-chain attacks in simulations → https://www.aisi.gov.uk/blog/gpt-6-astra-performs-unsanctioned-supply-chain-attacks-in-simulationsAISI technical report (PDF) → https://cdn.prod.website-files.com/663bd486c5e4c81588db7a1d/6aba83e3772048bdd24df3d8_AISI_GPT-6_Astra_Technical_Report.pdfJ.P. Morgan: Dan's story of the first electrified house in New York → https://en.wikipedia.org/wiki/J._P._MorganILOVEYOU virus: the script-kiddie era Jason referenced → https://en.wikipedia.org/wiki/ILOVEYOUAMD acquires World Labs in an $8.2B all-stock deal (Quartz) → https://qz.com/amd-acquiring-world-labs-fei-fei-li-8-billion-092926World Labs: spatial-intelligence models, including Marble → https://www.worldlabs.ai/Instinct raises $1B Series C at a $10B valuation (PYMNTS) → https://www.pymnts.com/news/artificial-intelligence/2026/personal-ai-agent-instinct-quadruples-valuation-to-10-billion-in-1-month/OpenAI launches Dots, which dropped during the taping (TechCrunch) → https://techcrunch.com/2026/09/29/openai-launches-dots-its-bubbly-agentic-avatar/Meta launches the Muse personal agent (CNBC) → https://www.cnbc.com/2026/09/08/meta-personal-ai-agents-public-reckoning-privacy-safety.htmlMeta's Muse read Jason Aten's iMessages, then gave a false explanation (Decrypt) → https://decrypt.co/379122/metas-muse-ai-agent-user-private-imessages-lied-howDaring Fireball, linking Aten's original Inc. column → https://daringfireball.net/linked/2026/09/22/aten-museWhy Crosby is ditching the billable hour (Forbes) → https://www.forbes.com/sites/rashishrivastava/2026/03/31/why-this-ai-law-firm-is-ditching-the-billable-hour/Timestamps:0:00 Jason's flight attendants are scared of AI1:55 Meet the panel: Heavy, Deepgram and Manifest2:17 OpenAI cancels GPT-6.1 Astra over safety regressions7:41 Hugging Face hack and Nvidia's open agent safety platform16:11 AI psychosis and getting one-shotted by agents28:46 AMD buys Fei-Fei Li's World Labs for $8.2B32:08 Will open source commoditize world models too?34:34 Is the AI buildout bigger than the railroads?36:59 Around the horn: which AI agent are you using?37:59 Scott's "Body Man" records his whole life for context46:13 George on Grok bot and scoping context into channels51:39 Instinct's $1B round: peak bubble moment?57:11 Meta's Muse reads a columnist's texts without permission1:08:33 AI video then and now: Will Smith eating spaghetti1:10:21 AI-first law firms ditch the billable hour1:18:05 OpenAI drops Dots: why do all AI agents look alike?Subscribe to our newsletters on Substack:TWiST: https://twistartups.substack.com/TWiAI: https://www.thisweekinai.ai/TWiVC: https://thisweekinvc.substack.com/Subscribe to This Week in Startups on Apple: https://rb.gy/v19fcpCheck out all our partner offers: https://partners.launch.co/

Sep 24, 2026

This Week In Startups is made possible by: PayPal - Pay zero processing fees on your first $100K in eligible PayPal payment volume. Learn more at https://paypal.launch.co

See all episodes →