Ep. 004 - The Impact of AI Datacenters On Consumer Power Costs (Datacenter, Energy) | Jeremie Eliahou Ontiveros, Jordan Nanos, Doug O'Laughlin
SemiAnalysis WeeklyShow Notes
Join Jordan Nanos, Doug O’Laughlin, and special guest Jeremie Eliahou Ontiveros for an in-depth analysis of the intersection between AI infrastructure and energy markets. Jeremie, Head of Datacenter & Energy Infrastructure Research, shares expert insights on how AI data centers are reshaping electricity pricing, market dynamics, and the regulatory challenges facing the grid today.
00:00 AI Data Centers and Electricity Prices 02:15 Market Dynamics: PJM vs. ERCOT 04:56 Supply and Demand Challenges 08:02 Thermal Accreditation and Market Reforms 11:05 Future of Energy Supply and Coal Retirements 17:13 The Future of Coal Power Plants 18:27 Balancing Energy Prices and Consumer Expectations 19:29 Customized Tariffs and Their Impact 20:28 Investment Commitments and Grid Reliability 22:30 Negotiation Timelines for Data Centers 24:32 Financing Mismatches in Energy Projects 25:10 The AI Boom and Its Impact on Energy 27:13 Anthropic vs. OpenAI: The Revenue Race 29:15 The Role of Government in AI Adoption 32:00 Demand Drivers in AI and Software Development 33:33 The Shift in Consumer Perception of AI 35:53 The Future of Coding and AI Integration 39:55 The Evolution of Software and AI Tools 43:53 The Canadian Tech Scene and AI Growth
More from SemiAnalysis Weekly
Every hybrid bonder on the market today brings the die to the wafer. ASML's patents bring the wafer to the die.Sherry Zhang and Howie join Jordan Nanos (@jordananos) to dig into the patents behind ASML's die-to-wafer hybrid bonder, why a track-based design could beat Besi on alignment and particle control, and why HBM won't adopt die-to-wafer hybrid bonding before 2029. The team also looks at how China is using hybrid bonding to keep scaling past its lithography limits, and what larger photomasks mean for High-NA EUV.Chapters:0:00 The Patent Tip-Off1:53 Hybrid Bonding 1014:06 Die-to-Wafer vs Wafer-to-Wafer5:43 Back End vs Front End8:05 Why HBM Waits Until 202913:45 Everything Comes to the Die18:26 Alignment and Cleanliness22:48 Bonding Instead of Shrinking25:49 China's Toolmakers Step Up28:25 Bigger Masks for High-NA33:29 Two Tool Stacks?Read the full article: ASML Is Building a Hybrid Bonding Tool!https://newsletter.semianalysis.com/p/asml-is-building-a-hybrid-bonding
Brad Gerstner put our 43 gigawatt forecast for 2027 on All-In, then again in his BG2 sit-down with Jensen, and called it too aggressive. The consensus counter sits near 25 GW, built on moratorium headlines and grid connection fears. Jordan Nanos (@JordanNanos) sits down with Jeremie Ontiveros (@JeremieEO) and Reyk Knuhtsen (@robotknower), who have been tracking the same capacity curve since March 2024, and it has barely moved across every model revision. So they aren't cutting it. They're raising it.
GLM 5.3 only attends to the tokens that matter. It still has to keep every one of them.
H100 rental prices went up, on a GPU that should be sliding down its depreciation curve. That curve is what lenders underwrite. Daniel Nishball (@dnishball) kicks off our new Compute Capital Markets group by following the money through Nvidia's $497B backstops, ClusterMAX as a credit signal, and whether each token is profitable. Jordan Nanos (@JordanNanos) brings the rental data. AI debt is about to pass auto loans.
Pay Anthropic $200 a month and you can pull $12,000 of Opus 5.5 tokens at API pricing. Max Kan (@maxkan) and Andrew Megalaa bought every plan, OpenAI, Meta, xAI, MiniMax, Moonshot, Z.ai, Cursor, and measured every token type to find the ceiling. The catch isn't subsidy. Anthropic still books 50 to 60% gross margins on these plans, which means the API itself is the price gouge.