Show Notes
Everyone wants to talk about agents and models. Jeff McMillan, starts where almost nobody else does: the foundation.
In this episode, Jeff McMillan, founder of McMillanAI, former Head of Firmwide AI at Morgan Stanley, and advisor on enterprise AI, maps AI as a stack: high-quality accessible data → semantic layer (knowledge graphs, RAG) → control and governance → models → orchestration → applications. The heavy lifting is in the bottom layers. Organizations that skip them can fake it for a handful of agents, but at 150 or 15,000 agents, you need near-100% accessibility and 99%-plus quality, or you’re monitoring chaos you can’t see.
Josh and Robb press him on why knowledge management feels unfundable, why tribal institutional knowledge breaks when machines execute without judgment, and why evaluation (golden datasets, custom org evals, regression when models upgrade) is the work builders hate and operators can’t skip. Robb names the trap CTOs are falling into: grinding tokens on feature backlogs that never reach production or revenue. Jeff agrees on the strategic gap — after controlled experimentation, leaders should ask what destroys the business in ten years, not what demo ships next quarter.
The trio also discuss: Embedded ethics and monitoring, including independent models asking, “Does something smell right?” Capacity vs. value (30% freed time spent golfing is not ROI) Process mapping in high-end knowledge businesses that can’t articulate how work moves Use case zero — knowledge that maintains and teaches itself Agent-in-the-loop and humans with something to lose in the accountability chain Jeff’s Board of Advisors experiment at MacmillanAI AI can make you incredibly smart or comfortably dumb. The choice is cultural, not technical.
Learn more about McMillanAI: https://mcmillanai.com/
---------- Support our show by supporting our sponsors!
This episode is supported by OneReach.ai Forged over a decade of R&D and proven in 10,000+ deployments, OneReach.ai’s GSX is the first complete AI agent runtime environment (circa 2019) — a hardened AI agent architecture for enterprise control and scale. Backed by UC Berkeley, recognized by Gartner, and trusted across highly regulated industries, including healthcare, finance, government and telecommunications. A complete system for accelerating AI adoption — design, train, test, deploy, monitor, and orchestrate AI agents. Use any AI models Build and deploy intelligent agents fast Create guardrails for organizational alignment Enterprise-grade security and governance Get in touch: https://onereach.ai/contact/?utm_source=soundcloud&utm_medium=social&utm_campaign=s7e12&utm_content=1 ---------- The revised and significantly updated second edition of our bestselling book about succeeding with AI agents, Age of Invisible Machines, is available everywhere: Amazon — https://bit.ly/4hwX0a5
#InvisibleMachines #Podcast #TechPodcast #AIPodcast #AI #AgenticAI #AIAgents #EnterpriseAI #KnowledgeManagement #AITransformation
More from Invisible Machines podcast by UX Magazine
For twenty-five years, Ben Reason and Lavrans Løvlie have been trying to give services the design quality people already expect from a product. Everybody knows what a designed BMW feels like. Almost nobody loves their bank, their hospital, or their mortgage. A product is the contract. A service is everything before it, during it, and after you are done, and it includes the relationships people do not aspire to: tax, a prison, a claim.
Three years after The Song of Significance, Seth Godin returns to Invisible Machines on the day his new book arrives, The Knot: Problems Can Be Solved. The compression of his body of work is now a sorting tool. Most stuckness is not a lack of information, it's an entanglement—two incompatible wants held at once. Effort doesn’t help. You stay stuck until you name the pin, pull it out, and loosen the knot.
The demo works. People start depending on it. Then one morning you have to explain yesterday's decision to someone who wasn't in the room.
Three years after his first Invisible Machines visit, Don Scheibenreif returns with a sharper read on the trough: everybody knows generative AI, almost nobody has answered what it does to the business model. He led Gartner’s Autonomous Business research, the successor to digital business, and co-authored When Machines Become Customers. The through-line is that AI is a tool, the harder question is how to create value with it.
There’s a particular kind of exhaustion that hits when you’re building with AI. You’ve got the license. You’ve got the pilot. You’ve got a chat window that generates whatever you ask for. But then comes the wall—the workflow that almost works, the dependency that loops back on itself, victories that only come when you quietly move the goalposts. In this episode, we talk about how to get around the wall.