AI Governance Illusion: Hidden Risks & Accountability in ITSM
The ITSM Practice: Elevating ITSM and IT Security KnowledgeShow Notes
AI governance maturity can be misleading. Many organizations rely on frameworks, policies, and dashboards that signal control but fail to reflect true understanding of AI systems. This episode explores the Governance–Understanding Gap, highlighting why unclear decision ownership and limited system insight create hidden risks in AI, ITSM, and Enterprise Service Management environments.
In this episode, we answer to: What is the worst decision an AI system could realistically make in practice? Which AI system in the organization is least understood and hardest to explain? If an AI system makes a harmful decision, who is accountable for it?
Resources Mentioned in this Episode: NIST website, framework "AI Risk Management Framework", link https://www.nist.gov/itl/ai-risk-management-framework
European Commission website, policy "Artificial Intelligence", link https://digital-strategy.ec.europa.eu/en/policies/artificial-intelligence
ISO Standards website, ISO/IEC 42001 standard, link https://www.iso.org/standard/81230.html
MIT Sloan Management Review website, article "A framework for assessing AI risk", link https://mitsloan.mit.edu/ideas-made-to-matter/a-framework-assessing-ai-risk
Stanford Human-Centered AI website, article " AI Index 2025", link https://aiindex.stanford.edu
Connect with me on: LinkedIn: https://www.linkedin.com/in/theitsmpractice/ Website: http://www.theitsmpractice.com And if you want more tips and guidance, follow me on LinkedIn. I am sharing daily posts regarding Enterprise Service Management, IT Service Management, and IT Security.
Credits: Sound engineering by Alan Southgate - http://alsouthgate.co.uk/
Graphics by Yulia Kolodyazhnaya
More from The ITSM Practice: Elevating ITSM and IT Security Knowledge
How can an MSP grow revenue without growing headcount at the same rate? In this episode of The ITSM Practice Podcast, Luigi Ferri explores how MSPs can protect margins through a scalable Target Operating Model, standardization, automation, AI, knowledge management, self-service, suppliers, and Professional Services.
What happens when a cyber-physical threat crosses Cybersecurity, Physical Security, Facilities and IT Operations? This episode explores how SOC teams can correlate signals, establish incident ownership, define escalation thresholds and build a unified operating model to protect critical infrastructure and business services.
Does your SOC really protect the entire business, or does its visibility stop at the firewall? In this episode of The ITSM Practice Podcast, Luigi Ferri explores drone threats against data centers and what they reveal about gaps between Cybersecurity, Physical Security, Facilities, IT Operations and Business Continuity. Discover why CISOs need to rethink the traditional cyber attack surface and focus on protecting the complete service.
AI that summarizes an incident is one thing. AI that disables accounts, isolates endpoints and blocks connections is another. In this episode of The ITSM Practice Podcast, Luigi Ferri explains the ITIL 5 6C Model for AI and why CIOs, CISOs and MSPs need to stop asking, “Are we using AI?” and start asking, “What are we allowing AI to do?”
A critical vulnerability is not automatically a critical business risk. If your CMDB only tells you which server is affected but not the customer, service, contract, SLA, or revenue behind it, you are missing the information that matters. This episode explains why CISOs need a business-aware CMDB to connect technical risk with real business impact.