Show Notes
What happens when AI stops advising and starts acting? Agentic AI promises autonomy, speed, and a new level of intelligence in how systems operate. But as these systems begin to pursue goals and make decisions, the risks become harder to predict. In this episode of The AI Forecast, Paul Muller sits down with futurist Nell Watson, AI ethics expert and co-author of “Safer Agentic AI: Principles and Responsible Practices,” to explore what safe, responsible AI looks like in this new era. In this engaging conversation, Nell shares insights from her journey in AI, her work on ethics and safety, and why agentic systems represent a fundamental shift in how we think about risk. From data provenance to governance frameworks, she explains why organizations must move from reactive oversight to proactive design—and why cooperation will be critical to navigating what comes next. Together, Paul and Nell delve into:
Why “AI is the butler for the brain” The importance of data provenance in building trustworthy systems How AI ethics and safety must be embedded from the start Why governance needs to anticipate risks, not just respond to them The role of “AI supervising AI” in maintaining control How science fiction can help us prepare for real-world AI challenges
If you’re a business or technology leader deploying AI, this episode offers a clear, practical lens on balancing innovation with responsibility—and why safety is now a core requirement for scaling AI systems.
Stay in touch with Nell:
Nell Watson on LinkedIn: https://www.linkedin.com/in/nellwatson/ Nell’s website: https://www.nellwatson.com/ Nell Watson’s books on Amazon: https://www.amazon.com/stores/author/B0CWS75KPG
To hear more about AI governance, listen to EP 67 | The “Wobbly” Nature of AI: Governing an Unpredictable Technology +++ Like and subscribe to The AI Forecast, sponsored by Cloudera, to stay up to date on the latest episodes. You can watch the video version of this episode on The AI Forecast.
More from The AI Forecast: Data and AI in the Cloud Era
One developer burned through 300 million AI tokens in a single week. The payoff was far less impressive. For Todd Trevillion, it's a striking example of what can happen when AI adoption outpaces the controls needed to manage it. And with autonomous AI agents beginning to make decisions on behalf of businesses, the stakes are getting higher. Recorded at EVOLVE26 Singapore, this episode of The AI Forecast follows Paul Muller as he sits down with Todd Trevillion, technology entrepreneur and co-founder of Citadel Edge, to explore whether enterprises are truly ready for agentic AI and what it takes to deploy the technology responsibly. Working with organizations in highly regulated industries, Todd has seen how quickly AI ambitions can run into operational reality. He questions whether enterprises are prepared to give autonomous agents greater control when the consequences of their actions can be difficult to predict. Paul and Todd dive into:
The AI worked in the sandbox. Then it met the real world. David Hardoon learned that lesson during an ATM optimization project designed to improve cash-delivery routes. Once deployed, the system collided with traffic and unpredictable schedules, which are the realities that face the people doing the work. Recorded at EVOLVE26 Singapore, this episode of The AI Forecast brings Paul Muller together with David Hardoon, Head of Advanced AI at Accenture, to explore why the human side of AI transformation can determine whether promising technology ever delivers value in production. Paul and David discuss:
Your AI agent has credentials. Now, what happens when it goes off script? An agent can take action and change course before a traditional security review even begins. For Alex Bovee, identity is only the beginning of the security conversation. In this episode of The AI Forecast, Paul Muller sits down with Alex Bovee, co-founder and CEO of C1 and longtime cybersecurity and identity leader, to explore how autonomous AI agents are changing enterprise security. Alex argues that zero trust was built for a world where people remained behind the keyboard. AI agents introduce non-deterministic behavior and can relentlessly optimize toward a goal, sometimes finding routes their creators never anticipated. Paul and Alex’s discussion examines:
An AI project can deliver a great prediction and still fail the business. Rajesh Kelvalkar has seen it happen firsthand. In one mining project, the model worked, but the team discovered that the downstream business process wasn’t configured to act consistently on its recommendations. The technology had done its job, but the transformation hadn’t. Recorded at EVOLVE26 Singapore, this episode of The AI Forecast brings Paul Muller together with Rajesh Kelvalkar, Senior Advisor at Tech Data APJ, to explore what more than 20 years of transformation work has taught him about putting AI into practice. Rajesh argues that organizations often approach transformation as a technology initiative, even though much of the work happens elsewhere in the business. Clear ownership and measurable outcomes determine whether an AI pilot becomes part of operations or disappears when the project team moves on. Paul and Rajesh explore:
After 23 years in machine learning and data science, Cao Hong has seen plenty of AI projects come and go. His measure of success is simple: did it create value for the business? Recorded at EVOLVE26 Singapore, this episode of The AI Forecast brings Paul Muller together with Cao Hong, Principal Director of Data Apps at NCS, to explore how organizations can turn AI experimentation into measurable business impact. That becomes harder as enthusiasm for AI pushes expectations higher. Cao Hong argues that organizations need to define the outcome they’re working toward early and then understand how AI will fit into how the business actually operates. Having worked across research and commercial AI projects, Cao Hong has seen how differently the two environments operate. Research can explore problems whose value may be realized years from now. In business, AI ultimately has to earn its investment. That means connecting the technology to a clear use case and establishing how its performance will translate into business value. Paul and Cao Hong explore: