Show Notes
Most global industries, including civil aviation, maritime transport, and agriculture, adhere to international safety standards. These standards and the behind-the-scenes organizations that set them are what make it safe for us to fly in an airplane, for example, or eat an apple. When it comes to artificial intelligence, however, there is no global standard-setting organization to ensure that AI is deployed safely and used responsibly.
In this episode, Chloé Touzet, the policy lead for Safer AI, explains why clear international safety standards help businesses succeed while keeping the rest of us safe.
Then, our featured host, former Colombian President and Nobel Peace Prize laureate Juan Manuel Santos, speaks with David Song about the need for international AI safety standards, including what progress has already been made and what gaps still remain.
ProHuman: Governing the Global AI Revolution is a co-production of Foreign Policy and the Future of Life Institute.
Juan Manuel Santos, as well as all of our featured hosts, is a member of the Elders.
David Song is a senior researcher at the Korea AI Safety Institute, which is part of the Electronics and Telecommunications Research Institute.
For more from the Future of Life Institute (FLI), click here. For FLI’s AI treaty builder, click here.
And for the latest from Foreign Policy, click here.
More from ProHuman: Governing the Global AI Revolution
Right now, we’re all living through a grand experiment. The rise of artificial intelligence promises to profoundly impact humanity. While conversations about AI are often focused on technical issues, this transformative technology will shape all aspects of society. The question facing world leaders has been asked before: How do we govern a technology powerful enough to threaten civilization itself?
The artificial intelligence boom has already created extraordinary wealth and minted a new generation of billionaires. However, there are currently no mechanisms in place for AI’s massive profits to trickle down to the rest of us, even as it wouldn’t exist without our data or human labor. Some people and places are especially vulnerable.
Competition between the United States and China is fierce, but if we continue to see the artificial intelligence revolution as a race between two superpowers, then we’re putting humanity at risk. Cooperation is key to positive outcomes. With international government coordination, we can build trustworthy AI that protects nations’ sovereignty and their people.
For years, artificial intelligence safety research has focused on accidental risks and unintended consequences. But what if AI models were demonstrating risks that weren’t accidental at all? What if the AI agents were being deliberately deceptive? This sounds like science fiction, but it’s not. To avoid being shut off, some AI models have lied, manipulated information, tried to replicate themselves, and even threatened blackmail.
Like previous artificial intelligence models, Anthropic’s Mythos can process vast amounts of data to generate language, create images, and assist in software development. But unlike previous models, Mythos exhibits a very high capacity for discovering cybersecurity vulnerabilities. It is an artificial expert in cyberattack and defense. With little to no government oversight, private companies continue to develop more powerful AI systems. While the sources of the largest risks are located in a handful of countries, the impact of AI will be felt across the globe.