Voices from DARPA

Episode 83: When Should Machines Decide?

Voices from DARPA

Show Notes

What characteristics make a person trustworthy? Under what circumstances would a person delegate life or death decisions to artificial intelligence (AI)? Does it matter that AI systems reflect trustworthy humans’ decision-making preferences, morals, and ethics? If so, what characteristics are most important?

These are some of the fundamental questions DARPA researchers are exploring for the In the Moment (ITM) program, which aims to support the development of algorithms that are trusted to independently make decisions in difficult domains, particularly in significant trauma events such as battlefield triage.

DARPA’s research has identified the need for fundamentally different approaches to advance AI technology to a place where we’re willing to trust it and not be foolish to do so. Continuing themes from our mini-series on ELSI – ethical, legal, and societal implications of new technologies and capabilities – we meet with DARPA’s ITM program manager, Dr. Patrick Shafto, and the ITM performers and ELSI advisors, who break down how they’re tackling the fundamental question of alignment in the context of human decision-makers and autonomous decision-making tools.

In case you missed them, check out our previous ELSI series episodes at the following links: Episode 79: Integrating ELSI Episode 78: Introducing ELSI

Our special thanks to the following ITM performers and advisors for their contributions to this episode (in order of their appearance): · Alice Leung, RTX BBN · Joseph Cohn, SoarTech · Matthew Molineaux, Parallax Advanced Research · Arslan Basharat, Kitware Inc. · Jennifer McVay, CACI · Dave Cotting, Institute for Defense Analyses (IDA) · Sarah Daly, IDA · Lauren Diaz, University of Maryland Applied Research Laboratory for Intelligence and Security (ARLIS) · Ellie Tyler, ARLIS

More from Voices from DARPA

Oct 1, 2026

logistics challenge sparked a movement to break a nearly century-old barrier holding back heavy vertical-lift aircraft.

Aug 27, 2026

As the landscape of naval warfare changes, traditional defense methods like large convoys and standard object recognition are becoming impractical. New, scalable solutions are needed to help U.S. Navy Sailors identify maritime threats, track potential targets, and safeguard the massive commercial and military logistics vessels that form the backbone of global trade and defense.

Jul 9, 2026

What new capabilities can we unlock by understanding how to rearrange the building blocks of matter? At some time in our lives, most of us have learned that matter is made of molecules, molecules are made of atoms, and atoms are made of protons, electrons, and neutrons. But what’s less commonly learned is what’s going on inside those atoms and molecules, such as when a bond breaks or internal components are rearranged through a chemical reaction.

Jun 12, 2026

What if we could turn economic complexity into strategic understanding? In this episode, we sit down with David Rushing Dewhurst, Ph.D., a program manager in DARPA\'s Information Processing Techniques Office, IPTO. Dewhurst works at the complex intersection of economics, data science, and national security to develop tools that help America navigate a world where economic competition has become a primary battlefield.

May 20, 2026

What does it take to solve the world's most urgent national security and economic challenges? At DARPA, it starts with questioning past assumptions. In this episode, we go behind the scenes of a major organizational pivot to hear directly from the office leaders driving the change.

See all episodes →