AI Raises Concerns for In Extremis Decision-Making

Experts warn of risks as AI becomes more prevalent in high-stakes, dangerous situations.

Published on Feb. 17, 2026

Got story updates? Submit your updates here. ›

As artificial intelligence (AI) becomes more advanced, it is being explored as a tool to aid decision-making in high-stakes, time-sensitive situations like military operations, law enforcement, and emergency medicine. However, experts caution that the use of AI in these "in extremis" scenarios comes with significant risks and ethical considerations that must be carefully addressed.

Why it matters

In extremis decision-making, where lives are on the line and there is little time to deliberate, has historically been the domain of human judgment and training. The introduction of AI into these critical decisions raises concerns about the degree of human control, cultural differences in AI policies, moral and ethical factors, and the challenges of verifying information in the face of disinformation.

The details

Proponents argue that AI's speed and information-processing capabilities could transform "System II" (conscious, deliberative) thinking into "System I" (fast, intuitive) thinking, potentially improving outcomes in high-pressure situations. For example, AI could have more quickly processed the information that led to the tragic downing of Iran Air Flight 655 by the USS Vincennes in 1988. However, experts warn that fully autonomous AI decision-making in these contexts is ethically questionable, and that AI must be designed to consider moral and ethical factors. There are also concerns about how AI could be employed by authoritarian regimes or terrorist groups, as well as the varying levels of public trust in AI across different contexts and nationalities.

  • The USS Vincennes incident occurred in 1988.
  • Experts are currently exploring the use of AI to aid in extremis decision-making.

The players

Daniel Kahneman

A Nobel Laureate who distinguished between "System I" (fast, intuitive) and "System II" (slow, deliberative) thinking.

West Point cadets

Military personnel who receive a combination of academic and hands-on training to hone both types of thinking.

Got photos? Submit your photos here. ›

What’s next

Experts will continue to explore the potential benefits and risks of using AI to aid in extremis decision-making, with a focus on ensuring appropriate human oversight and the incorporation of moral and ethical considerations.

The takeaway

While AI may offer advantages in high-stakes, time-sensitive decision-making, its use in these critical contexts must be approached with great caution and careful consideration of the ethical implications to ensure it is not misused in ways that endanger lives.