Preserving Human Moral Agency Amid AI in Healthcare

Penn Nursing experts warn that nurses must lead the design and implementation of AI to maintain the core values of the profession.

Mar. 11, 2026 at 7:22am

Got story updates? Submit your updates here. ›

As artificial intelligence (AI) rapidly integrates into clinical settings, an article published in the Hastings Center Report warns that the core of nursing, its moral agency, must remain a human-driven responsibility. The authors argue that while AI systems can now simulate empathy, they lack the sentience, intentionality, and accountability required for true moral agency. The article emphasizes that nurses must not be passive users of technology but active leaders in its design and implementation to preserve the public's trust.

Why it matters

The global robotic nurse industry is projected to reach over $2.7 billion by 2031, underscoring the urgency of establishing ethical guardrails as AI becomes more prevalent in healthcare. Preserving the human element of nursing, characterized by a "therapeutic presence" and intuitive exchange of shared humanity, is essential to maintaining the profession's core values and public trust.

The details

The article, "What Does Moral Agency Mean for Nurses in the Era of Artificial Intelligence?", explores the growing tension between advanced algorithmic capabilities and the ethical obligations of the world's most trusted profession. The authors define a moral agent as a person capable of discerning right from wrong and being held accountable for their actions, which they argue AI systems lack. The article emphasizes that nurses must be active leaders in the design and implementation of AI tools to ensure they align with clinical values and preferences, and that facilities should explicitly disclose when AI is used to generate summaries or treatment suggestions.

  • The article was published on March 10, 2026.

The players

Connie M. Ulrich

The Lillian S. Brunner Chair in Medical and Surgical Nursing, Professor of Nursing, and Professor of Medical Ethics and Health Policy at the University of Pennsylvania School of Nursing.

George Demiris

Co-author from the University of Pennsylvania School of Nursing.

Patricia Brennan

Co-author from the University of Pennsylvania School of Nursing.

Oonjee Oh

Co-author from the University of Pennsylvania School of Nursing.

Sang Bin You

Co-author from the University of Pennsylvania School of Nursing.

Got photos? Submit your photos here. ›

What they’re saying

“Patients come to health care settings to be heard, seen, and valued by skilled professionals, not to seek care from machines. While AI may simulate compassion... it cannot 'care' in the moral sense.”

— Connie M. Ulrich, The Lillian S. Brunner Chair in Medical and Surgical Nursing, Professor of Nursing, and Professor of Medical Ethics and Health Policy (Hastings Center Report)

What’s next

The article emphasizes that nurses must be actively involved in the design and implementation of AI systems in healthcare to ensure they align with the profession's core values and ethical obligations.

The takeaway

This case highlights the critical need for nurses to lead the integration of AI in healthcare, ensuring that the human element of the profession, characterized by moral agency and a therapeutic presence, remains at the forefront as advanced technologies become more prevalent in clinical settings.