What to Know Before Asking an AI Chatbot for Health Advice

Experts weigh the benefits and risks of using AI-powered chatbots for medical information and guidance.

Published on Mar. 2, 2026

Got story updates? Submit your updates here. ›

With hundreds of millions of people turning to chatbots for advice, tech companies have begun offering programs specifically designed to answer health questions. OpenAI's ChatGPT Health and Anthropic's Claude chatbot are two such examples, but experts caution that while these AI platforms can provide useful information, they should not be used as a substitute for professional medical care. The article outlines key considerations, including the importance of providing chatbots with detailed personal medical information, the lack of HIPAA privacy protections, and the limitations of current AI technology in accurately diagnosing and advising on health issues.

Why it matters

As AI chatbots become more prevalent, it's crucial for consumers to understand both the potential benefits and risks of using these tools for health-related information and guidance. While AI-powered chatbots may offer more personalized and specific responses than a generic online search, they are not a replacement for professional medical advice and can sometimes provide inaccurate or incomplete information.

The details

Both OpenAI and Anthropic say their health-focused chatbots are not meant to diagnose medical conditions, but can help summarize test results, prepare for doctor's visits, and analyze health data. However, experts caution that these AI platforms can sometimes "hallucinate" or give bad advice. Patients are advised to approach chatbots with "a degree of healthy skepticism" and never rely solely on their recommendations, especially for major medical decisions. Additionally, any personal health information shared with an AI company is not protected by the federal HIPAA privacy law that governs doctor-patient interactions.

  • In January 2026, OpenAI introduced ChatGPT Health.
  • A 1,300-participant study by Oxford University on the performance of AI chatbots in health scenarios was conducted in 2024.

The players

OpenAI

An artificial intelligence research company that has introduced ChatGPT Health, a version of its chatbot designed to answer health and medical questions.

Anthropic

An AI company that offers similar health-focused features in its Claude chatbot.

Dr. Robert Wachter

A medical technology expert at the University of California, San Francisco who sees AI chatbots as an improvement over the status quo for providing health information to patients.

Dr. Lloyd Minor

The dean of Stanford University's medical school, who cautions that consumers need to understand the different privacy standards that apply to personal health information shared with AI companies versus traditional healthcare providers.

Adam Mahdi

The lead author of a 2024 Oxford University study that found communication problems between people and AI chatbots in health scenarios, despite the chatbots' high accuracy in identifying underlying conditions.

Got photos? Submit your photos here. ›

What they’re saying

“The alternative often is nothing, or the patient winging it. And so I think that if you use these tools responsibly, I think you can get useful information.”

— Dr. Robert Wachter, medical technology expert (AP News)

“If you're talking about a major medical decision, or even a smaller decision about your health, you should never be relying just on what you're getting out of a large language model.”

— Dr. Lloyd Minor, dean of Stanford's medical school (AP News)

“When someone is uploading their medical chart into a large language model, that is very different than handing it to a new doctor. Consumers need to understand that they're completely different privacy standards.”

— Dr. Lloyd Minor, dean of Stanford's medical school (AP News)

What’s next

Independent testing and evaluation of the latest AI chatbot health features, such as ChatGPT Health and Anthropic's Claude, is still in its early stages. As these technologies continue to evolve, further research is needed to better understand their capabilities and limitations in providing accurate and reliable medical advice.

The takeaway

While AI-powered chatbots may offer a convenient way to get health information, it's crucial for consumers to approach these tools with caution and not rely on them as a substitute for professional medical care. Patients should always consult with their healthcare providers, especially for major medical decisions, and be aware of the privacy implications of sharing personal health data with AI companies.