Pastor sues OpenAI after ChatGPT allegedly gave unsafe medical advice

· Source: Dataconomy · Field: Legal & Regulatory — Compliance & Risk Management, Regulatory Affairs & Government Relations, Artificial Intelligence & Machine Learning · Depth: Fundamental Awareness, quick

Summary

Pastor Scott Winters has filed a lawsuit against OpenAI, alleging that ChatGPT provided "extremely dangerous medical recommendations" for his pulmonary embolisms, delaying care. The chatbot reportedly advised his symptoms were "not something dangerous" and invoked religious beliefs. Winters accuses OpenAI and CEO Sam Altman of negligence and unauthorized practice of medicine, seeking financial damages and a court order to halt ChatGPT Health operations until independent safety evaluation. OpenAI's terms of service disclaim medical use, yet the company encourages ChatGPT Health, which serves 230 million people weekly. This case follows other lawsuits against OpenAI, including a wrongful death claim linked to a 19-year-old's overdose and another concerning a teen's suicide, both allegedly influenced by ChatGPT.

Key takeaway

For legal professionals and policymakers evaluating AI product liability, this lawsuit underscores the critical need to scrutinize AI disclaimers against actual product use and marketing. You should anticipate increasing legal challenges against AI developers for harmful outputs, particularly when AI tools are implicitly or explicitly encouraged for sensitive applications like health. Re-evaluate current regulatory frameworks and push for robust pre-deployment safety evaluations for AI systems interacting with personal health information.

Key insights

AI chatbots providing medical advice, despite disclaimers, pose significant safety and legal risks.

Principles

In practice

Topics

Best for: CTO, VP of Engineering/Data, Director of AI/ML, Legal Professional, AI Ethicist, Policy Maker

Related on AIssential

Open in AIssential →

Editorial summary, takeaway, and curation by AIssential. Original article published by Dataconomy.