AI Healthcare Chatbots as Information Infrastructure: A Large-Scale Study of User-Reported Breakdowns

2026-06-25 · Source: Artificial Intelligence · Field: Health & Wellbeing — Medical Devices & Health Technology, Human-Computer Interaction, Artificial Intelligence & Machine Learning · Depth: Intermediate, quick

Summary

A large-scale study analyzed over 15,000 user reviews from 59 AI healthcare chatbot applications to understand their performance and user impact in daily informational and emotional contexts. The research identified three primary categories of breakdowns: access barriers and service unreliability, issues related to user experience and interaction quality, and problems with billing and customer support. Notably, privacy and security concerns were strongly associated with the most negative user experiences. By conceptualizing AI healthcare chatbots as critical information infrastructures, the findings underscore how failures in accessibility, usability, and trust significantly affect users, providing a foundation for improving digital health systems.

Key takeaway

For AI Product Managers developing healthcare chatbots, prioritize robust infrastructure that ensures reliable access and high interaction quality. Your focus must extend beyond core functionality to include transparent billing and responsive customer support, as these significantly impact user trust. Critically, address privacy and security concerns proactively, as these are directly linked to the most negative user experiences and can undermine adoption.

Key insights

AI healthcare chatbots, as information infrastructure, face critical breakdowns in access, usability, and trust, impacting user experience.

Principles

• Chatbot failures affect user trust.
• Usability and access are core infrastructure needs.
• Privacy concerns drive negative experiences.

Method

The study used topic modeling and interpretive analysis on over 15,000 user reviews from 59 AI healthcare chatbot apps to identify recurring breakdowns and their impact.

In practice

• Address access and reliability issues.
• Improve chatbot interaction quality.
• Enhance privacy and security features.

Topics

• AI Healthcare Chatbots
• User Experience
• Information Infrastructure
• Digital Health Systems
• Privacy Concerns

Best for: CTO, VP of Engineering/Data, Director of AI/ML, AI Product Manager, Policy Maker, AI Ethicist

Related on AIssential

• ‘At 2am, it feels like someone’s there’: why Nigerians are choosing chatbots to give them advice and therapy — AI chatbots are bridging critical mental health access gaps in Nigeria, offering affordable, anonymous support where traditional care is scarce.
• People are turning to AI chatbots to plug gaps in health information — People are increasingly using AI chatbots for health information, despite concerns about content quality.
• When RAG Chatbots Expose Their Backend: An Anonymized Case Study of Privacy and Security Risks in Patient-Facing Medical AI — Patient-facing RAG chatbots can expose critical privacy and security vulnerabilities through client-side communication.
• Users of social media and AI chatbots for health information are more likely to say they are convenient than accurate — Digital health information from social media and AI chatbots is valued for convenience and understandability, not accuracy.
• Developing and evaluating a chatbot to support maternal health care — Trustworthy medical chatbots in noisy, multilingual settings require defense-in-depth design and multi-method evaluation.
• Real-world safety and harms from patient-facing LLMs — Real-world data on AI chatbot harms in health is limited but growing, highlighting mental health risks.

Open in AIssential →

Editorial summary, takeaway, and curation by AIssential. Original article published by Artificial Intelligence.