The danger of confusing AI mental health support with therapy

2026-06-23 · Source: Artificial intelligence (AI) – The Conversation · Field: Health & Wellbeing — Mental Health & Psychological Support, Artificial Intelligence & Machine Learning · Depth: Intermediate, medium

Summary

The article highlights the critical distinction between AI mental health support and human therapy, using a British sitcom example where a character uses ChatGPT for sensitive family advice. It explains that genuine therapy relies on a "not-knowing stance," where the client is the expert, and a "therapeutic alliance" built on trust, connection, and shared purpose, rather than just providing answers. While AI chatbots offer accessibility and non-judgmental responses, with potential in screening and psychoeducation, they lack the human presence, intersubjectivity, ethical responsibility, and capacity for genuine relational engagement. Reviews in 2025 emphasized the need for stronger evaluation and safeguards for AI in mental health, underscoring that AI cannot replicate the trained human presence that listens, responds, and remains accountable.

Key takeaway

For mental health professionals evaluating AI tools, recognize that while chatbots offer accessible support and psychoeducation, they cannot replicate the core elements of human therapy. Prioritize solutions that augment, rather than replace, the "not-knowing stance" and therapeutic alliance. Ensure AI applications are rigorously evaluated for safety, privacy, and over-reliance, and clearly differentiate AI support from professional therapy to manage user expectations and ethical responsibilities.

Key insights

AI mental health support lacks the relational depth, ethical responsibility, and "not-knowing stance" essential for human therapy outcomes.

Principles

• Therapeutic alliance is crucial for positive therapy outcomes.
• A "not-knowing stance" empowers clients as experts on their own lives.
• Human therapists provide intersubjective presence and ethical accountability.

Method

Trainee therapists develop clinical skill by tolerating uncertainty, reflecting on the "not-knowing stance," and resisting the urge to provide immediate answers.

In practice

• AI chatbots offer accessible, non-judgmental emotional support.
• AI tools can aid in mental health screening and psychoeducation.
• Use AI to prepare for difficult conversations or practice seeking help.

Topics

• AI Mental Health
• Psychotherapy
• Therapeutic Alliance
• Not-Knowing Stance
• Ethical AI
• Large Language Models

Best for: CTO, VP of Engineering/Data, Director of AI/ML, AI Ethicist, Research Scientist, Domain Expert

Related on AIssential

• AI Chatbots in Mental Health: Comfort Is Not the Same as Improvement — AI chatbots are rapidly becoming common tools for mental health support, offering "therapy-adjacent support and companionship" but raising critical concerns that comfort is being prioritized over genuine improvement.
• Why AI Will Not Replace Psychologists: The Body, the Vagus Nerve, and the Boundaries of Digital… — Embodied co-regulation through human physiological presence is indispensable for psychological healing, a capability AI lacks.
• Good News & Bad News: AI is better than most therapy for some people. You need to understand some nuance, but its genuinely extraordinarily valuable. — AI provides uniquely personalized, accessible, and nuanced mental health support, often surpassing traditional therapy for specific needs.
• TherapyGym: Evaluating and Aligning Clinical Fidelity and Safety in Therapy Chatbots — TherapyGym evaluates and aligns therapy chatbots using clinical fidelity and safety metrics, improving performance through RL with expert-validated feedback.
• ‘At 2am, it feels like someone’s there’: why Nigerians are choosing chatbots to give them advice and therapy — AI chatbots are bridging critical mental health access gaps in Nigeria, offering affordable, anonymous support where traditional care is scarce.
• 😺 🎙️ AI therapy? We're LIVE right now — Purpose-built AI for therapy, like Ash, aims to mitigate risks associated with general-purpose chatbots in mental health.

Open in AIssential →

Editorial summary, takeaway, and curation by AIssential. Original article published by Artificial intelligence (AI) – The Conversation.