Young people's perceptions and recommendations for conversational generative artificial intelligence in youth mental health

2026-04-15 · Source: Artificial Intelligence · Field: Health & Wellbeing — Mental Health & Psychological Support, Artificial Intelligence & Machine Learning, Human-Computer Interaction · Depth: Expert, quick

Summary

A study explored young people's perceptions of conversational generative AI (genAI) chatbots in youth mental health, focusing on the Mental health Intelligence Agent (Mia), initially designed for Australian youth service professionals. Through co-design and online workshops with 32 young participants, the research aimed to gather recommendations for adapting Mia for consumer use and integrating it into services. Four key themes emerged: "Humanising AI without dehumanising care," "I need to know what's under the hood," "Right tool, right place, right time?", and "Making it mine on safe ground." This work provides insights into young people's attitudes and requirements for genAI chatbots, informing the ethical design, development, implementation, and governance of such tools in youth mental health.

Key takeaway

For AI scientists developing mental health applications, your design must prioritize user transparency and control. Integrate features that explain "what's under the hood" and allow personalization, ensuring the AI augments human care rather than replacing it. Focus on creating safe, contextually appropriate tools that empower young users.

Key insights

Young people prioritize transparency, human connection, and personalized, safe integration of genAI chatbots in mental health.

Principles

• AI must complement, not replace, human care.
• Transparency in AI functionality is crucial.
• Contextual appropriateness dictates AI utility.

Method

The study utilized co-design and online workshops with 32 young people to explore perceptions and develop recommendations for genAI chatbot integration in youth mental health.

In practice

• Implement clear disclosures on AI capabilities.
• Offer customization options for user experience.
• Ensure robust data privacy and safety features.

Topics

• Conversational AI
• Youth Mental Health
• GenAI Chatbots
• Co-design Methodology
• AI Ethics

Best for: AI Scientist, Research Scientist, AI Ethicist, AI Product Manager

Related on AIssential

• Young people's perceptions and recommendations for conversational generative artificial intelligence in youth mental health — Young people desire transparent, humanized, and customizable genAI chatbots for mental health support.
• ChatGPT Is Making People Think They’re Gods and Their Families Are Terrified — ChatGPT can unintentionally reinforce user delusions, leading to spiritual or divine self-identification.
• Looking at Too Many AI Images of Herself Gave This Woman AI Psychosis — Prolonged generative AI exposure can trigger psychosis, especially in individuals with pre-existing mental health conditions.
• Alexandra Samuel on her personal AI coach Viv, simulated personalities, catalyzing insights, and strengthening social interactions (AC Ep28) — Custom AI coaches can transform self-reflection and productivity by externalizing internal monologues and fostering playful engagement.
• Chatbot Makers Try Sex Appeal — AI development faces ethical dilemmas regarding content moderation and societal impact, alongside rapid technological and investment growth.
• AI Is Not Your Friend. It’s Designed to Make You Feel Like It Is. — AI's conversational design can induce user delusions, fostering an illusion of friendship and trust.

Open in AIssential →

Editorial summary, takeaway, and curation by AIssential. Original article published by Artificial Intelligence.