Instagram will alert parents if their kids ‘repeatedly’ search for self-harm topics

· Source: The Verge · Field: Technology & Digital — Artificial Intelligence & Machine Learning, Emerging Technologies & Innovation · Depth: Fundamental Awareness, quick

Summary

Instagram is launching a new feature next week that will notify parents when their teen repeatedly searches for terms related to self-harm or suicide within a short period. This system, rolling out initially in the US, UK, Australia, and Canada, requires both parents and teens to opt into Instagram's supervision features. Meta plans to extend a similar alert system to its AI chatbots later this year. Instagram's stated goal is to empower parents to intervene if their teen's search behavior suggests a need for support, while also avoiding excessive notifications that could diminish the feature's utility. Alerts will be delivered via email, text, or WhatsApp, and will include in-app notifications with resources for discussing sensitive topics.

Key takeaway

For parents concerned about their children's online safety, you should consider opting into Instagram's supervision features to receive alerts regarding self-harm or suicide-related searches. This proactive notification system, coupled with provided resources, offers a structured way to identify potential issues and initiate supportive conversations, enhancing your ability to safeguard your teen's mental well-being on the platform.

Key insights

Instagram will alert opted-in parents about teens' repeated self-harm searches, aiming to provide support.

Principles

Method

The system detects repeated searches for self-harm/suicide terms, then sends alerts via email, text, or WhatsApp to opted-in parents, including in-app guidance and resources.

In practice

Topics

Best for: CTO, VP of Engineering/Data, Director of AI/ML, General Interest, Tech Journalist, AI Ethicist

Related on AIssential

Open in AIssential →

Editorial summary, takeaway, and curation by AIssential. Original article published by The Verge.