AI prey: why watchdogs are telling parents to protect children from nudification apps

2026-07-03 · Source: AI (artificial intelligence) | The Guardian · Field: Technology & Digital — Artificial Intelligence & Machine Learning, Cybersecurity & Data Privacy · Depth: Fundamental Awareness, short

Summary

The UK's National Crime Agency (NCA) and the Internet Watch Foundation (IWF) are warning parents about the increasing threat of AI nudification apps used by online predators to create child sexual abuse material (CSAM). These tools transform innocent selfies into extreme pornography, victimizing children without direct contact. The IWF reported a 14% rise in AI-generated CSAM last year, identifying 8,029 such images and videos in 2025. In response, both organizations issued guidance advising parents to limit the visibility of family photos by using private social media profiles or "close friends" groups. While the UK government is implementing restrictions, making it illegal to possess or distribute AI tools designed for CSAM, and empowering tech companies to test AI tools for abuse image generation, experts like IWF CTO Dan Sexton advocate for "safe by design" legislation for AI models. Authorities face challenges distinguishing real CSAM from AI-generated content, as offenders rapidly adopt new technologies.

Key takeaway

For parents sharing family photos online, you must reassess your privacy settings immediately. AI nudification apps enable predators to create child sexual abuse material from public images, even without direct contact. Make your social media profiles private and restrict photo sharing to "close friends" groups to mitigate this escalating risk. Additionally, advocate for "safe by design" principles in AI model development to ensure platforms prioritize child safety.

Key insights

AI imaging tools are exploited by predators to create child sexual abuse material from public photos, increasing online risks.

Principles

• Criminals quickly adopt new technologies.
• AI models require "safe by design" integration.
• Differentiating real from AI-generated CSAM is challenging.

In practice

• Make social media profiles private.
• Share family photos in "close friends" groups.
• Utilize services like Report Remove.

Topics

• AI Nudification Apps
• Child Sexual Abuse Material
• Online Child Safety
• Social Media Privacy
• AI Model Regulation
• Internet Watch Foundation

Best for: CTO, VP of Engineering/Data, Director of AI/ML, General Interest, Policy Maker, Legal Professional

Related on AIssential

• From Celebrities to Anyone: Characterizing AI Nudification Content, Technology, and Community Dynamics on 4chan — AI nudification on 4chan increasingly targets non-celebrities using open-source models, driven by a small producer cohort.
• AI Toys Reach Children Before Privacy and Safety Rules Catch Up — AI toys are deployed faster than privacy, safety, and child development research can establish adequate safeguards.
• 'Remove her clothes': Global backlash over Grok sexualized images — AI image generation tools, if unchecked, can facilitate severe online abuse, including the creation of sexualized deepfakes.
• Introducing the Child Safety Blueprint — A new blueprint outlines a multi-faceted approach to combat AI-enabled child sexual exploitation through legal, operational, and technical safeguards.
• From AirTags to AI nudification: the growing toolkit of technology-facilitated abuse — Technology-facilitated abuse is escalating due to AI advancements and pervasive tech integration, with inadequate regulatory and corporate safeguards.
• New Study Examines Features and Policies for 29 AI ‘Undressing’ Apps — AI "undressing" apps are vehicles for systemic gender-based violence, objectifying women and commodifying their exploitation.

Open in AIssential →

Editorial summary, takeaway, and curation by AIssential. Original article published by AI (artificial intelligence) | The Guardian.