Meta turns off the Instagram feature that let users make AI deepfakes of public accounts

2026-07-10 · Source: The Verge · Field: Technology & Digital — Artificial Intelligence & Machine Learning, Cybersecurity & Data Privacy · Depth: Fundamental Awareness, quick

Summary

Meta has disabled an Instagram feature that allowed users to generate AI images by tagging public accounts, following significant public and organizational backlash. Introduced earlier this week, the feature enabled content from any public Instagram profile to be used in AI creations without explicit owner permission. Meta stated its intent was to provide a "useful creative tool" but acknowledged it "missed the mark" after widespread criticism. Organizations like the National Center on Sexual Exploitation and SAG-AFTRA condemned the default opt-in approach, citing concerns over likeness rights and potential misuse for sextortion. This strong negative feedback prompted Meta to remove the feature entirely, despite initially offering an opt-out option.

Key takeaway

For platform product managers designing new AI features, prioritize user consent and default privacy settings from the outset. Implementing a default opt-in for sensitive data, especially public likeness, generates significant backlash and erodes user trust, necessitating immediate feature retraction. Proactive ethical design prevents reputational damage and ensures feature longevity.

Key insights

Meta removed an Instagram AI image generation feature due to backlash over unauthorized use of public account content.

Principles

• User consent is paramount for AI data usage
• Default opt-in for sensitive data risks backlash
• High-risk design requires robust safeguards

In practice

• Review platform privacy settings regularly
• Monitor new AI features for default permissions

Topics

• Instagram
• Meta AI
• AI Ethics
• User Privacy
• Content Moderation
• Deepfakes
• Opt-out Mechanisms

Best for: CTO, VP of Engineering/Data, Director of AI/ML, AI Ethicist, Legal Professional, Tech Journalist

Related on AIssential

• Meta removes controversial AI feature on Instagram after backlash — AI features using public content without explicit user notification or consent risk immediate backlash and removal.
• Meta kills Muse Image feature that let anyone generate AI photos of Instagram users without consent — Meta's rapid retraction of Muse Image highlights critical user consent and default setting challenges in AI-generated content features.
• Meta ditches Muse Image AI feature because it ‘misses the mark’ on users’ privacy — Automatic opt-in for AI features using public data risks significant privacy backlash and requires immediate reversal.
• Literally everyone hated this feature — Instagram's AI image generation feature failed due to a fundamental lack of consent and automatic opt-in for public profiles.
• Meta pulls Instagram AI feature amid privacy concerns — Rapid AI feature deployment without clear consent mechanisms for public data risks immediate user backlash and withdrawal.
• The Instagram AI Privacy Backlash: What Marketers Should Take From It — Default-on consent for AI data use is a significant brand-safety risk, not a growth strategy.

See Counsel's argued verdicts on the open AI decisions leaders are weighing →

Open in AIssential →

Editorial summary, takeaway, and curation by AIssential. Original article published by The Verge.