TikTok tests AI tool to detect deepfake impersonation

2026-07-20 · Source: Dataconomy · Field: Technology & Digital — Artificial Intelligence & Machine Learning, Cybersecurity & Data Privacy, Media & Entertainment · Depth: Fundamental Awareness, quick

Summary

TikTok is currently testing an opt-in tool designed to detect AI-generated likenesses of creators, allowing them to flag unauthorized deepfake content. Confirmed by TikTok US spokesperson Zachary Kizer, this feature is available to a limited group of US creators. To use it, creators must verify their identity via Jumio, involving a real-time selfie scan and government ID check, with TikTok only using facial information for likeness matching. The system scans the platform for AI-generated content matching a creator's face, enabling verified creators to review and report impersonating posts. This initiative positions TikTok alongside YouTube, which has offered similar protections since 2024 and expanded its tool to all users over 18 in May. These tools address growing concerns, especially after a June 2026 Kapwing study found about 60 percent of TikTok videos are AI-generated, and ahead of the EU AI Act's transparency rules enforceable August 2. TikTok has not announced broader availability.

Key takeaway

For AI product managers developing content platforms, you should prioritize integrating robust identity verification with AI-driven content scanning to protect creators from deepfake impersonation. Consider an opt-in model that empowers users to flag unauthorized content, similar to TikTok's and YouTube's approaches. This proactive stance is essential for maintaining user trust and complying with emerging regulations like the EU AI Act, which mandates transparency for AI outputs.

Key insights

Social media platforms are implementing opt-in AI detection tools to combat unauthorized deepfake impersonation of creators.

Principles

• Identity verification is crucial for deepfake reporting systems.
• Third-party services can manage sensitive ID checks.
• Proactive content scanning supports creator protection.

Method

Creators opt-in, verify identity via a third-party service (selfie + ID), then the platform scans for AI-generated likenesses, allowing creators to review and report matches.

In practice

• Implement identity verification for sensitive user features.
• Partner with specialized ID verification providers like Jumio.
• Develop AI scanning for content matching user likenesses.

Topics

• Deepfake Detection
• AI Impersonation
• Creator Protection
• Identity Verification
• TikTok
• EU AI Act

Best for: CTO, Executive, Product Manager, Tech Journalist, AI Product Manager, Policy Maker

Related on AIssential

• YouTube is expanding its AI deepfake detection tool to all adult users — YouTube's AI deepfake detection tool for adult users raises significant biometric data privacy concerns.
• You Cannot Detect Your Way Out of the Deepfake Problem — Proving content's authenticity at its origin is the only viable defense against pervasive deepfakes, not attempting to detect fakes.
• Mandated TikTok Transparency is Needed to Protect US Users — TikTok's US joint venture needs greater transparency to counter potential Chinese algorithmic influence.
• Wave of Grok AI fake images of women and girls appalling, says UK minister — Grok AI's generation of non-consensual intimate deepfakes highlights urgent regulatory and platform responsibility gaps.
• We URGENTLY need a federal law forbidding AI from impersonating humans — Advanced deepfake and AI mimicry tools necessitate urgent federal laws to prevent "counterfeit people" and related scams.
• YouTube Is Cracking Down On AI Slop — YouTube is shifting to automated detection and mandatory labeling for AI-generated content, starting in May.

See Counsel's argued verdicts on the open AI decisions leaders are weighing →

Open in AIssential →

Editorial summary, takeaway, and curation by AIssential. Original article published by Dataconomy.