Chinese activist in UK told by X that abusive deepfakes do not breach rules

2026-06-10 · Source: AI (artificial intelligence) | The Guardian · Field: Technology & Digital — Artificial Intelligence & Machine Learning, Cybersecurity & Data Privacy · Depth: Fundamental Awareness, short

Summary

Chinese activist Apple Peiqing Ni, founder of the UK-based China Dissent Network, was targeted on X by deepfake posts portraying her as a promiscuous drug addict after she announced participation in a Tiananmen Square commemoration. The abuse included 12 posts with fake photographs and videos, tagging Ni and describing her as having "chronically chaotic sexual relationships" and being a heavy drug user. X's automated systems and subsequent support complaints initially deemed these posts not to breach rules on harassment or violent speech, despite platform policies against malicious targeting for humiliation. The abusive account was only suspended hours after The Guardian contacted X's press office. Ni, who moved to the UK in 2019, believes a pro-regime bot is behind the attacks and reports her parents in China are being harassed by secret police over her activism. This incident highlights concerns about X's content moderation, particularly for Chinese dissident voices, contrasting with its recent agreement with UK regulator Ofcom to review illegal content within 24 hours.

Key takeaway

For policy makers evaluating platform accountability, this incident underscores the critical need for robust, transparent content moderation systems. X's failure to act on deepfake abuse against a Chinese activist, despite clear rule violations, highlights gaps in protecting vulnerable users, especially dissidents. Your regulatory frameworks must mandate clear escalation paths and independent oversight to ensure platforms like X uphold their stated safety policies and protect human rights online.

Key insights

X's content moderation failed to protect a Chinese activist from deepfake abuse, raising concerns about platform accountability and protection for dissidents.

Principles

• Online platforms may fail to enforce their own content rules.
• Deepfake technology is weaponized for political harassment.
• Dissident activists face targeted, state-linked online abuse.

In practice

• Document all abusive posts and platform responses.
• Engage media when platform moderation fails.
• Report severe online abuse to local police.

Topics

• Deepfakes
• Content Moderation
• Online Harassment
• X Platform
• Chinese Dissidents
• Digital Rights

Best for: CTO, Executive, AI Product Manager, Policy Maker, AI Ethicist, Tech Journalist

Related on AIssential

• Liz Kendall says Elon Musk’s X must urgently deal with ‘appalling’ sexualised deepfake content produced by Grok AI - UK politics live — AI-generated deepfake content on social media platforms poses significant ethical and regulatory challenges.
• What Are the Politics of a Platform? What the Data Says About Content Moderation on X — Measuring "hate speech" impact requires distinguishing between content production and user impressions, with only platforms having full impression data.
• New IT Rules Target AI Deepfakes What Does It Mean? — New IT rules in India enable rapid content takedowns by officers, raising concerns about due process and deepfake detection capabilities.
• Meta’s deepfake moderation isn’t good enough, says Oversight Board — Meta's deepfake moderation is insufficient, requiring an overhaul of AI content labeling and detection.
• The Deepfake Nudes Crisis in Schools Is Much Worse Than You Thought — This content is a paywall for a digital publication, offering a free trial for premium access.
• A stacking of mechanisms that quietly convert speech into a permissioned activity—filtered by platform policy, priced by quasi-legal services, and chilled by corporate litigation strategies. — Converging private and automated systems are creating a permissioned speech environment, risking functional authoritarianism.

Open in AIssential →

Editorial summary, takeaway, and curation by AIssential. Original article published by AI (artificial intelligence) | The Guardian.