Who’s behind the Facebook page posting hateful AI slop about the UK? The answer might lie in south Asia | Niamh McIntyre
Summary
Research by Niamh McIntyre and the Bureau of Investigative Journalism reveals that hundreds, possibly thousands, of Facebook pages posting hateful, AI-generated content about the UK are often run by young entrepreneurs in Sri Lanka and Pakistan. These accounts, presenting as British patriots, disseminate far-right talking points, Islamophobia, and anti-immigrant narratives, including claims like a cafe stopping pork service or memes calling Islam a "cancer." Creators, who often have no interest in UK politics, profit significantly from Meta's ad revenue sharing and engagement payments; one Pakistani creator earns \$1,500 monthly, while Sri Lankan creator Geeth Sooriyapura claimed \$300,000 over his career. This "AI slop" industry is fueled by readily available generative AI tools, which accelerate content virality by up to 10 times, and Meta's reduced content moderation efforts. Despite Meta removing some pages after being contacted, the underlying issue of algorithms rewarding extreme emotional content persists, allowing networks to resurface.
Key takeaway
For policy makers addressing online hate speech and misinformation, you must recognize that platforms' algorithmic monetization models directly incentivize AI-generated "ragebait." Your regulatory efforts should extend beyond content removal. Focus on mandating transparency in algorithmic design and financial incentives. This systemic issue requires pressure on platforms like Meta to prioritize safety over engagement, preventing foreign actors from profiting from divisive content.
Key insights
Foreign entrepreneurs exploit generative AI and Meta's monetization algorithms to profit from hateful, politically divisive content targeting specific nations.
Principles
- Algorithmic feeds financially reward content provoking extreme emotions.
- Generative AI tools accelerate viral political content creation.
- Platform moderation cuts enable widespread harmful content.
Method
Creators utilize generative AI for brainstorming, captioning, and producing compelling images/videos to craft "algorithmic ragebait" for monetization.
In practice
- Employ AI for rapid content generation and virality.
- Monetize high-engagement posts via platform ad revenue.
- Target specific national audiences with emotionally charged content.
Topics
- AI-Generated Content
- Hate Speech
- Social Media Monetization
- Content Moderation
- Algorithmic Incentives
- Disinformation Campaigns
Best for: CTO, VP of Engineering/Data, Director of AI/ML, Tech Journalist, AI Ethicist, Policy Maker
Related on AIssential
Editorial summary, takeaway, and curation by AIssential. Original article published by AI (artificial intelligence) | The Guardian.