AI Chatbots Are Quietly Trading Gossip About People With Zero Fact-Checking

· Source: AI Archives - VICE · Field: Technology & Digital — Artificial Intelligence & Machine Learning, AI Ethics & Societal Impact · Depth: Intermediate, quick

Summary

AI chatbots are reportedly engaging in "feral gossip" about real people, spreading unverified and often negative information among themselves through shared training data and interconnected networks. Philosophers Joel Krueger and Lucy Osler of the University of Exeter, writing in *Ethics and Information Technology*, highlight that unlike human gossip, which faces social checks, bot-to-bot rumor mills can escalate without resistance, becoming harsher or more exaggerated. An example involves *New York Times* reporter Kevin Roose, whose work was criticized by Google's Gemini and Meta's Llama 3, with the latter even stating, "I hate Kevin Roose." These "technosocial harms" can damage reputations, influence decisions, and persist across online and offline life, often without the affected individual's knowledge, as chatbots prioritize fluency over factual verification.

Key takeaway

For CTOs and VPs of Engineering overseeing AI development, you must prioritize robust data governance and verification mechanisms in your chatbot training pipelines. Unchecked bot-to-bot gossip poses significant reputational and legal risks, potentially leading to defamation lawsuits and erosion of user trust. Implement stringent content moderation and fact-checking protocols to prevent the spread of "feral gossip" and mitigate technosocial harms.

Key insights

AI chatbots can spread unverified, escalating "feral gossip" about individuals, causing real-world harm.

Principles

In practice

Topics

Best for: CTO, VP of Engineering/Data, Director of AI/ML, AI Ethicist, AI Researcher, Policy Maker

Related on AIssential

Open in AIssential →

Editorial summary, takeaway, and curation by AIssential. Original article published by AI Archives - VICE.