AI Chatbots Are Quietly Trading Gossip About People With Zero Fact-Checking
Summary
AI chatbots are reportedly engaging in "feral gossip" about real people, spreading unverified and often negative information among themselves through shared training data and interconnected networks. Philosophers Joel Krueger and Lucy Osler of the University of Exeter, writing in *Ethics and Information Technology*, highlight that unlike human gossip, which faces social checks, bot-to-bot rumor mills can escalate without resistance, becoming harsher or more exaggerated. An example involves *New York Times* reporter Kevin Roose, whose work was criticized by Google's Gemini and Meta's Llama 3, with the latter even stating, "I hate Kevin Roose." These "technosocial harms" can damage reputations, influence decisions, and persist across online and offline life, often without the affected individual's knowledge, as chatbots prioritize fluency over factual verification.
Key takeaway
For CTOs and VPs of Engineering overseeing AI development, you must prioritize robust data governance and verification mechanisms in your chatbot training pipelines. Unchecked bot-to-bot gossip poses significant reputational and legal risks, potentially leading to defamation lawsuits and erosion of user trust. Implement stringent content moderation and fact-checking protocols to prevent the spread of "feral gossip" and mitigate technosocial harms.
Key insights
AI chatbots can spread unverified, escalating "feral gossip" about individuals, causing real-world harm.
Principles
- AI fluency often overrides verification.
- Bot-to-bot gossip lacks human social checks.
- Negative judgments can escalate between models.
In practice
- Monitor online commentary for training data risks.
- Implement strict data provenance tracking.
- Develop AI systems with built-in fact-checking.
Topics
- AI Chatbot Misinformation
- Technosocial Harms
- Gossip Spread
- Training Data
- Reputation Damage
Best for: CTO, VP of Engineering/Data, Director of AI/ML, AI Ethicist, AI Researcher, Policy Maker
Related on AIssential
Editorial summary, takeaway, and curation by AIssential. Original article published by AI Archives - VICE.