The fake disease that fooled the internet — and what it says about all of us

2026-04-20 · Source: Artificial intelligence (AI) – The Conversation · Field: Science & Research — Social Sciences & Behavioral Studies, Research Methodology & Innovation · Depth: Fundamental Awareness, medium

Summary

A recent Cambridge Festival event, inspired by the TV show "The Traitors," explored human susceptibility to deception, particularly in the context of scientific information and AI. Four panelists presented work, with two being "faithful" researchers and two being "traitors" (an actor posing as a climate researcher and a genuine researcher who falsified results). The audience was tasked with identifying the deceivers, but their decisions were influenced by superficial signals like accent, gender, ethnicity, and presentation style, leading them to incorrectly rate the traitors as more credible. This experiment highlighted how factors such as impressive-sounding data, lack of personal contribution to research, and even an academic field's "cool" name can undermine perceived credibility, while personal connection to a topic can enhance it, even for falsified work. The event underscored the ease with which fictional claims, like the fabricated "bixonimania" disease, can gain legitimacy, especially when amplified by large language models.

Key takeaway

For professionals evaluating information, especially in technical or scientific fields, you must actively cultivate critical thinking skills beyond purely quantitative analysis. Do not solely rely on presentation style, perceived personal connection, or even AI-generated content as indicators of truth. Instead, rigorously verify claims, scrutinize data for plausibility, and recognize your own biases to avoid being manipulated by increasingly sophisticated misinformation, whether from human or AI sources.

Key insights

Human biases and reliance on superficial cues often lead to misjudging credibility, even with AI amplification of falsehoods.

Principles

• Superficial signals influence credibility judgments.
• Outsourcing learning increases vulnerability to deception.
• Critical thinking is essential for discerning truth.

Method

A "Traitors"-themed science event used four presenters (two honest, two deceptive) to explore how audience members identify lies based on content and presentation, including factors like accent, gender, ethnicity, and dress.

In practice

• Be wary of "too good to be true" data.
• Question claims amplified by AI models.
• Prioritize critical thinking over surface appeal.

Topics

• Bixonimania
• Large Language Models
• Misinformation
• Critical Thinking
• Credibility Assessment

Best for: AI Ethicist, Policy Maker, General Interest

Related on AIssential

• Motivated reasoning, confirmation bias, and AI risk theory — Confirmation bias, driven by motivated reasoning, significantly distorts beliefs in complex fields like AI risk by compounding across cognitive stages.
• We Asked the ‘Future of Truth’ Author to Explain How He Used AI. It Didn’t Go Well — The irony of a book on AI and truth containing AI-generated falsehoods highlights critical authorial responsibility.
• CRED-1: Building an Open Domain Credibility Dataset for Misinformation Pre-Bunking — Multi-signal credibility scoring offers a nuanced, dynamic, and transparent alternative to binary domain labeling for misinformation pre-bunking.
• Scientists invented a fake disease. AI told people it was real — AI models can propagate misinformation, even when explicitly labeled as fake, highlighting data validation challenges.
• The Impossibility of Eliciting Latent Knowledge — The paper proves it's impossible to guarantee AI honesty about latent knowledge using only feedback on agent behavior.
• False claims in a widely-cited paper. No corrections. No consequences. Welcome to the Business School. — Institutional failures enable influential, flawed research to persist uncorrected, undermining scientific integrity.

Open in AIssential →

Editorial summary, takeaway, and curation by AIssential. Original article published by Artificial intelligence (AI) – The Conversation.