KPMG Allegedly Published AI Report Filled With Hallucinations

· Source: Welcome to the Artificial Intelligence Incident Database · Field: Business & Management — Consulting & Professional Services, Corporate Strategy & Leadership · Depth: Fundamental Awareness, quick

Summary

KPMG, a major consulting firm, is accused of publishing a now-deleted AI report containing 40 out of 45 allegedly hallucinated citations. This report was subsequently referenced by OpenAI's ChatGPT, Google Gemini, a major Czech newspaper, and several trade publications. Specific examples include false claims about Japan's JR East using agentic AI, linking to a 2019 press release, and Austria's Verbund employing AI agents for real-time household analytics, despite no supporting evidence. AI safety firm GPTZero suggests an LLM research tool conflated sources and exaggerated claims, implying a lack of human verification. KPMG has removed the report and stated it is reviewing the circumstances, reiterating its guidelines on responsible AI use and human oversight. This incident mirrors a previous case where Deloitte refunded part of an AU\$440,000 report due to AI hallucinations.

Key takeaway

For Directors of AI/ML or consultants developing client-facing reports, you must implement stringent human oversight and verification protocols for all AI-generated content. Unverified AI outputs, especially citations, risk severe reputational damage and the propagation of misinformation through your work and downstream systems. Ensure your teams are trained to independently validate every claim and source, preventing "workslop" from undermining your credibility and client trust.

Key insights

Unverified AI-generated content, particularly citations, can lead to widespread misinformation and reputational damage.

Principles

In practice

Topics

Best for: CTO, VP of Engineering/Data, AI Product Manager, Consultant, Director of AI/ML, AI Ethicist

Related on AIssential

Open in AIssential →

Editorial summary, takeaway, and curation by AIssential. Original article published by Welcome to the Artificial Intelligence Incident Database.