KPMG Allegedly Published AI Report Filled With Hallucinations
Summary
KPMG, a major consulting firm, is accused of publishing a now-deleted AI report containing 40 out of 45 allegedly hallucinated citations. This report was subsequently referenced by OpenAI's ChatGPT, Google Gemini, a major Czech newspaper, and several trade publications. Specific examples include false claims about Japan's JR East using agentic AI, linking to a 2019 press release, and Austria's Verbund employing AI agents for real-time household analytics, despite no supporting evidence. AI safety firm GPTZero suggests an LLM research tool conflated sources and exaggerated claims, implying a lack of human verification. KPMG has removed the report and stated it is reviewing the circumstances, reiterating its guidelines on responsible AI use and human oversight. This incident mirrors a previous case where Deloitte refunded part of an AU\$440,000 report due to AI hallucinations.
Key takeaway
For Directors of AI/ML or consultants developing client-facing reports, you must implement stringent human oversight and verification protocols for all AI-generated content. Unverified AI outputs, especially citations, risk severe reputational damage and the propagation of misinformation through your work and downstream systems. Ensure your teams are trained to independently validate every claim and source, preventing "workslop" from undermining your credibility and client trust.
Key insights
Unverified AI-generated content, particularly citations, can lead to widespread misinformation and reputational damage.
Principles
- Human oversight is essential for validating AI-generated content.
- AI research tools can conflate sources and exaggerate claims.
- Unverified AI output can propagate through other LLMs and publications.
In practice
- Establish robust human review processes for AI-assisted reports.
- Independently verify all citations and factual claims from AI tools.
- Train teams on responsible AI use and content validation.
Topics
- AI Hallucinations
- Responsible AI
- Content Verification
- Consulting Ethics
- Large Language Models
- Misinformation
Best for: CTO, VP of Engineering/Data, AI Product Manager, Consultant, Director of AI/ML, AI Ethicist
Related on AIssential
See Counsel's argued verdicts on the open AI decisions leaders are weighing →
Editorial summary, takeaway, and curation by AIssential. Original article published by Welcome to the Artificial Intelligence Incident Database.