KPMG drops AI report after false case studies exposed
Summary
KPMG has withdrawn its global AI report, "Redefining excellence in the age of agentic AI," published in October, after multiple case studies were found to be inaccurate and likely generated by AI hallucinations. The Financial Times reported that the document contained false claims regarding AI use at UBS, NHS Greater Manchester, Swiss Federal Railways, and Transport for London (TfL). For instance, KPMG falsely asserted NHS Greater Manchester uses AI agents for readmissions and triage. Research group GPTZero initially flagged these passages as hallucinations, a finding later verified by the FT. This incident follows a similar event last month where EY also retracted a report due to fabricated data and bogus references attributed to AI.
Key takeaway
For consultants or analysts producing AI-related reports, this incident underscores the critical need for stringent fact-checking. You must implement robust verification processes for any content generated or assisted by AI, especially case studies or specific claims about organizational operations. Relying solely on AI outputs without human oversight risks publishing inaccurate information, damaging your firm's reputation, and misleading clients. Ensure all data and references are independently validated before publication.
Key insights
AI hallucinations pose a significant risk to the factual integrity of professional reports.
Principles
- AI-generated content requires rigorous human verification.
- Unverified AI outputs can damage corporate credibility.
In practice
- Implement AI content detection tools.
- Mandate human fact-checking for all AI-assisted reports.
Topics
- AI Hallucinations
- KPMG
- Corporate Reporting
- Fact-Checking
- AI Ethics
- Generative AI
Best for: CTO, VP of Engineering/Data, Director of AI/ML, Tech Journalist, AI Ethicist, Consultant
Related on AIssential
See Counsel's argued verdicts on the open AI decisions leaders are weighing →
Editorial summary, takeaway, and curation by AIssential. Original article published by Welcome to the Artificial Intelligence Incident Database.