Fake AI references in South African AI Policy: Two men named in report

2026-06-22 · Source: Welcome to the Artificial Intelligence Incident Database · Field: Government & Public Sector — Public Policy & Governance, Regulatory & Compliance · Depth: Fundamental Awareness, quick

Summary

Two seasoned Department of Communications officials in South Africa are reportedly under investigation for incorporating AI-hallucinated references into the draft South Africa National Artificial Intelligence (AI) Policy. Senior government sources have identified these individuals, who are now facing scrutiny for their role in developing critical national policy documents. This incident highlights significant concerns regarding the integrity and reliability of official government policy formulation processes, particularly when emerging technologies like AI are involved in research or drafting. The investigation underscores the potential for misuse of AI tools, leading to the inclusion of fabricated information in foundational policy frameworks, which could have far-reaching implications for the nation's AI strategy and its implementation.

Key takeaway

For government officials drafting national policies, you must implement stringent verification protocols for all research inputs, especially those sourced or assisted by AI tools. The incident in South Africa demonstrates that AI-hallucinated references can infiltrate critical documents, undermining policy integrity and public trust. Your teams should establish clear guidelines for AI tool usage and mandate human review of all citations to prevent the inclusion of fabricated information, safeguarding the credibility of official policy frameworks.

Key insights

AI-generated misinformation can compromise critical policy documents, necessitating rigorous human oversight.

Principles

• Verify all sources, especially AI-generated content.
• Maintain human accountability in policy drafting.
• AI tools require careful integration into official processes.

In practice

• Implement source verification protocols.
• Train staff on AI tool limitations.
• Audit policy drafts for fabricated data.

Topics

• AI Policy
• South Africa
• AI Hallucinations
• Government Officials
• Policy Integrity
• Source Verification

Best for: CTO, VP of Engineering/Data, Director of AI/ML, Policy Maker, Legal Professional, Tech Journalist

Related on AIssential

• South Africa withdraws AI policy due to fake AI-generated sources — Unverified AI-generated sources can compromise policy integrity, leading to official document withdrawals.
• Officials suspended over fake AI sources in government policy — Government officials were suspended for using AI-generated fake sources in policy, revealing critical risks in AI integration.
• Concerns ‘AI slop’ used by University of Sydney-based institute to lobby for $20m gambling education funding — A research institute's funding request was undermined by an evidence review containing significant inaccuracies, potentially due to AI-generated content.
• Scientists Asked AI to Impersonate 112 Public Figures. What Happened Next Is a ‘Dire’ Warning — AI-generated impersonations of public figures are perceived as more authentic and coherent than real human responses, posing a "dire" deception risk.
• KPMG pulls report on AI usage due to apparent hallucinations — AI-generated content requires rigorous human oversight to prevent factual inaccuracies and reputational damage.
• Ai Misinformation Report — AI-driven misinformation poses society's biggest risk, blurring truth and empowering authoritarian regimes, necessitating urgent mitigation strategies.

See Counsel's argued verdicts on the open AI decisions leaders are weighing →

Open in AIssential →

Editorial summary, takeaway, and curation by AIssential. Original article published by Welcome to the Artificial Intelligence Incident Database.