South Africa yanks AI policy after AI-assisted drafting invents citations

2026-04-27 · Source: The Register: Enterprise Technology News and Analysis · Field: Government & Public Sector — Public Policy & Governance, Regulatory & Compliance, Artificial Intelligence & Machine Learning · Depth: Fundamental Awareness, quick

Summary

South Africa has withdrawn its draft national AI policy after discovering it contained "various fictitious sources" in its reference list, which appear to be AI-generated hallucinations. The Department of Communications and Digital Technologies confirmed the issue after reports flagged fake citations, prompting Minister Solly Malatsi to pull the document. This lapse, which compromised the policy's integrity, has led to "consequence management" for those involved in drafting and sign-off. Experts noted that at least six fabricated references matched classic AI hallucination patterns. The incident highlights the critical need for vigilant human oversight when using AI in policy development, echoing a similar past issue where Deloitte had to correct an Australian government report due to AI-generated citations.

Key takeaway

For government agencies or organizations drafting critical policy documents, you must implement stringent human oversight and fact-checking protocols when utilizing AI tools. Relying solely on AI for content generation, particularly citations, risks compromising the document's integrity and credibility, potentially leading to public embarrassment and policy withdrawal. Ensure every reference is manually verified to prevent AI hallucinations from undermining your work.

Key insights

AI-generated content, especially citations, requires rigorous human verification to maintain integrity.

Principles

• Vigilant human oversight is critical for AI-assisted drafting.
• AI hallucinations can produce convincing but fabricated information.

In practice

• Implement strict fact-checking protocols for AI-generated text.
• Avoid using AI for critical reference generation without verification.

Topics

• South Africa AI Policy
• AI Hallucinations
• Policy Drafting
• Human Oversight
• Fictitious Citations

Best for: CTO, VP of Engineering/Data, Executive, Policy Maker, AI Ethicist, Director of AI/ML

Related on AIssential

• Hallucinated citations are polluting the scientific literature. What can be done? — AI-generated hallucinated citations are rapidly increasing, polluting academic literature with fabricated and inaccurate references.
• bh-AI: So today’s lesson is a little technical so kindly bear with me… Continue reading on Medium » — AI models, while helpful, require human oversight and critical thinking to mitigate hallucinated outputs and ensure effective use.
• Stop Fact-Checking Every AI Report. Check These 4 Things Instead — The Singleton scan is a human-led method to detect AI hallucinations that automated checkers miss.
• i tested basically every AI tool i could find for med school research. most are useless unless you already know enough to catch them lying. — AI tools for professional research require extensive manual verification due to persistent accuracy and citation issues.
• Imbad0202 / academic-research-skills — ARS augments human researchers with AI tools to enhance academic writing quality and integrity, avoiding common AI pitfalls.
• The Internet Was Always Bad at Writing. Now It's Just More Obvious. — AI amplifies existing writing quality issues, making human voice, judgment, and responsibility more critical than ever.

Open in AIssential →

Editorial summary, takeaway, and curation by AIssential. Original article published by The Register: Enterprise Technology News and Analysis.