Concerns ‘AI slop’ used by University of Sydney-based institute to lobby for $20m gambling education funding
Summary
ACT Senator David Pocock has expressed "deep concern" over an "Evidence Review" submitted by the University of Sydney-based OurFutures Institute, which sought $20 million in federal funding for a gambling prevention education program targeting 15- to 20-year-olds. The review, intended to support the institute's budget submission, reportedly contains numerous inaccuracies, including references to non-existent studies, broken links, and claims unsupported by cited papers. For instance, a statement attributing an $8-10 return on investment for every $1 in school-based prevention to a Productivity Commission inquiry was found to be false, as the commission actually expressed reservations about such programs. The OurFutures Institute's director attributed these errors to an "editing tool" and pledged to issue corrected versions, while Senator Pocock described the report as "AI slop" and called for a ban on gambling advertisements.
Key takeaway
For directors of AI/ML or research integrity officers, this incident highlights the critical need for rigorous human oversight in content generation, even when using "editing tools." Your teams must implement stringent verification protocols for all external-facing documents, particularly those supporting funding requests or policy recommendations. Relying solely on automated tools without thorough fact-checking can lead to significant reputational damage and undermine credibility, especially when specific data points or citations are involved.
Key insights
A research institute's funding request was undermined by an evidence review containing significant inaccuracies, potentially due to AI-generated content.
Principles
- Evidence-based policy requires verifiable, accurate citations.
- Transparency in funding sources is crucial for research credibility.
In practice
- Verify all references in policy documents, especially those generated by AI tools.
- Disclose potential conflicts of interest, such as industry funding, in research submissions.
Topics
- AI Hallucinations
- Research Integrity
- Gambling Prevention
- Policy Advocacy
- Academic Ethics
Best for: CTO, VP of Engineering/Data, Director of AI/ML, Policy Maker, AI Ethicist, Tech Journalist
Related on AIssential
Editorial summary, takeaway, and curation by AIssential. Original article published by AI (artificial intelligence) | The Guardian.