[D] ICML paper to review is fully AI generated

2026-03-11 · Source: Machine Learning · Field: Technology & Digital — Artificial Intelligence & Machine Learning, Research Methodology & Innovation · Depth: Intermediate, medium

Summary

An ICML reviewer encountered a submitted paper that appeared to be entirely AI-generated, despite conference policies prohibiting LLM assistance for writing or reviewing. The paper was described as an "incoherent mess" and a "hype-train type of thread," leading to a strong rejection with high confidence. The incident sparked discussion among reviewers regarding policy enforcement, the difficulty of proving AI authorship, and the importance of verifiable research artifacts like working code and pretrained models. While some argued that AI-assisted writing should be grounds for rejection if it violates submission policy or results in poor quality, others noted that current policies often focus on review assistance rather than paper authorship, and that the core technical content should still be assessed.

Key takeaway

For AI Researchers submitting to conferences with strict authorship policies, ensure your work adheres to all guidelines, especially regarding AI assistance in writing. If your paper lacks verifiable code or models, or reads like unedited AI output, it risks immediate rejection. Focus on robust research and clear, human-edited communication to avoid policy violations and ensure your technical contributions are properly evaluated.

Key insights

AI-generated research papers challenge conference policies and reviewer assessment of technical merit and authorship.

Principles

• Reviewer effort should match author effort.
• Verifiable code and models are crucial for ML/AI papers.

Method

Reviewers should report suspected policy violations to the Area Chair, provide a concise review highlighting weaknesses, and assign a low score, prioritizing verifiable technical content over writing style.

In practice

• Prioritize papers with easily runnable code.
• Flag papers lacking verifiable artifacts.
• Assess technical content even if writing seems AI-generated.

Topics

• AI-Generated Content
• Academic Peer Review
• LLM Writing Policies
• Research Reproducibility
• Submission Quality

Best for: AI Researcher, AI Scientist, Research Scientist

Related on AIssential

• The AI Scientist: Towards Fully Automated AI Research, Now Published in Nature — AI agents can now autonomously conduct machine learning research, generate papers, and pass human peer review.
• [D] Has anyone received their ICML papers to review yet? — ICML 2026 is using hidden prompt injections to detect LLM-assisted paper reviews, raising ethical concerns.
• [D] First time reviewer. I got assigned 9 papers. I'm so nervous. What if I mess up. Any advice? — First-time academic reviewers should manage workload proactively and adhere strictly to AI usage policies.
• Can AI Review Improve Paper Drafting? An Empirical Study on 20 Computer Architecture Submissions — AI review can significantly align with human feedback and identify novel issues in paper drafting.
• A key science publishing platform is cracking down on AI slop — arXiv's ban on AI-error papers highlights the challenge of maintaining research quality amidst rising AI-generated content.
• Please follow the rules for ARR/ACL papers — Adherence to publication guidelines is crucial for research quality and reviewer efficiency.

Open in AIssential →

Editorial summary, takeaway, and curation by AIssential. Original article published by Machine Learning.