Citation errors and hallucinated case turn up in Boies Schiller brief in 'artificial-intelligence debacle'
Summary
On September 24, 2025, Boies Schiller Flexner partner John Kucera sought to file a corrected legal brief after acknowledging "material citation errors" and a "completely made up" case, attributing these issues to artificial intelligence use. This incident, involving a Vault 100 and Am Law 200 firm, is being labeled "BigLaw's biggest artificial-intelligence debacle to date" by David Lat of Original Jurisdiction. The firm represents plaintiffs in a lawsuit against the Church of Scientology and actor Danny Masterson. The Church of Scientology's lawyers identified the errors, noting mischaracterized holdings, mistitled cases, and a fabricated citation. Kucera, who oversaw the AI process, took personal responsibility for failing to proofread. Boies Schiller Flexner has since "adopted policies and implemented trainings" to prevent improper AI use, emphasizing scrupulous proofreading and cite checking. Other firms like Butler Snow, K&L Gates, and Latham & Watkins have also experienced AI-related errors.
Key takeaway
For legal professionals integrating AI into brief preparation, this incident underscores the critical need for robust human oversight. You must implement strict verification protocols, including mandatory manual proofreading and cite checking, for all AI-generated content. Relying solely on AI without diligent human review risks severe reputational damage and legal repercussions, as demonstrated by this "debacle." Ensure your firm's policies and training explicitly address AI's hallucination risks.
Key insights
AI tools can introduce significant errors, including "hallucinations," requiring rigorous human oversight.
Principles
- AI-generated content needs scrupulous human verification.
- Legal professionals bear ultimate responsibility for brief accuracy.
- AI use in legal work carries reputational risks.
Method
Boies Schiller "adopted policies and implemented trainings intended to protect against the risks of the improper use of artificial intelligence." Lawyers are expected "to scrupulously proofread and cite check" briefs.
In practice
- Implement mandatory AI use policies.
- Conduct thorough human proofreading of AI outputs.
- Train staff on AI limitations and verification.
Topics
- Legal AI
- AI Hallucinations
- Citation Errors
- Professional Responsibility
- Law Firm Risk Management
- Boies Schiller Flexner
Best for: CTO, VP of Engineering/Data, Executive, Legal Professional, Tech Journalist, Director of AI/ML
Related on AIssential
See Counsel's argued verdicts on the open AI decisions leaders are weighing →
Editorial summary, takeaway, and curation by AIssential. Original article published by Welcome to the Artificial Intelligence Incident Database.