Sullivan & Cromwell apologises to US court for filing errors caused by AI hallucinations - Bar and Bench
Summary
Sullivan & Cromwell LLP has apologized to Chief Judge Martin Glenn of the US Bankruptcy Court for the Southern District of New York after an emergency motion filed in the *In re Prince Global Holdings Limited* insolvency proceedings contained inaccurate citations and other errors. The law firm admitted that some of these inaccuracies stemmed from AI "hallucinations," where generative AI tools fabricated case law or misquoted authorities. The firm acknowledged that its internal policies for AI tool usage were not followed during the motion's preparation, and its standard review process failed to detect the errors before filing. Partner Andrew G Dietderich took responsibility, and the firm has since filed a revised motion with corrections and informed opposing counsel.
Key takeaway
For legal teams integrating AI into their workflows, this incident underscores the critical need for robust verification protocols. Your firm's internal policies, however rigorous, are only effective if consistently adhered to by all practitioners. Implement a multi-stage review process that specifically targets AI-generated content for factual accuracy and source validation to mitigate the risks of AI hallucinations in court filings.
Key insights
AI hallucinations pose significant risks in legal contexts, requiring strict adherence to verification protocols.
Principles
- AI output requires independent verification.
- Internal policies must be enforced rigorously.
Method
Mandatory training and independent verification of all AI-generated output are critical safeguards before use in legal work.
In practice
- Implement mandatory AI training for all users.
- Require independent verification of AI output.
Topics
- AI Hallucinations
- Legal Filings
- Law Firm Policies
- Generative AI
- Citation Errors
Best for: CTO, VP of Engineering/Data, Executive, Legal Professional, Director of AI/ML, Tech Journalist
Related on AIssential
Editorial summary, takeaway, and curation by AIssential. Original article published by artifical intelligence via Google News.