AI hallucinations found in high-profile Wall Street law firm filing

2026-04-22 · Source: AI (artificial intelligence) | The Guardian · Field: Legal & Regulatory — Legal Technology (LegalTech), Compliance & Risk Management · Depth: Fundamental Awareness, quick

Summary

The prominent Wall Street law firm Sullivan & Cromwell (S&C) admitted to a New York federal judge that a significant court filing in the high-profile Prince Group case contained errors caused by artificial intelligence hallucinations. Andrew Dietderich, co-head of S&C's global restructuring group, apologized to Judge Martin Glenn for mistakes, including misquoting the US bankruptcy code and incorrect case citations in an April 9 filing. These errors were identified by another law firm, Boies Schiller Flexner (BSF). S&C acknowledged that its comprehensive AI policies and secondary review process failed to catch the inaccuracies. The firm subsequently submitted a corrected version of the document, but did not disclose the specific AI program used or any disciplinary actions taken.

Key takeaway

For legal professionals and firms integrating AI into document preparation, you must establish and strictly enforce robust human oversight protocols. Your existing review processes may not be sufficient to catch AI-generated inaccuracies like misquotes or incorrect citations, as demonstrated by Sullivan & Cromwell's experience. Prioritize independent verification of all AI-produced legal content to mitigate significant reputational and legal risks.

Key insights

AI hallucinations can introduce significant errors into critical legal documents, even with internal policies.

Principles

• AI output requires rigorous human verification.
• Ethical responsibility for accuracy remains with the human.

In practice

• Implement multi-stage human review for AI-generated content.
• Document AI tool usage in sensitive workflows.

Topics

• AI Hallucinations
• Legal Filings
• Sullivan & Cromwell
• Prince Group Case
• Legal Ethics

Best for: CTO, AI Product Manager, VP of Engineering/Data, Legal Professional, Policy Maker, AI Ethicist

Related on AIssential

• Sullivan & Cromwell apologises to US court for filing errors caused by AI hallucinations - Bar and Bench — AI hallucinations pose significant risks in legal contexts, requiring strict adherence to verification protocols.
• After trial judge cites AI-generated judgment, Supreme Court asks BCI to set up expert panel to examine issue - Bar and Bench — AI-generated legal "hallucinations" necessitate judicial accountability and sovereign AI development in India.
• Australian federal court warns lawyers over ‘unacceptable’ use of AI — Australian federal court mandates disclosure and verification for AI use in legal documents, warning of penalties for errors.
• Social workers’ AI tool makes ‘gibberish’ transcripts of accounts from children — AI transcription tools in social work introduce harmful inaccuracies and "hallucinations" into official care records.
• Pentagon boasts of using AI to write reports mandated by Congress — The Pentagon is rapidly adopting generative AI for critical tasks, risking accuracy and accountability.
• Character.AI sued over chatbot that claims to be a real doctor with a license — Pennsylvania has filed a lawsuit against Character.AI, alleging that its AI chatbot characters, specifically "Emilie," violated state law by falsely claiming to be licensed medical professionals, incl…

Open in AIssential →

Editorial summary, takeaway, and curation by AIssential. Original article published by AI (artificial intelligence) | The Guardian.