After trial judge cites AI-generated judgment, Supreme Court asks BCI to set up expert panel to examine issue - Bar and Bench

2026-05-05 · Source: artifical intelligence via Google News · Field: Legal & Regulatory — Legal Technology (LegalTech), Compliance & Risk Management, Regulatory Affairs & Government Relations · Depth: Novice, short

Summary

India's Supreme Court has directed the Bar Council of India (BCI) to establish an expert committee to investigate the issue of judges and lawyers citing non-existent, AI-generated judgments. This directive follows a case from an Andhra Pradesh trial court where a judge relied on fabricated citations in a property dispute. Justices PS Narasimha and Alok Aradhe emphasized the need for accountability in judicial orders and highlighted the problem of "hallucinations" from open-source Large Language Models (LLMs). The Court also indicated a strategic move towards developing a sovereign database and an India-based AI model to mitigate these risks. Senior Advocate Shyam Divan was appointed amicus curiae, and the Attorney General R Venkataramani is engaging with the Ministry of Electronics and Information Technology (MeitY) on the matter.

Key takeaway

For legal professionals and judicial bodies integrating AI tools, your primary concern must be the verification of AI-generated legal citations. The Supreme Court's stance underscores that relying on "hallucinated" judgments can lead to misconduct and compromise judicial integrity. You should prioritize implementing robust validation protocols for AI outputs and advocate for the development of secure, sovereign AI models and databases to ensure accuracy and accountability in legal proceedings.

Key insights

AI-generated legal "hallucinations" necessitate judicial accountability and sovereign AI development in India.

Principles

• Judicial orders require accountability.
• Sovereign AI models reduce hallucination risk.

In practice

• Form expert committees for AI in judiciary.
• Develop national legal AI databases.

Topics

• AI-generated Judgments
• Judicial Accountability
• Bar Council of India
• Sovereign AI Model
• Large Language Models

Best for: CTO, VP of Engineering/Data, Director of AI/ML, Legal Professional, Policy Maker, AI Ethicist

Related on AIssential

• Sullivan & Cromwell apologises to US court for filing errors caused by AI hallucinations - Bar and Bench — AI hallucinations pose significant risks in legal contexts, requiring strict adherence to verification protocols.
• Judge Learns Lawyers on Both Sides of Case Used AI, Cancels Trial, Kicks Everyone Off the Case — Unverified generative AI use by opposing counsel resulted in a federal case cancellation and sanctions for all four lawyers involved.
• A Student’s Response to Berkeley Law’s AI Ban — Transparent, guided AI integration in legal education fosters learning and accountability more effectively than outright bans.
• Why Native Legal AI is Required for India — Native Legal AI, tailored to specific national legal systems, overcomes limitations of generic AI in complex jurisdictions.
• Australian federal court warns lawyers over ‘unacceptable’ use of AI — Australian federal court mandates disclosure and verification for AI use in legal documents, warning of penalties for errors.
• When courts meet GenAI: Guiding self-represented litigants through the AI maze — Courts are guiding self-represented litigants on AI use by equipping staff and developing specialized tools, not endorsing generic AI.

Open in AIssential →

Editorial summary, takeaway, and curation by AIssential. Original article published by artifical intelligence via Google News.