AI and Liability

2026-06-25 · Source: Schneier on Security · Field: Legal & Regulatory — Compliance & Risk Management, Regulatory Affairs & Government Relations · Depth: Intermediate, medium

Summary

A recent German court ruling held Google liable for its AI search summaries, rejecting defenses that users should verify information themselves. This decision re-ignites a long-standing debate about internet companies' roles as "carriers" versus "publishers," a distinction blurred by Section 230 of the 1996 Communication Decency Act. The article argues that AI overviews, which rewrite content rather than merely relaying it, function as publishers and should incur liability for inaccuracies. This stance is reinforced by Air Canada's prior court loss, where it was held responsible for its chatbot's false promises. With Google's AI Overviews showing a ~10% error rate, potentially generating 16,000 erroneous summaries per second from 5 trillion annual searches, and facing lawsuits like the one from Ashley MacIsaac, the author emphasizes that assigning liability is essential for public trust and corporate accountability in the rapidly evolving AI landscape.

Key takeaway

For Directors of AI/ML deploying customer-facing AI, understand that your organization is directly liable for AI agent outputs, as demonstrated by recent court rulings. This necessitates rigorous accuracy testing and robust content governance for all AI-generated information. You must prioritize building trustworthy systems, as legal precedents like the German Google ruling and Air Canada case confirm that "faulty AI" is not a valid defense for misrepresentation or harm.

Key insights

Companies are liable for their AI agents' actions, mirroring accountability for human employees, to ensure trust and accuracy.

Principles

• AI agents are extensions of the deploying entity.
• Liability drives accuracy and accountability.
• Editorial discretion implies publisher-like responsibility.

In practice

• Evaluate AI system error rates rigorously.
• Implement robust content verification for AI outputs.
• Understand legal precedents for AI agent actions.

Topics

• AI Liability
• Google AI Overviews
• Section 230 Reform
• Corporate Accountability
• AI Chatbot Misinformation
• Digital Publishing Law

Best for: CTO, VP of Engineering/Data, Executive, Legal Professional, Director of AI/ML, AI Product Manager

Related on AIssential

• AI and Liability — Organizations deploying AI should be held liable for its outputs, treating AI agents legally as human agents to ensure accountability.
• A Court Has Ruled That Google Is Liable for False Statements Generated by AI Overviews — A German court ruled Google liable for false statements from its AI Overviews, setting a precedent for AI accountability.
• The conceptualization of artificial intelligence as a neutral tool is increasingly untenable in light of its emergent properties and autonomous behavior. — Agentic AI's autonomous behavior necessitates strict liability and robust regulation to prevent severe psychological, physical, and professional harms.
• Maybe Section 230 doesn’t shield AI companies from liability, after all — Chatbot outputs may not be protected by Section 230, as a German court ruled they constitute the company's "own words," not third-party speech.
• Breaking: Google liable for hallucinations — A German court holds Google liable for AI Overviews' false outputs.
• Is Your AI Unfair? Why Responsible AI is the New Non-Negotiable in Customer Experience — Biased AI, reflecting its training data, can lead to discriminatory outcomes and significant business liabilities in customer experience.

Open in AIssential →

Editorial summary, takeaway, and curation by AIssential. Original article published by Schneier on Security.