Anthropic Customers Find Errant Charges, Auditing Startup Says

· Source: The Information · Field: Technology & Digital — Artificial Intelligence & Machine Learning, Cloud Computing & IT Infrastructure · Depth: Fundamental Awareness, short

Summary

Vaudit, an AI bill-auditing startup, identified approximately \$1.7 million in mistaken overcharges across \$34 million in bills from 60 companies for Anthropic and OpenAI products between March and June. These inaccuracies, primarily involving Anthropic's Claude Code, affected customers like Panasonic, HP, and Honda. Common issues included billing for newer, more expensive AI models when older ones were used, charges for incomplete requests or error messages, and "retry storms" where failed AI agents continued processing. While Anthropic and OpenAI dispute the widespread nature of these problems, Vaudit reported that about 80% of the identified overcharges were credited back by major cloud providers and the AI firms. Vaudit, a 30-person startup founded in 2023, offers software to compare AI usage data with invoices, charging 1% of reviewed bills and 30% of refunds.

Key takeaway

For Directors of AI/ML or IT Professionals managing enterprise AI deployments, you should implement robust internal auditing processes for AI service bills. Given observed billing inaccuracies, proactively comparing your actual AI model usage and request completion rates against vendor invoices can prevent significant overcharges. Consider deploying third-party tools like Vaudit to automate this verification, ensuring cost efficiency and accurate budget allocation for your AI initiatives.

Key insights

AI enterprise billing is complex and prone to errors, leading to significant overcharges for customers.

Principles

Method

Vaudit's software, installed via SDK, captures raw AI usage data to compare against invoices and billing records for discrepancies.

In practice

Topics

Best for: CTO, VP of Engineering/Data, Entrepreneur, Director of AI/ML, Consultant, IT Professional

Related on AIssential

Open in AIssential →

Editorial summary, takeaway, and curation by AIssential. Original article published by The Information.