Office workers are spending way too much on AI too

2026-06-25 · Source: Pivot to AI · Field: Business & Management — Corporate Strategy & Leadership, Entrepreneurship & Start-ups, Consulting & Professional Services · Depth: Fundamental Awareness, medium

Summary

AI vendors like Microsoft, Anthropic, and OpenAI are transitioning customers from monthly subscriptions to token-based billing, which obscures actual costs. This shift has led to exorbitant expenses, with one client reportedly spending \$500 million in a month on Claude Code, likely Amazon or Uber. GitHub Copilot users have seen bills multiply by 100. The issue extends beyond developers to general office workers, as evidenced by Walmart rationing its internal AI tool, "Code Puppy," in early June after previously unlimited use. Accenture's February mandate for staff to use chatbots for promotions resulted in significant token consumption by non-engineers, with tasks like converting PDFs to markdown identified as major cost drivers. This customer backlash is prompting OpenAI's Sam Altman to consider price cuts, despite the company's need for strong revenue for its planned IPO. The article concludes that AI often lacks critical business value, leading to unsustainable costs.

Key takeaway

For Directors of AI/ML evaluating enterprise AI adoption, you must scrutinize token-based billing models and demand clear ROI metrics from vendors. Your teams should implement strict monitoring of AI tool usage, especially among non-engineers, to prevent uncontrolled "token chewing" on low-value tasks like PDF conversions. Recognize that current AI solutions may not deliver critical business value, impacting your budget and vendor relationships. Prioritize solutions with demonstrable, cost-effective utility to avoid unsustainable expenses and potential backlash.

Key insights

AI costs are spiraling due to obscure token-based billing and questionable business value, leading to vendor dilemmas and customer backlash.

Principles

• Token-based billing obscures true AI operational costs.
• Mandating AI use without clear value drives wasteful consumption.
• AI's current business value often doesn't justify its expense.

In practice

• Monitor token consumption for non-engineering teams.
• Evaluate AI tool ROI beyond initial "hook" promises.
• Identify "token chewers" like PDF-to-markdown conversions.

Topics

• AI Cost Management
• Token-based Billing
• Enterprise AI Adoption
• OpenAI Business Model
• AI Return on Investment
• Corporate AI Strategy

Best for: CTO, VP of Engineering/Data, AI Product Manager, Director of AI/ML, Executive, Investor

Related on AIssential

• The Tokenpocalypse Is Here: Companies Are Scrambling To Stop Spending So Much on AI — AI token consumption is driven significantly by non-technical users performing routine tasks, leading to unexpected cost overruns.
• Enterprise AI adoption low due to high token usage, low RoI: Cognizant CEO - Business Standard — Enterprise AI adoption lags due to excessive token consumption lacking clear ROI and production value.
• AI's Brokenomics — AI labs' business models are unsustainable due to massive subsidies, high costs, and unproven ROI, leading to customer revolt and price cuts.
• Let's spend 250K$ on tokens just for sake of spending — The provided content critically analyzes a "flawed logic," attributed to Jensen, which suggests that engineering value is now measured by high AI token consumption rather than efficient, optimized solutions.
• The token bill comes due: Inside the industry scramble to manage AI’s runaway costs — AI's escalating token costs necessitate new financial management standards and tools to ensure ROI amidst surging consumption.
• SED News: Apple’s AI Problem, The Real Business Model of AI, and Token Cost Reckoning — AI's true business model relies on high-value enterprise contracts subsidizing consumer subscriptions, driving a new "AI compute tax."

Open in AIssential →

Editorial summary, takeaway, and curation by AIssential. Original article published by Pivot to AI.