AI vendors have found someone to pay their infrastructure bills: You
Summary
Businesses should prepare for substantial increases in software and AI spending in 2027, according to Forrester's latest warnings, driven by vendors passing on their significant AI infrastructure costs. A survey of over 2,600 decision-makers indicates 80 percent expect higher data and software budgets. Companies like Anthropic, OpenAI, and GitHub have already shifted to usage-based billing, while Microsoft introduced its premium E7 license bundling M365 Copilot. Bain & Company estimated AI datacenter build costs could reach \$2 trillion by 2030. Despite "AI washing of layoffs," IT staffing costs remain high, with 67 percent of tech decision-makers expecting increases in 2027, particularly for data/analytics roles. Forrester advises adapting FinOps practices to manage unpredictable AI costs through runtime controls like model routing and semantic caching. KPMG research shows nearly a third of corporate leaders struggle with AI operating cost control.
Key takeaway
For Directors of AI/ML evaluating 2027 budgets, anticipate significant increases in software and AI service expenditures due to vendor price hikes and usage-based billing. You must proactively adapt FinOps strategies to implement runtime cost controls like model routing and semantic caching. Prioritize investments in trusted data and strong governance, rather than solely focusing on AI spending, to ensure effective AI adoption and avoid runaway costs.
Key insights
AI vendors are shifting infrastructure costs to customers via usage-based pricing and premium tiers, necessitating new cost management strategies.
Principles
- Outperforming organizations invest in AI foundations.
- AI cost management requires FinOps adaptation.
- Guard against inflated AI employee replacement claims.
Method
Organizations should adapt FinOps practices to manage unpredictable AI costs by funding runtime cost controls like model routing, semantic caching, and usage guardrails.
In practice
- Implement model routing for cost control.
- Utilize semantic caching to reduce spend.
- Establish usage guardrails for AI services.
Topics
- AI Cost Management
- FinOps
- Usage-Based Billing
- Software Budgets
- AI Governance
- IT Staffing
Best for: Director of AI/ML, VP of Engineering/Data, Consultant
Related on AIssential
See Counsel's argued verdicts on the open AI decisions leaders are weighing →
Editorial summary, takeaway, and curation by AIssential. Original article published by The Register: Enterprise Technology News and Analysis.