AI costs rising for businesses: report
Summary
A new report from Bain & Company indicates that 20% to 30% of operating expenses will shift to AI agents from humans within three to four years, with businesses facing pressure to adopt advanced, yet costly, AI products like Anthropic's Fable, which is double the price of OpenAI's most powerful model. Concurrently, a Glean survey of 6,000 digital workers found AI saves an average of 11 hours weekly, though only 13% report significant organizational performance improvement. Many effective AI users employ unapproved tools or methods. Separately, analysis suggests space-based data centers could become cost-effective by the early 2030s, potentially falling to 30% more expensive than terrestrial options, driven by increasing demand and terrestrial bottlenecks. Anthropic also launched Fable 5, a guardrailed version of its powerful Mythos model, tested against jailbreaking attempts, and priced lower than previous Mythos versions. OpenAI also confidentially filed for an IPO.
Key takeaway
For Directors of AI/ML evaluating strategic investments, recognize that while AI promises substantial productivity gains, managing rising model costs and "shadow AI" usage is critical. Your strategy should include a diversified AI model portfolio to optimize cost-performance and a framework to understand and integrate effective, unsanctioned employee AI practices. Additionally, consider the long-term potential of space-based data centers as a future compute infrastructure solution.
Key insights
AI adoption drives significant operational cost shifts and productivity gains, yet effective use often involves unsanctioned methods.
Principles
- AI model selection should balance capability with cost.
- Unsanctioned AI use often correlates with higher productivity.
- Future data center expansion may necessitate orbital solutions.
In practice
- Evaluate AI model portfolios for cost-efficiency per task.
- Investigate "shadow AI" use for best practices.
- Monitor space infrastructure developments for future compute.
Topics
- AI Cost Management
- AI Productivity
- Space Data Centers
- AI Model Development
- Shadow IT
- AI Investment
Best for: CTO, VP of Engineering/Data, AI Product Manager, Executive, Investor, Director of AI/ML
Related on AIssential
Editorial summary, takeaway, and curation by AIssential. Original article published by Semafor.