What enterprise CIOs can learn from the public sector on AI spending

2026-06-24 · Source: Information and Enterprise Technology News | CIO Dive - Www.ciodive.com · Field: Business & Management — Corporate Strategy & Leadership, Operations & Process Management · Depth: Intermediate, short

Summary

Enterprise CIOs can learn from the public sector's approach to AI spending, as highlighted by Dru Rai, CIO for the State of New York, in an article published June 24, 2026. Rai, who transitioned from the corporate world in 2023, emphasizes a cost-conscious mindset focused on serving residents, ensuring safety, and protecting privacy, rather than solely improving a company's bottom line. With AI budgets under scrutiny in 2026 and pricing models shifting to usage-based structures, enterprises face pressure to demonstrate ROI. Rai advocates for a "try and fail fast" strategy within controlled environments for AI pilots, enabling early termination of unscalable projects to prevent wasted investment. He also suggests prioritizing sustainable, less expensive, even if slightly slower, AI solutions over being first to market, viewing AI as an "event in the evolution" of technology. Future IT leaders, he notes, must navigate hardware dependencies like GPUs and quantum computing.

Key takeaway

For CIOs managing escalating AI budgets, consider adopting a public sector mindset to optimize spending. You should implement a "try and fail fast" strategy for AI pilots, allowing early termination of unscalable projects to prevent wasted investment. Prioritize sustainable, cost-effective AI solutions over rapid deployment, even if it means choosing slightly slower models. This approach helps ensure your AI investments deliver tangible value while safeguarding resources.

Key insights

Public sector's lean, resident-focused AI spending offers enterprises a model for cost-conscious innovation and risk mitigation.

Principles

• Prioritize safety, privacy, and public good in AI deployment.
• Embrace a "try and fail fast" approach for AI pilots.
• Value sustainable, cost-effective solutions over speed.

Method

Implement a "try and fail fast" process for AI pilots in a highly controlled environment. This involves early recognition of scalability issues to cut losses and redirect investment efficiently.

In practice

• Evaluate AI models based on cost-effectiveness and sustainability.
• Establish clear exit criteria for AI pilot projects.
• Integrate privacy and safety checks into AI development.

Topics

• AI Spending
• Public Sector AI
• CIO Strategy
• AI Project Management
• Cost Optimization
• AI Governance

Best for: Executive, CTO, Director of AI/ML, VP of Engineering/Data

Related on AIssential

• The Pulse: a trend of trying to cut back on AI spend within eng departments? — Companies struggle to link high AI spending to direct productivity gains or user-facing feature delivery, prompting cost optimization efforts.
• A new framework to accelerate trustworthy AI adoption in public administrations — EU public administrations can strategically adopt AI through a three-pillar framework focused on alignment, capacity, and value.
• AI Can't Survive Your C-Suite’s Magic Thinking — Corporate "magic thinking" and business-driven data practices, not technical issues, cause 95% of AI initiative failures.
• AI deployment plans are catching leaders underprepared — Organizations are largely unprepared for AI deployment scale, with governance and financial controls lagging behind rapid adoption.
• How Do We Fix This? — Focus AI investments on use cases where returns outpace costs to achieve economic viability and avoid negative unit economics.
• SED News: Apple’s AI Problem, The Real Business Model of AI, and Token Cost Reckoning — AI's true business model relies on high-value enterprise contracts subsidizing consumer subscriptions, driving a new "AI compute tax."

Open in AIssential →

Editorial summary, takeaway, and curation by AIssential. Original article published by Information and Enterprise Technology News | CIO Dive - Www.ciodive.com.