Scaling AI calls for a revamped operating model

2026-06-04 · Source: Information and Enterprise Technology News | CIO Dive - Www.ciodive.com · Field: Business & Management — Corporate Strategy & Leadership, Operations & Process Management, Human Resources & Workforce Development · Depth: Intermediate, medium

Summary

Jamie Rutledge, President of Kyndryl US, argues in a June 4, 2026 article that scaling enterprise AI requires a fundamental overhaul of organizational operating models, moving beyond mere experimentation. Many AI initiatives stall due to technical hurdles like hybrid cloud limitations, fragmented data, and unsuitable review processes. Successful AI adoption necessitates mission-critical technology foundations, including AI-ready infrastructure, governed data, and embedded security, integrated into modern platforms. The article emphasizes using agentic AI to modernize legacy systems and workflows, not just layer intelligence on top. It highlights the need for operationalized governance, clear approval workflows, role-based access controls, and runtime logging. Furthermore, organizational change management is crucial, redefining roles for infrastructure and security teams, and clarifying human-AI decision ownership. Only 29% of leaders feel their workforce is AI-ready, underscoring the need for co-created, cross-functional workflows.

Key takeaway

For CTOs and VPs of Engineering planning large-scale AI deployments, recognize that success hinges on organizational redesign, not just technology. You must prioritize revamping operating models and embedding AI into core enterprise architecture with operationalized governance. Actively manage change across people, processes, and technology. Focus on workforce readiness and cross-functional collaboration to avoid stalled initiatives and ensure sustainable ROI.

Key insights

Scaling enterprise AI demands a complete operating model reinvention, integrating AI into core systems with robust governance and workforce readiness.

Principles

• AI adoption needs AI-ready infrastructure.
• Operationalize governance, don't just document it.
• Redesign workflows, don't just optimize them.

Method

Integrate AI into live systems with discipline, using agentic AI to modernize legacy environments, and implement policy-as-code for systematic governance and clear approval workflows.

In practice

• Implement policy-as-code for AI governance.
• Redefine roles for AI workload requirements.
• Co-create AI-enabled workflows with employees.

Topics

• AI Operating Models
• Enterprise AI Adoption
• Agentic AI
• AI Governance
• Organizational Change Management
• Workforce Readiness

Best for: Executive, Director of AI/ML, VP of Engineering/Data, CTO

Related on AIssential

• Your AI Reinvention Needs An Engine — Scaling AI requires integrated organizational reinvention, focusing on skills and codifying tacit knowledge for machine readability.
• How Frontier Firms are rebuilding the operating model for the age of AI — Effective AI integration requires redesigning organizational operating models around human-agent collaboration patterns, not just individual adoption.
• Enabling agent-first process redesign — AI agents require agent-first process redesign for nonlinear gains, shifting humans to governance.
• What CIOs Are Doing To Evolve Operating Models And Talent — Evolving IT operating models and talent is crucial for CIOs to translate strategy into measurable business outcomes.
• IBM Study: CEOs are Reshaping C-suite Roles for the AI Era — AI's rapid integration is compelling CEOs to fundamentally redesign C-suite structures and decision-making processes.
• EY: How to Scale AI at Speed Without Impacting Innovation — Effective AI architecture, not just model accuracy, drives speed, trust, and scalable human-AI orchestration.

Open in AIssential →

Editorial summary, takeaway, and curation by AIssential. Original article published by Information and Enterprise Technology News | CIO Dive - Www.ciodive.com.