The real cost, security, and culture problems behind enterprise AI agents

2026-07-07 · Source: VentureBeat · Field: Technology & Digital — Artificial Intelligence & Machine Learning, Cybersecurity & Data Privacy, Cloud Computing & IT Infrastructure · Depth: Intermediate, short

Summary

At VentureBeat's AI Impact event, Red Hat's Brian Gracely highlighted the real-world challenges enterprises face when scaling AI agents beyond pilot stages. Many leaders mistakenly believe they are far behind competitors, but organizations often learn rapidly. This quick adoption, however, quickly escalates AI costs, making cost management a boardroom issue due to high agent usage and dependency on a few model providers. Gracely emphasized that right-sizing AI models via semantic routing and infrastructure techniques like caching are crucial for cost control, drawing parallels to FinOps. Furthermore, AI-powered vulnerability discovery demands faster patch management cycles (7-14 days), as AI tools can chain minor flaws. Ultimately, scaling agents requires deep involvement and buy-in from subject matter experts and compliance teams, necessitating proper incentives to overcome organizational friction.

Key takeaway

For AI Architects or Directors of AI/ML deploying enterprise AI agents, proactively address cost, security, and cultural integration from the outset. Implement semantic routing and FinOps principles for AI spend to avoid escalating costs. Prioritize rapid patch management, aiming for a 7-14 day window, given AI's accelerated vulnerability discovery. Crucially, engage and incentivize subject matter experts and compliance teams early to ensure successful organizational adoption and prevent projects from stalling.

Key insights

Scaling enterprise AI agents requires proactive cost management, accelerated security patching, and strategic organizational buy-in.

Principles

• Enterprises often overestimate their lag in AI agent adoption.
• Right-sizing models is the primary lever for cutting AI agent costs.
• AI-powered vulnerability discovery necessitates rapid patch cycles.

Method

Implement semantic routing to classify requests and direct them to appropriately sized models, combined with caching repetitive queries at the GPU infrastructure level to reduce compute needs.

In practice

• Adopt FinOps-like practices for AI token spend.
• Educate internal teams on optimal model selection.
• Incentivize subject matter experts to collaborate on agent development.

Topics

• AI Agents
• Enterprise AI
• Cost Optimization
• FinOps
• Vulnerability Management
• Organizational Buy-in

Best for: CTO, VP of Engineering/Data, Executive, Director of AI/ML, AI Architect, MLOps Engineer

Related on AIssential

• The 100-agent benchmark: why enterprise AI scale stalls and how to fix it — Scaling agentic AI requires robust governance and unified platforms to overcome significant operational costs and production challenges.
• Why Data‑Driven Efforts Stall in Fragmented Environments - with Jason Loomis of Freshworks — Enterprise AI adoption requires a sequenced approach, prioritizing regulatory compliance, data trust, and AI-specific security frameworks to balance speed and safety.
• 5 Practical Ways to Reduce AI Costs (TCO) in the Enterprise — Optimizing enterprise AI costs requires architectural strategies beyond just technical solutions.
• AI for FinOps: Agentic Use Cases in FinOps — Agentic AI shifts FinOps from reactive reporting to proactive, autonomous orchestration, enhancing efficiency and value management.
• 10 best practices for optimizing generative and agentic AI costs — Effective AI cost optimization requires balancing technical tradeoffs, transparent governance, and proactive management across the AI lifecycle.
• What it takes to scale agentic AI in the enterprise — Scaling agentic AI demands robust governance, data infrastructure, and system integration, not just advanced technology.

Open in AIssential →

Editorial summary, takeaway, and curation by AIssential. Original article published by VentureBeat.