Datadog sees tagging and model governance as the foundation of AI cost management

2026-06-11 · Source: AI – SiliconANGLE · Field: Technology & Digital — Artificial Intelligence & Machine Learning, Cloud Computing & IT Infrastructure · Depth: Intermediate, long

Summary

Datadog, through Senior FinOps Analyst Deeja Cruz at FinOps X 2026, asserts that effective AI cost management fundamentally relies on robust attribution tagging and comprehensive model governance. Cruz highlights that while AI introduces new vendors and pricing schemas, the core FinOps principles of understanding usage, purpose, and cost remain constant. Enterprises must prioritize high-quality attribution tags to enable accurate spend allocation and identify optimization opportunities, preventing cost visibility collapse. Datadog itself employs a multi-model selection strategy, evaluating optimal models for specific workloads, and fosters cross-team ownership where FinOps manages forecasting and attribution, while an AI developer experience team handles governance tooling and developer feedback. This collaborative approach mirrors cloud cost management evolution.

Key takeaway

For Directors of AI/ML overseeing new AI initiatives, prioritize establishing a strong foundation for cost management from the outset. Ensure your teams implement comprehensive attribution tagging across all AI workloads to enable accurate spend allocation and identify optimization opportunities. Foster cross-functional partnerships between FinOps and AI development teams to define clear ownership for forecasting, attribution, and model governance, preventing cost overruns and ensuring strategic model selection.

Key insights

Effective AI cost management hinges on robust attribution tagging and strategic model governance.

Principles

• High-quality attribution tags are crucial for AI spend allocation.
• Select optimal AI models per workload, not just the most expensive.
• AI cost management is a collaborative "team sport."

Method

FinOps practitioners can use LLMs to generate code for cost-saving configuration changes, then collaborate with owners for approval and implementation.

In practice

• Implement high-coverage attribution tags for all AI workloads.
• Develop a multi-model selection strategy for AI deployments.
• Partner FinOps with AI developer teams for shared ownership.

Topics

• AI Cost Management
• FinOps
• Model Governance
• Attribution Tagging
• Large Language Models
• Cloud Cost Optimization

Best for: CTO, VP of Engineering/Data, Executive, MLOps Engineer, Director of AI/ML, Consultant

Related on AIssential

• FinOps AI goes beyond token economics as agentic costs emerge — AI FinOps must expand beyond tokenomics to encompass all "adjacent AI costs" for effective governance and cost explainability.
• One company reportedly spent $500 million on Claude in one month after failing to cap AI usage — AI cost overruns stem from uncapped usage, misuse, and poor model selection, necessitating internal expertise.
• FinOps AI governance demands new KPIs as token economics reshape enterprise cost models — AI's token-based economics necessitate new FinOps KPIs, automation, and cross-functional collaboration for effective governance and value.
• The Full Map of AI Workshop — The AI landscape is rapidly expanding, adding new structural layers like agentic harnesses and governance for production and controlled capability release.
• AI Costs Are Outpacing Marketing Budgets, So How Do You Strategize? — Escalating AI costs, fueled by agentic AI's high token consumption, demand strategic management focused on value and task-appropriate model selection.
• Production AI very different from the demos [D] — Production AI costs often exceed prototype estimates due to scaling, longer prompts, and lack of granular attribution.

Open in AIssential →

Editorial summary, takeaway, and curation by AIssential. Original article published by AI – SiliconANGLE.