Why Authenticity Beats Algorithms: The New Rules of Digital Marketing - ML 185

2025-04-04 · Source: Adventures in Machine Learning · Field: Technology & Digital — Artificial Intelligence & Machine Learning, Cloud Computing & IT Infrastructure, Data Science & Analytics · Depth: Advanced, extended

Summary

This podcast episode features Barzan, a computer science professor and founder of Kivo, a fully automated cloud optimizer known for its Snowflake integrations. Barzan discusses Kivo's origin, which stemmed from the observation that data growth was outpacing Moore's Law, leading to escalating cloud infrastructure costs. Kivo addresses this by training AI models on performance telemetry, not customer data, to optimize cloud data warehouse usage and reduce costs by 20-50%. The platform uses reinforcement learning agents to pull optimization levers in real-time, rewarding cost savings and penalizing inefficiencies. Barzan highlights that Kivo differentiates itself from cloud-specific solutions by integrating with existing data stacks without requiring migration, focusing on a "data learning platform" approach that includes warehouse optimization, workflow intelligence, smart query routing, and data quality alerts.

Key takeaway

For CTOs and VP of Engineering facing escalating cloud data warehouse costs, Kivo's AI-driven optimization offers a compelling solution to reduce spend by 20-50% without data migration. Your teams can shift focus from manual optimization to core business growth, leveraging automated systems that continuously learn and adapt to complex data workloads, ensuring efficient resource utilization and unlocking further business value.

Key insights

Automated cloud optimization leverages AI to reduce data infrastructure costs by learning from performance telemetry.

Principles

• Data growth outpaces hardware improvements.
• Cost optimization requires continuous learning.
• Decouple application logic from performance.

Method

Kivo trains AI models on performance telemetry, not customer data, using reinforcement learning agents to identify and apply optimizations in real-time, rewarding cost savings and penalizing inefficiencies.

In practice

• Implement AI for cloud cost reduction.
• Focus on performance telemetry for optimization.
• Utilize query rewriting with LLMs.

Topics

• Cloud Optimization
• Data Warehousing
• Reinforcement Learning
• LLM Query Rewriting
• AI Research & Development

Best for: CTO, VP of Engineering/Data, AI Architect, Data Engineer, Machine Learning Engineer, Data Scientist

Related on AIssential

• I messed up... — AI-driven development accelerates shipping but risks cost overruns and reduced understanding of underlying code and services.
• Optimizing cloud economics with linear elastic caching — Dynamic, cost-aware cache sizing using a "ski rental" model significantly reduces total ownership cost by optimizing memory use.
• Predictive Optimization at Scale: A Year of Innovation and What’s Next — Predictive Optimization automates data layout and maintenance for cost-effective, high-performance lakehouses.
• From the clouds: The imperatives and designs of today’s IT and data economics — Cloud-first strategies created data fragmentation, necessitating a shift to outcome-driven, economically measured enterprise architecture for AI and regulation.
• Chart your AI and agent strategy with Microsoft Marketplace — Azure is enhancing its cloud infrastructure with specialized AI hardware and integrated database capabilities.
• The Minimill of AI — Distributing AI tasks between local and cloud models based on complexity significantly boosts efficiency and reduces reliance on hyperscalers.

Open in AIssential →

Editorial summary, takeaway, and curation by AIssential. Original article published by Adventures in Machine Learning.