The Biggest Bottlenecks For AI: Energy & Cooling

2026-01-26 · Source: a16z · Field: Finance & Economics — Capital Markets & Investment Management, Corporate Finance & Treasury, Artificial Intelligence & Machine Learning · Depth: Intermediate, extended

Summary

The AI market is experiencing unprecedented growth, driven by massive infrastructure investments from large tech companies, with annual capital expenditure for AI infrastructure and data centers estimated at $400 billion. Input costs for accessing AI models have declined by over 99% in two years, while model capabilities improve significantly every seven months. This rapid advancement is creating a market opportunity far exceeding previous cycles like mobile and cloud computing, with AI's economic impact projected to be much larger than the $10 trillion generated by the prior cycle. The current buildout is deemed more stable than past tech booms due to strong corporate builders and immediate global distribution via existing internet and cloud infrastructure. Key bottlenecks for AI's future growth are identified as energy and cooling, with nuclear power and innovative cooling solutions being critical areas for investment and development.

Key takeaway

For investors and entrepreneurs evaluating AI opportunities, recognize that the market's rapid expansion and unique distribution model de-risks infrastructure buildout compared to past tech cycles. Focus on business models demonstrating strong customer retention and efficient acquisition, as initial gross margins may be less critical given projected declines in input costs. Your investment thesis should account for AI's potential to create vast economic surplus, with much of the value accruing to end-users, while still generating substantial market capitalization for innovative companies.

Key insights

AI's rapid growth, fueled by massive infrastructure investment and declining input costs, presents a market opportunity far exceeding prior tech cycles.

Principles

• Input costs for AI models decrease faster than Moore's Law.
• AI's global distribution is accelerated by existing internet/cloud infrastructure.
• Value capture in AI will heavily favor end-customers (90%) over providers (10%).

Method

Investment strategy focuses on companies with undeniable momentum and very early deals with top-tier teams, prioritizing customer love, gross retention, and ease of acquisition over current gross margins due to anticipated cost reductions.

In practice

• Prioritize gross retention and customer acquisition for AI business models.
• Explore nuclear power and advanced cooling for data center energy needs.
• Consider AI for sophisticated shopping research and workflow automation.

Topics

• AI Infrastructure
• AI Business Models
• AI Market Growth
• Energy and Cooling
• Venture Capital Strategy

Best for: CTO, VP of Engineering/Data, Director of AI/ML, Investor, Entrepreneur, Business Analyst

Related on AIssential

• AI Will Supercharge Modelbusters — AI's exponential improvements in capability and cost reduction are creating unprecedented market expansion and rapid growth opportunities.
• Google’s $185B Infra Bet & DeepMind’s Memory Fix, India’s GPU Surge, and the Mobile RAM Crisis — AI's rapid growth is driving massive infrastructure investments and creating critical supply chain pressures across the tech industry.
• Software Selloff Continues as AI-Impact Worries Grow — AI's disruptive force is reshaping market valuations, driving investment in new energy, and transforming digital commerce and social media accountability.
• Billions spent and hypothetical returns: the AI boom explained with six charts - The Guardian — The AI boom is marked by unprecedented investment and rapid adoption, but faces significant infrastructure and cost challenges.
• How Do We Fix This? — Focus AI investments on use cases where returns outpace costs to achieve economic viability and avoid negative unit economics.
• Big Tech commits at least $610 billion to AI, then loses $950 billion in market value — Massive Big Tech AI infrastructure investments are creating a self-reinforcing spending cycle amid investor uncertainty.

Open in AIssential →

Editorial summary, takeaway, and curation by AIssential. Original article published by a16z.