SHI International: Assessing AI's Impact on RAM Prices
Summary
Cheryl Slater, Director for End User Compute in the UK at SHI International Corp, details how accelerating AI demand is driving a significant global shortage and price increase for Random Access Memory (RAM), particularly High Bandwidth Memory (HBM). This shift is due to major manufacturers like SK hynix, Micron, and Samsung reallocating wafer capacity from conventional DRAM to more profitable HBM for AI accelerators, with HBM consuming nearly three times the wafer capacity of DDR5. SK hynix, for instance, secured demand for all its RAM production for 2026 by October. This situation, exacerbated by hyperscalers stockpiling amid fears of constrained supply, is stalling hardware deployment and impacting data center capacity. Conservative estimates suggest the shortage could last until early 2027, depending on factors like fab rebalancing and potential shifts in AI demand.
Key takeaway
For IT and procurement leaders navigating current RAM shortages, waiting for prices to normalize is a significant risk. You should prioritize device refresh and optimize server configurations to use memory more efficiently, reducing demand. Implement dynamic procurement strategies, like Intelligent Refresh Programs, to move away from fixed refresh cycles. This approach will enhance your supply chain resilience and mitigate exposure during periods of market volatility, ensuring continuous operational capacity.
Key insights
AI's surging demand for HBM is causing a critical global RAM shortage, impacting IT supply chains and pricing.
Principles
- Wafer reallocation to HBM reduces traditional DRAM availability.
- Stockpiling by hyperscalers exacerbates supply constraints.
- Supply chain resilience requires dynamic procurement strategies.
Method
Implement Intelligent Refresh Programs (IRPs) to share refresh timelines, supply risks, and budget triggers, guiding procurement decisions.
In practice
- Redesign data center architectures for memory efficiency.
- Explore ITAM/SAM/FinOps for cost reduction and rationalization.
- Extract and redeploy memory from end-of-life devices.
Topics
- RAM Shortage
- AI Accelerators
- HBM (High Bandwidth Memory)
- Supply Chain Resilience
- Data Center Infrastructure
- IT Asset Management
Best for: CTO, VP of Engineering/Data, Executive, IT Professional, Director of AI/ML, Consultant
Related on AIssential
Editorial summary, takeaway, and curation by AIssential. Original article published by AI Magazine.