Meta buys tens of millions of AWS Graviton 5 processor cores from Amazon

· Source: The Decoder · Field: Technology & Digital — Artificial Intelligence & Machine Learning, Cloud Computing & IT Infrastructure, Robotics & Autonomous Systems · Depth: Intermediate, quick

Summary

Meta is acquiring tens of millions of AWS Graviton 5 processor cores from Amazon, establishing itself as one of the largest Graviton customers globally. These ARM-based CPU cores are intended to power Meta's agentic AI systems, which require significant processing for task planning and execution, complementing GPUs used for AI model training. This purchase aligns with Meta's broader strategy of investing in ARM-based processors, following its deployment of Nvidia's Grace CPUs in February and the co-development of the "AGI CPU" with ARM in March. The agreement with AWS is scalable, allowing Meta to potentially transition workloads from Graviton 5 to its new ARM chips in the future. Specific financial terms or contract duration were not disclosed.

Key takeaway

For CTOs and VP of Engineering evaluating infrastructure for advanced AI, your strategy should prioritize ARM-based CPUs like Graviton 5 for agentic AI orchestration, even as GPUs handle training. This move by Meta signals a critical shift towards distributed, CPU-intensive AI workloads, suggesting a need to diversify beyond GPU-centric planning to optimize cost and performance for complex AI systems.

Key insights

Meta is heavily investing in ARM-based CPUs, including AWS Graviton 5, to power agentic AI systems.

Principles

In practice

Topics

Best for: CTO, VP of Engineering/Data, MLOps Engineer, AI Engineer, AI Architect, Director of AI/ML

Related on AIssential

Open in AIssential →

Editorial summary, takeaway, and curation by AIssential. Original article published by The Decoder.