Nvidia and Meta Agree to Wide-Ranging new AI Chip Deal

· Source: aibusiness · Field: Technology & Digital — Artificial Intelligence & Machine Learning, Cloud Computing & IT Infrastructure · Depth: Novice, quick

Summary

Nvidia and Meta have announced a new, extensive AI chip deal, expanding their existing "multiyear and multigenerational" partnership across on-premises, cloud, and AI infrastructure. This agreement will see Meta integrate more Nvidia chips into its data centers to support AI training and inference, as well as its core business operations. While financial specifics were not disclosed, the deal is likely worth tens of billions, given Meta CEO Mark Zuckerberg's commitment to spend up to $135 billion on AI this year. The agreement includes Meta purchasing Nvidia Grace CPUs, Blackwell GPUs, and next-generation Vera Rubin GPUs, alongside collaboration on Vera CPUs for potential 2027 deployment. Notably, this marks Nvidia's first Grace-only deployment, indicating a shift towards standalone CPUs for AI inference. Meta will also adopt Nvidia's Spectrum-X Ethernet platform and Confidential Computing security system for its AI infrastructure.

Key takeaway

For VPs of Engineering or Data considering large-scale AI infrastructure investments, this deal highlights the strategic importance of integrated hardware solutions. Your teams should evaluate Nvidia's Grace CPUs and Vera Rubin platform for future AI training and inference needs, especially given the trend towards specialized CPUs for inference. Additionally, assess the benefits of Nvidia's Spectrum-X Ethernet and Confidential Computing for optimizing performance and security in your AI deployments.

Key insights

Meta and Nvidia deepen their AI hardware partnership, focusing on next-gen GPUs, CPUs, and networking for large-scale AI infrastructure.

Principles

In practice

Topics

Best for: VP of Engineering/Data, Investor, Director of AI/ML, CTO, AI Architect

Related on AIssential

Open in AIssential →

Editorial summary, takeaway, and curation by AIssential. Original article published by aibusiness.