Meta’s new AI chips will begin production in September

· Source: TechCrunch · Field: Technology & Digital — Artificial Intelligence & Machine Learning, Cloud Computing & IT Infrastructure · Depth: Intermediate, quick

Summary

Meta is set to begin production of its latest AI-specific chips in September, aiming to reduce GPU costs amidst a component shortage. At least one chip completed its testing phase in approximately six weeks. Developed under the Meta Training and Inference Accelerator (MTIA) program, these chips are designed with a modular approach, building on previous generations and incorporating evolving AI workload insights. Meta is collaborating with Broadcom on design, TSMC for manufacturing, Samsung for RAM, Sandisk for storage, and Sumitomo Electric for fiber-optic equipment. The company plans to use MTIA chips for training models for ranking and recommendation algorithms, broader AI workloads, and inference across its applications. This initiative is part of Meta's substantial investment in AI infrastructure, with projected capital expenditures between \$125 billion and \$145 billion this year, including plans to deploy 7 gigawatts of compute capacity.

Key takeaway

For AI Architects evaluating compute infrastructure, Meta's strategy signals a critical shift towards custom silicon. You should assess whether your organization's specific AI workloads, particularly for ranking and recommendations, warrant investing in or exploring specialized hardware development. This approach can significantly reduce long-term GPU costs and enhance performance for proprietary models, but requires substantial upfront capital expenditure and deep engineering expertise.

Key insights

Major tech companies are developing custom AI chips to reduce costs and optimize for specific workloads.

Principles

In practice

Topics

Best for: Director of AI/ML, AI Architect, AI Hardware Engineer

Related on AIssential

Open in AIssential →

Editorial summary, takeaway, and curation by AIssential. Original article published by TechCrunch.