Intel: Our upcoming AI chip will be cheaper, run cooler than Nvidia, AMD options
Summary
Intel plans to ship its new "Crescent Island" GPU, an AI chip designed for inference tasks, by the end of this year. This offering aims to challenge Nvidia and AMD by utilizing cheaper LPDDR5 memory and air-cooling technology, contrasting with rivals' expensive high-bandwidth memory (HBM) and liquid-cooling infrastructure. The chip, developed over 18 months, marks Intel's renewed push into the AI infrastructure market under CEO Lip-Bu Tan, following past struggles with AI training GPUs like "Gaudi." Intel intends to manufacture Crescent Island in its own foundries, further reducing costs compared to competitors relying on TSMC. The company is also evaluating compliance with US export controls for potential sales in China, where demand for such price points exists. Intel's shares have risen over 200 percent this year amidst this strategic shift.
Key takeaway
For AI Architects evaluating new inference hardware, Intel's upcoming "Crescent Island" GPU presents a compelling alternative to high-cost Nvidia and AMD options. Your decision-making should now factor in this air-cooled, LPDDR5-based chip, which promises significantly lower memory and cooling infrastructure expenses. This shift could enable more economical deployment of AI inference at scale, especially if your operations are sensitive to HBM and liquid-cooling costs. Investigate its performance benchmarks upon release to assess its fit for your specific inference workloads.
Key insights
Intel targets AI inference with a cost-effective, air-cooled GPU using LPDDR5 memory, aiming to undercut rivals.
Principles
- Cost-effective memory and cooling create market differentiation.
- In-house foundry manufacturing reduces chip production costs.
- Focus on specific market segments based on past experience.
In practice
- Develop AI hardware optimized for inference workloads.
- Explore LPDDR5 memory for cost-sensitive AI applications.
- Consider air-cooling solutions to reduce infrastructure complexity.
Topics
- Intel Crescent Island
- AI Inference
- LPDDR5 Memory
- Air Cooling
- Foundry Manufacturing
- Data Center GPUs
- US Export Controls
Best for: CTO, VP of Engineering/Data, MLOps Engineer, AI Hardware Engineer, AI Architect, Director of AI/ML
Related on AIssential
Editorial summary, takeaway, and curation by AIssential. Original article published by AI - Ars Technica.