Apple Going All-In on AI Chips
Summary
Apple is intensifying its focus on AI capabilities within its Apple Silicon efforts, particularly with the upcoming M7 Ultra chip. This chip, slated for 2028, is expected to dramatically upgrade AI performance, potentially bringing it closer to dedicated AI accelerators like NVIDIA's Blackwell for inference workloads. A key advantage for Apple is its unified memory architecture, which could allow the M7 Ultra to compete with Blackwell for LLM inference if it achieves 1.5TB of memory. The article also notes Apple's plans for a new server chip based on the M7 Ultra by 2029, suggesting a potential shift in its AI server strategy and reduced reliance on external cloud providers. However, it acknowledges NVIDIA's continuous advancements and the increasing size of AI models as significant challenges.
Key takeaway
For investors tracking the AI chip market, Apple's aggressive push into AI-optimized silicon, particularly with the M7 Ultra targeting NVIDIA Blackwell-class inference by 2028, signals a significant competitive shift. You should monitor Apple's memory capacity advancements and server chip development, as these could reduce its cloud reliance and potentially position it as a future chip vendor, impacting current market leaders.
Key insights
Apple's M7 Ultra aims for NVIDIA Blackwell-class AI inference performance by 2028, utilizing unified memory.
Principles
- Unified memory architecture benefits on-device AI inference.
- AI inference and training have distinct hardware requirements.
- Future chip roadmaps must anticipate model growth.
In practice
- Design chips with high memory bandwidth for LLM inference.
- Prioritize on-device AI to mitigate cloud compute costs.
- Develop internal server chips for AI workloads.
Topics
- Apple Silicon
- AI Chips
- M7 Ultra
- NVIDIA Blackwell
- AI Inference
- Unified Memory
- On-device AI
Best for: AI Hardware Engineer, Investor, Tech Journalist
Related on AIssential
See Counsel's argued verdicts on the open AI decisions leaders are weighing →
Editorial summary, takeaway, and curation by AIssential. Original article published by Spyglass.