AWS Graviton5 Reaches General Availability with 192 Cores and Formally Verified VM Isolation

2026-06-22 · Source: InfoQ · Field: Technology & Digital — Artificial Intelligence & Machine Learning, Cloud Computing & IT Infrastructure · Depth: Intermediate, short

Summary

AWS Graviton5 processors are now generally available, powering new M9g and M9gd EC2 instances. These processors feature 192 cores on four TSMC 3nm chiplets, 192 MB of L3 cache, DDR5-8800 memory, and PCIe Gen 6. AWS positions Graviton5 for agentic AI workloads, though the r/hardware community notes its strong general-purpose ARM capabilities benefit databases, web servers, and batch processing. Customer benchmarks show significant gains, including a 36% performance boost for ClickHouse and a 60% reduction in MySQL query duration for HubSpot. A key security feature is the Nitro Isolation Engine, offering the first formally verified hypervisor isolation in a production cloud environment. While M9g instances are 9% more expensive than M8g, they deliver approximately 15% better price-performance.

Key takeaway

For MLOps Engineers or architects evaluating cloud compute for CPU-intensive tasks, Graviton5 instances offer compelling price-performance and security. You should consider M9g for agentic AI, database, or general web server workloads, leveraging its 192 cores and DDR5-8800 memory. If your applications handle untrusted code or multi-tenant environments, the formally verified VM isolation provides a critical security advantage over competing cloud offerings.

Key insights

AWS Graviton5 offers high-core ARM performance and formally verified VM isolation for diverse CPU-intensive workloads.

Principles

• Increased core count, cache, and memory bandwidth improve general CPU performance.
• Formal verification provides mathematically proven security guarantees for VM isolation.

In practice

• Deploy M9g instances for agentic AI, databases, web servers, or batch processing.
• Utilize M9gd instances for workloads requiring fast local NVMe SSD storage.
• Consider Graviton5 for multi-tenant environments needing strong VM isolation.

Topics

• AWS Graviton5
• ARM Processors
• EC2 Instances
• Formal Verification
• Hypervisor Isolation
• Agentic AI
• Price-Performance

Best for: CTO, VP of Engineering/Data, Director of AI/ML, AI Hardware Engineer, AI Engineer, MLOps Engineer

Related on AIssential

• Graviton5’s improved design increases speed and energy efficiency — beyond Moore’s law — Graviton5's chiplet architecture and advanced components deliver significant performance and efficiency gains for diverse cloud workloads.
• In another wild turn for AI chips, Meta signs deal for millions of Amazon AI CPUs — AWS secured a significant Meta deal for Graviton CPUs, intensifying cloud and custom AI chip competition.
• Meta buys tens of millions of AWS Graviton 5 processor cores from Amazon — Meta is heavily investing in ARM-based CPUs, including AWS Graviton 5, to power agentic AI systems.
• Lambda Bare Metal Instances: full hardware control with API-driven operations — Lambda Bare Metal Instances offer direct hardware control and API-driven operations, eliminating hypervisor overhead for AI workloads.
• Startup Boosts Scale-Up to 1000+ GPUs in a Single Domain — Disaggregated server design and software enable resilient, large-scale GPU inference clusters with flexible topologies.
• A Practical Guide to CPU-Optimized LLM Deployment on Intel® Xeon® 6 Processors on AWS. — Intel Xeon 6 processors with vLLM enable cost-effective, high-throughput LLM inference on CPUs.

Open in AIssential →

Editorial summary, takeaway, and curation by AIssential. Original article published by InfoQ.