More Startups Try New Cloud Companies as AWS Faces Heavy Demand

2026-07-14 · Source: The Information · Field: Technology & Digital — Artificial Intelligence & Machine Learning, Cloud Computing & IT Infrastructure · Depth: Fundamental Awareness, quick

Summary

Open-source AI developer Arcee, which committed \$8 million over three years to Amazon Web Services in 2024 for data storage and AI model execution, has encountered significant challenges accessing sufficient Nvidia-powered servers on AWS. Due to this heavy demand on AWS infrastructure, Arcee CEO Mark McQuade stated that the startup is now running the majority of its AI models on alternative cloud providers. These include emerging cloud companies such as Hugging Face and Together, indicating a shift among startups to diversify their cloud infrastructure beyond established giants when critical resources like high-demand GPUs are scarce. This trend highlights the increasing strain on cloud capacity for specialized AI workloads.

Key takeaway

For AI Engineers or Directors of ML planning cloud infrastructure, you should proactively assess GPU availability across multiple cloud providers, not just your primary vendor. The current heavy demand for Nvidia-powered servers on AWS suggests that relying on a single provider for critical AI compute may lead to operational bottlenecks. Diversify your cloud strategy to ensure consistent access to high-demand resources, potentially leveraging specialized upstarts like Hugging Face or Together to avoid project delays.

Key insights

High demand for Nvidia GPUs on AWS is pushing AI startups to diversify cloud providers.

Principles

• Cloud resource scarcity drives provider diversification.
• Specialized hardware access is critical for AI workloads.

In practice

• Evaluate multiple cloud providers for GPU availability.
• Allocate AI workloads across diverse cloud infrastructures.

Topics

• Cloud Computing
• AWS
• NVIDIA GPUs
• AI Infrastructure
• Startup Strategy
• Hugging Face
• Together AI

Best for: CTO, VP of Engineering/Data, AI Architect, Director of AI/ML, AI Engineer, Entrepreneur

Related on AIssential

• Nobody is Immune From the Nvidia GPU Crunch — The Nvidia GPU shortage is forcing startups to find alternative cloud providers and unconventional sourcing methods.
• OpenAI, AWS, NVIDIA and the New AI Deployment Race — Major tech companies are in a fierce competition to deploy AI technologies and infrastructure.
• AWS Raises Prices for Nvidia Compute by 20% — AWS increased AI compute prices by 20% due to the global compute crunch, impacting EC2 Capacity Blocks.
• No Dumb Questions: What is cloud computing and why is everyone doing it? — Cloud computing offers flexibility and scalability by abstracting hardware management to third-party providers.
• Lambda’s multi-cloud blueprint for high-performance AI infrastructure — Multi-cloud AI infrastructure mitigates single-cloud risks, offering flexibility, cost optimization, and compliance for GPU-intensive workloads.
• How GPU Shortages Are Fueling Large Capacity Deals in the AI Cloud Market — Persistent GPU shortages and escalating AI compute demands are driving massive investments in alternative AI infrastructure.

See Counsel's argued verdicts on the open AI decisions leaders are weighing →

Open in AIssential →

Editorial summary, takeaway, and curation by AIssential. Original article published by The Information.