The AI Data Centers That Fit on a Truck
Summary
Companies like Duos Edge AI and LG CNS are addressing the slow deployment of AI hardware by adopting modular data centers, which are pre-fabricated, self-contained units that can be deployed in months rather than years. Duos Edge AI's compute pods are 55 feet long and 12.5 feet wide, designed for truck transport, and contain racks of GPUs. Duos recently partnered with Hydra Host to deploy four pods, totaling 2,304 GPUs, with an option to double to 4,608 GPUs, featuring upgrades like liquid cooling for intense AI workloads. Similarly, LG CNS has unveiled its AI Modular Data Center, also containing 576 Nvidia GPUs per unit, with plans to support over 4,600 GPUs in a single unit and deploy up to 50 units in Busan. This modular approach, also pursued by HPE, Vertiv, and Schneider Electric, simplifies site preparation to a concrete pad and offers faster deployment times and potentially lower costs per megawatt, with the market projected to more than double by 2030.
Key takeaway
For CTOs and VPs of Engineering evaluating AI infrastructure, modular data centers offer a compelling solution to accelerate GPU deployment. Your teams can achieve operational readiness in months, not years, by leveraging pre-fabricated units that simplify site preparation and scale incrementally. This approach mitigates delays from traditional data center construction and can provide cost efficiencies, especially for smaller or rapidly expanding AI initiatives.
Key insights
Modular data centers accelerate AI hardware deployment by using pre-fabricated, scalable units.
Principles
- Modular design enables rapid scaling.
- Off-site fabrication reduces on-site complexity.
Method
Deploy pre-fabricated compute pods and power modules on a concrete pad, then network them with redundant fiber connections for unified operation, reducing deployment time to months.
In practice
- Consider modular units for rapid GPU cluster deployment.
- Utilize liquid cooling for high-density AI workloads.
Topics
- Modular Data Centers
- AI Hardware Deployment
- GPU Infrastructure
- Liquid Cooling
- Duos Edge AI
Best for: CTO, VP of Engineering/Data, Entrepreneur, AI Architect, MLOps Engineer, Director of AI/ML
Related on AIssential
Editorial summary, takeaway, and curation by AIssential. Original article published by IEEE Spectrum.