Behind Google’s TPU Ground War to Lure Nvidia’s Most Loyal Customers

· Source: The Information · Field: Technology & Digital — Artificial Intelligence & Machine Learning, Cloud Computing & IT Infrastructure · Depth: Intermediate, quick

Summary

Google is initiating a direct competition, described as a "ground war," with Nvidia in the AI chip market by expanding the availability of its Tensor Processing Units (TPUs). Historically, Google's TPUs were primarily confined to its own facilities and accessible only through Google Cloud. However, Google is now actively marketing these TPUs to emerging cloud providers, termed "neoclouds," which have traditionally focused on developing facilities to rent Nvidia graphics processing units. This strategic shift aims to challenge Nvidia's significant market share, despite Google itself being one of the biggest buyers of Nvidia AI server chips. An example of a neocloud Google recently approached for TPU sales is Nscale.

Key takeaway

For AI Architects evaluating compute infrastructure, Google's move to sell TPUs to neoclouds signals increasing vendor choice beyond Nvidia. You should assess the performance and cost benefits of integrating TPUs into your existing or planned GPU-centric deployments. This shift could diversify your supply chain and potentially reduce reliance on a single vendor for high-performance AI compute.

Key insights

Google is directly challenging Nvidia's AI chip dominance by selling its TPUs to third-party neoclouds.

Principles

Method

Google's sales strategy involves approaching neoclouds, which previously rented Nvidia GPUs, to offer them TPUs for their infrastructure, expanding TPU availability beyond Google Cloud.

In practice

Topics

Best for: CTO, VP of Engineering/Data, Entrepreneur, Director of AI/ML, AI Architect, Investor

Related on AIssential

Open in AIssential →

Editorial summary, takeaway, and curation by AIssential. Original article published by The Information.