SambaNova Raises $1B, Signs JPMorganChase as a Customer
Summary
SambaNova has secured a \$1 billion oversubscribed funding round, achieving an \$11 billion valuation, led by General Atlantic with participation from Seligman Ventures, T. Rowe Price Associates, Capital Group, and existing investors including Intel Capital, BlackRock, and QIA. This follows a prior \$350 million+ round. CEO Rodrigo Liang attributes the valuation to significant customer growth and the SN50's ability to handle multi-trillion parameter models without quality loss from quantization. The company also announced JPMorganChase as a new customer, deploying SN40 and SN50 systems for secure on-prem AI inference. SambaNova is pursuing a disaggregated inference strategy, demonstrating SN40 chips boosting performance 2x to 3x with Nvidia Blackwell GPUs and Intel Xeon 6 CPUs. A new venture, Vector Core Compute (VC2), backed by Vista Equity Partners and Cambium Capital, placed a \$3.5 billion order for SambaNova RDUs over three years for distributed cloud deployments in urban areas. SambaNova is also collaborating with Intel for efficient interconnects to Xeon CPU racks for agentic AI applications.
Key takeaway
For AI Architects evaluating large model inference solutions, SambaNova's recent funding and customer wins, particularly with JPMorganChase, signal a viable alternative to traditional GPU-centric or cloud-only deployments. You should investigate their SN40/SN50 systems for secure on-prem inference, especially if data privacy is critical. Additionally, explore their disaggregated inference strategy with existing Nvidia GPUs or Intel CPUs to potentially achieve 2x-3x performance improvements and better cost economics for your specific workloads.
Key insights
SambaNova secures significant funding and customers by addressing large model inference needs through high-capacity hardware and flexible deployment strategies.
Principles
- Large AI models require substantial memory capacity to maintain quality.
- Enterprise customers prioritize secure, on-prem inference for data privacy.
- Disaggregated inference architectures can enhance performance and cost-efficiency.
Method
SambaNova deploys SN40/SN50 systems in large clusters, supports disaggregated inference with Nvidia GPUs and Intel CPUs, and offers on-prem solutions for data privacy and security.
In practice
- Consider SN40/SN50 systems for multi-trillion parameter model inference.
- Explore disaggregated inference with SN40 and Nvidia GPUs for 2x-3x performance gains.
- Implement SambaNova's on-prem clusters for secure, air-cooled enterprise AI.
Topics
- AI Hardware
- AI Inference
- Enterprise AI
- Disaggregated Architectures
- Venture Capital Funding
- On-Premise AI
Best for: CTO, VP of Engineering/Data, Executive, Investor, Director of AI/ML, AI Architect
Related on AIssential
Editorial summary, takeaway, and curation by AIssential. Original article published by Big Data & AI News - EE Times.