Together AI positions open-weight AI models as the enterprise moat for cost, control and IP
Summary
Together AI, a company that recently secured \$800 million in Series C funding at an \$8.3 billion valuation, is positioning open-weight AI models as a critical enterprise moat for cost, control, and intellectual property. CEO Vipul Ved Prakash notes a "stampede" towards these models, with Together AI experiencing a surge from 30 billion tokens/month nine months ago to over 400 trillion tokens/month currently. Enterprises are driven by significant cost differences, ranging from six to 60 times compared to closed models, and the need for data sovereignty and compliance. The ability to run models in customer-controlled environments prevents proprietary data from being used by competitors. Companies are also developing "harnesses" – orchestration loops that allow flexible model swapping with near-zero switching costs, turning open infrastructure into a competitive advantage.
Key takeaway
For AI Architects evaluating enterprise AI infrastructure, prioritizing open-weight models is essential to secure long-term cost advantages and data sovereignty. Your teams should invest in developing AI harnesses to create a flexible, future-proof architecture that protects intellectual property and ensures compliance, rather than relying solely on closed frontier models that pose significant control and cost risks. This approach allows for mixing and matching models while retaining full ownership of AI assets.
Key insights
Open-weight AI models offer enterprises superior cost, control, and IP protection for agentic AI workloads.
Principles
- Data sovereignty is crucial for enterprise AI adoption.
- Cost efficiency scales significantly with open-weight models.
- Harnesses enable flexible, controlled AI deployments.
Method
Enterprises build "harnesses" as orchestration loops to manage AI workloads, allowing seamless swapping of open-weight models, integrating with internal data systems, and ensuring compliance and data residency.
In practice
- Evaluate open-weight models for 6x-60x cost savings.
- Implement AI harnesses for model flexibility and IP control.
- Post-train open models with proprietary data.
Topics
- Open-weight AI Models
- Enterprise AI
- Agentic AI
- AI Infrastructure
- Data Sovereignty
- AI Harnesses
Best for: Investor, CTO, VP of Engineering/Data, Director of AI/ML, AI Architect, Consultant
Related on AIssential
See Counsel's argued verdicts on the open AI decisions leaders are weighing →
Editorial summary, takeaway, and curation by AIssential. Original article published by AI – SiliconANGLE.