China’s Moonshot AI releases Kimi K3, the largest open-source model ever, rivaling top U.S. systems
Summary
Moonshot AI, a Beijing-based startup, released Kimi K3, a 2.8-trillion-parameter model, on July 16, 2026, claiming it as the world's largest open-source AI model. This model, approximately 75 percent larger than DeepSeek's V4 Pro, features a 1-million-token context window, native visual understanding, and an "always-on reasoning mode." Kimi K3 integrates Kimi Delta Attention and Attention Residuals, two internal architectural innovations. Benchmarks show K3 performing comparably to top proprietary systems like Claude Fable 5 Max and GPT-5.6 Sol Max, scoring 1,687 on GDPval-AA v2, 1,527 on AA-Briefcase, and a top score of 91.2 on BrowseComp. It also led in four out of eight real-world task automation benchmarks and achieved a top score of 1,679 on Arena.AI's Frontend Code Arena. The model's API is OpenAI SDK compatible, priced at \$3 per million input tokens and \$15 per million output tokens, with full weights scheduled for release on July 27. Moonshot AI also demonstrated K3's autonomous agent capabilities, including a 48-hour chip design and a 2-hour computational astrophysics calculation.
Key takeaway
For AI Scientists and Machine Learning Engineers evaluating frontier models, Kimi K3's open-source release fundamentally alters the landscape. You should assess its 2.8-trillion-parameter scale and benchmark performance against proprietary alternatives, especially for tasks requiring a 1-million-token context window or autonomous agent capabilities. Consider integrating its OpenAI SDK-compatible API or exploring its full weights post-July 27 for fine-tuning, recognizing the substantial GPU infrastructure required for inference at this scale.
Key insights
Kimi K3 demonstrates open-source models can now rival top proprietary AI systems in scale and performance.
Principles
- Algorithmic efficiency can match raw compute power.
- Raw context length is powerful with strong retrieval.
- Open-sourcing fosters global AI influence.
Method
Kimi K3 utilizes Kimi Delta Attention, a hybrid linear attention mechanism, and Attention Residuals, a drop-in replacement for residual connections, to achieve consistent scaling gains.
In practice
- Explore Kimi K3's 1-million-token context for complex tasks.
- Integrate Kimi K3 via its OpenAI SDK-compatible API.
- Utilize Kimi Code for multi-layered autonomous software projects.
Topics
- Kimi K3
- Open-source LLMs
- Autonomous Agents
- AI Benchmarks
- Attention Mechanisms
- Geopolitics of AI
Code references
Best for: CTO, VP of Engineering/Data, Investor, AI Scientist, Machine Learning Engineer, Director of AI/ML
Related on AIssential
See Counsel's argued verdicts on the open AI decisions leaders are weighing →
Editorial summary, takeaway, and curation by AIssential. Original article published by VentureBeat.