Mira Murati’s Thinking Machines drops Inkling, an open-weights model anyone can access
Summary
Mira Murati's Thinking Machines Lab Inc. launched Inkling, its first foundation model, making its full open weights available to developers. This mixture-of-experts model features 975 billion parameters, utilizing about 41 billion per prompt for faster, lower-cost processing. Trained on 45 trillion tokens across text, image, audio, and video, Inkling offers text-only outputs including code and structured data. The model aims to provide a Western open-source alternative to Chinese AI systems, filling a gap exacerbated by Meta's shift to proprietary models. Developed in less than nine months, Inkling was trained on Nvidia's GB300 NVL72 system. It emphasizes accessibility, customization, and multimodal collaboration, allowing developers to fine-tune it via the Tinker API, which launched in October. Inkling achieved 84.7% on financial reasoning benchmarks at less than 10% cost compared to proprietary alternatives.
Key takeaway
For AI Engineers evaluating foundation models, Inkling presents a compelling Western open-weight alternative to proprietary or Chinese systems. You should consider its customizability via Tinker and its multimodal reasoning capabilities to achieve specialized performance at significantly reduced costs. This approach allows you to control infrastructure spend and integrate the model deeply into your software substrate, avoiding compounding switching costs.
Key insights
Open-weight multimodal models like Inkling offer customizable, cost-effective alternatives to proprietary AI systems.
Principles
- Open weights enable deep customization.
- MoE architectures balance speed and cost.
- Base model choice impacts long-term costs.
Method
Thinking Machines developed Inkling as a mixture-of-experts model, trained on 45 trillion multimodal tokens, and offers fine-tuning via its Tinker API, allowing developers to adjust "thinking effort" for speed-accuracy tradeoffs.
In practice
- Fine-tune Inkling on Tinker for tasks.
- Adjust "thinking effort" for speed-accuracy.
Topics
- Inkling
- Open-weight Models
- Mixture-of-Experts
- Multimodal AI
- Tinker API
- Foundation Models
Best for: Machine Learning Engineer, NLP Engineer, CTO, AI Engineer, Director of AI/ML, Tech Journalist
Related on AIssential
See Counsel's argued verdicts on the open AI decisions leaders are weighing →
Editorial summary, takeaway, and curation by AIssential. Original article published by AI – SiliconANGLE.