North Mini Code - Cohere
Summary
Cohere has released North Mini Code, the inaugural model in its North family of code agent models, under the Apache 2.0 license. This Mixture of Experts model features 30B total parameters with a 3B active parameter footprint, specifically trained for agentic coding. Its compact active size makes it suitable for local deployment, offering competitive performance against larger open-source models on software engineering and terminal-based agentic benchmarks. North Mini Code supports a 256K token context window and 64K max output tokens, and is designed for agentic software engineering, terminal-based agents, local/on-device coding, and general code generation. It is available for production use through Cohere's Model Vault and is free until rate limits are reached for both trial and production keys.
Key takeaway
For AI Engineers evaluating code generation models for local or agentic applications, North Mini Code presents a strong candidate. Its 3B active parameter footprint enables efficient local deployment and low-latency inference, making it ideal for on-device coding. You can integrate this Apache 2.0 licensed model into your software engineering workflows or terminal-based agents, utilizing its competitive performance on benchmarks without immediate cost, as it is free until rate limits are reached.
Key insights
A compact 3B active parameter MoE model excels in agentic coding and local deployment.
Principles
- Small active footprint enables local deployment.
- MoE architecture balances size and performance.
- Training on multiple harnesses improves generalization.
Method
The model is trained against multiple agent harnesses to ensure performance generalizes across various agent scaffolds, rather than being tuned to a single one.
In practice
- Implement repo-level code changes with SWE-Agent.
- Drive shell tools end-to-end for multi-turn tasks.
- Perform low-latency inference on local hardware.
Topics
- Agentic Coding
- Mixture of Experts
- Code Generation
- Local Deployment
- Apache 2.0 License
- Cohere Models
- Terminal Agents
Best for: AI Architect, MLOps Engineer, NLP Engineer, AI Engineer, Machine Learning Engineer, Software Engineer
Related on AIssential
Editorial summary, takeaway, and curation by AIssential. Original article published by cohere.com via Google News.