GitHub Copilot AI token charges to go up 10×–100×
Summary
GitHub Copilot is transitioning to usage-based billing effective June 1st, leading to significant price increases for many users, ranging from 10x to over 100x. Microsoft's Q1 earnings call cited increased Copilot usage and AI investments as factors reducing Microsoft Cloud's gross margin to roughly 64%. This shift reflects the unsustainability of current AI chatbot pricing, with OpenAI reportedly spending \$2.35 for every \$1 of revenue in 2024. While some customers face monthly charges soaring from \$39 to \$5,852, enterprises are considering dropping AI coding tools. Alternatives like running local models can cost up to \$8,750 per month per user for ChatGPT Pro-level performance, indicating the true, unsubsidized cost of AI inference is substantially higher than previous rates.
Key takeaway
For Directors of AI/ML evaluating developer tooling, you should immediately audit your GitHub Copilot usage and projected costs under the new June 1st billing model. The dramatic price increases, potentially 10x-100x, necessitate a re-evaluation of AI agentic coding's ROI and exploration of local model alternatives, despite their current performance limitations, to avoid unexpected budget overruns.
Key insights
AI chatbot services are moving to usage-based pricing, revealing the high, previously subsidized operational costs.
Principles
- AI service pricing will align with actual inference costs.
- Enterprise SaaS models often involve initial subsidies followed by price increases.
In practice
- Evaluate local model performance for enterprise use cases.
- Monitor AI token budgets to manage rising costs.
Topics
- GitHub Copilot
- Usage-Based Billing
- AI Costs
- Enterprise Software
- Local AI Models
- Cloud Gross Margin
Code references
Best for: CTO, VP of Engineering/Data, Investor, Software Engineer, Director of AI/ML, Executive
Related on AIssential
Editorial summary, takeaway, and curation by AIssential. Original article published by Pivot to AI.