What Happened With Bio Anchors?
Summary
Ajeya Cotra's 2020 "Biological Anchors" report, a landmark AI timelines forecast, accurately predicted the scaling hypothesis and the current AI boom, with many of its assumptions proving correct against contemporary challenges. However, its headline prediction of AGI in the 2050s was significantly off, with current discussions ranging from the late 2020s to 2040s. The model's core methodology involved projecting AGI arrival by dividing the estimated FLOPs required for AGI (derived from "Bio Anchors" or human brain compute estimates) by the observed growth rate of available effective FLOPs. The primary error stemmed from a severe underestimation of annual algorithmic progress, which was 200% per year instead of the predicted 30%. This single miscalculation, compounded by other minor errors, shifted the AGI timeline by decades, despite the model's overall structural integrity and prescience in other areas.
Key takeaway
For AI Research Scientists developing long-term AGI forecasts, your models must rigorously account for the exponential and often unpredictable nature of algorithmic progress. While the Bio Anchors model was structurally sound, its underestimation of this single parameter led to a two-decade timeline error. Ensure your sensitivity analyses thoroughly explore the impact of such variables, potentially modeling them as distributions rather than static values, to avoid overconfidence and provide a more realistic range of potential AGI arrival dates.
Key insights
Underestimating algorithmic progress significantly skewed a prominent AI timeline forecast, despite its otherwise accurate premises.
Principles
- Forecasting models are highly sensitive to key parameter estimates.
- Algorithmic progress can accelerate beyond historical trends.
- Transparency about research depth improves model credibility.
Method
The Bio Anchors method estimates AGI timelines by dividing required FLOPs (based on biological analogies) by projected effective FLOPs growth, which combines compute availability and algorithmic efficiency.
In practice
- Prioritize accurate algorithmic progress estimation in AI forecasts.
- Conduct sensitivity analysis on critical model parameters.
- Use real-world data to update and refine growth rate assumptions.
Topics
- AI Timelines
- Biological Anchors Report
- Algorithmic Progress
- Effective Compute
- AGI Forecasting
Best for: AI Researcher, AI Scientist, Research Scientist
Related on AIssential
Editorial summary, takeaway, and curation by AIssential. Original article published by Astral Codex Ten.