The Metaculus Democracy Threat Index

2026-01-16 · Source: Astral Codex Ten · Field: Government & Public Sector — Public Policy & Governance, Social Sciences & Behavioral Studies, Research Methodology & Innovation · Depth: Intermediate, medium

Summary

The Metaculus Democracy Threat Index is a new tool designed to objectively measure the health of American democracy, addressing concerns about bias in traditional indices. Developed by Metaculus, a prediction site, it aggregates crowdsourced forecasts from 153 specific questions related to US democratic processes. Unlike expert-driven methods, this index offers transparency and leverages "superforecasting" to provide granular probability estimates for potential threats, such as a 3.5% chance of a nominee being blocked from a state ballot in 2026. While it mitigates expert bias, potential risks include susceptibility to crowd attacks, though Metaculus employs security measures like median aggregation, and question selector bias from the nonpartisan group Bright Line Watch. Historical data points from 2021-2024 are less reliable due to retrospective question design, but forecaster opinions from 2025 suggest a stable outlook, with predicted threats decreasing from a peak of 47% in late 2025 to 39%.

Key takeaway

For policy makers or research scientists evaluating democracy indices, the Metaculus Democracy Threat Index offers a transparent, crowdsourced alternative to expert-driven models. You should consider its probabilistic approach for finer-grained threat assessments, but be aware of potential question selector biases. Actively engaging with or replicating its forecasting methodology on platforms like Polymarket could enhance its robustness and your confidence in its long-term utility.

Key insights

The Metaculus Democracy Threat Index uses crowdsourced probabilistic forecasts to objectively measure US democracy's health.

Principles

• Crowdsourced predictions can reduce expert bias.
• Forecasting platforms offer granular threat probabilities.
• Index value increases with time, reducing initial question bias.

Method

The Metaculus Democracy Threat Index aggregates forecasts from 153 specific questions about US democracy using a recency-weighted median algorithm. It distinguishes between probabilities of events, not just binary outcomes.

In practice

• Participate in Metaculus forecasting for \$10,000 prizes.
• Consider conditional prediction markets for election outcomes.
• Evaluate index reliability based on question stability over time.

Topics

• Metaculus
• Democracy Index
• Prediction Markets
• Superforecasting
• US Politics
• Crowdsourcing
• Bright Line Watch

Best for: Research Scientist, Policy Maker, Consultant

Related on AIssential

• The Illusion of Certainty: Why PR’s Obsession with “Cold Data” Is Costing Us True Trust — PR's over-reliance on "cold data" misses real-time sentiment; informal intelligence is crucial for true trust.
• Meta pours $65 million into state elections to back AI-friendly politicians — Meta is investing heavily in state elections to shape AI regulation and support AI-friendly politicians.
• METR’s Joel Becker on exponential Time Horizon Evals, Threat Models, and the Limits of AI Productivity — META evaluates AI capabilities and propensities against threat models to assess societal risks and track continuous progress.
• Carissa Véliz on the dangers of predictive AI — Predictive AI, designed for surveillance and prediction, risks social control and perpetuates historical biases, undermining democracy and fairness.
• Recommend and manipulate: the dangers of the attention economy — Recommender systems, optimized for attention, inadvertently amplify extreme content and enable mass manipulation by exploiting user data and filter bubbles.
• Democratization — True AI democratization requires redistributing models and governance, not just compute, to avoid digital colonialism.

Open in AIssential →

Editorial summary, takeaway, and curation by AIssential. Original article published by Astral Codex Ten.