No, Bayes does not like Mayor Pete. (Pitfalls of using implied betting market odds to estimate electability.)
Summary
A 2019 analysis critically examines economist Greg Mankiw's method of using Predictit betting market odds and Bayes' Theorem to estimate 2020 US presidential candidate electability. Mankiw's initial calculation, based on April 27, 2019 data, indicated Mayor Pete Buttigieg had an 0.80 probability of winning the general election if nominated, with Joe Biden at 0.77. The critique highlights several issues with interpreting these odds as true probabilities. These include potential market bias, exemplified by Andrew Yang's 9% nomination contract price despite 0.8% polling. Significant volatility was also noted, with Biden's calculated electability shifting from 0.77 to 0.68 and Warren's from 0.44 to 0.68 between April 27 and June 12. Additionally, the sum of all candidate prices on Predictit exceeded 100%, suggesting market prices are not direct probabilities due to factors like the "vig." A re-evaluation using June 2019 data found Buttigieg's electability at 0.56, making him the least electable among the three, contradicting Mankiw's original finding.
Key takeaway
For data scientists or research scientists analyzing political prediction markets, you must critically evaluate raw odds. Do not directly interpret market prices as true probabilities without accounting for inherent biases, significant volatility, and market mechanics like the "vig" and rounding. Your models should incorporate adjustments for these factors, especially with early or thin market data, to avoid drawing misleading conclusions about candidate electability or other outcomes.
Key insights
Prediction market odds require careful scrutiny before direct interpretation as true probabilities.
Principles
- Betting market prices are not direct probabilities.
- Market thinness introduces significant noise.
- Early prediction market data is highly volatile.
In practice
- Scrutinize prediction market data for bias.
- Account for market volatility in analysis.
Topics
- Prediction Markets
- Bayesian Inference
- Election Forecasting
- Market Bias
- Data Volatility
- Predictit
Best for: Data Scientist, Research Scientist
Related on AIssential
Editorial summary, takeaway, and curation by AIssential. Original article published by Statistical Modeling, Causal Inference, and Social Science.