Should French pollsters be using Mister P?

· Source: Statistical Modeling, Causal Inference, and Social Science · Field: Science & Research — Mathematics & Computational Sciences, Social Sciences & Behavioral Studies · Depth: Advanced, quick

Summary

An anonymous French statistics student developed a poll aggregator and applied it to the last 100 days of the past five French presidential elections (2002-2022). The student utilized a Kalman-RTS smoothing algorithm with cross-validated noise levels, developed by Aki Vehtari, and validated it on simulated data. The smoothed results, derived from Wikipedia pages of French polls, are publicly available along with the code. Analysis of the plots reveals periodic opinion movements, potentially due to non-response, and surprisingly large shifts in candidate support (e.g., 10% in under 100 days). The student advocates for the adoption of Multilevel Regression and Poststratification (MRP) in French polling, citing the industry's current practice of manually adjusting final results by one point based on "pifomètre" (nosemeter) and the potential for MRP to enable predictions for legislative and municipal elections, which are currently neglected due to cost and complexity with quota sampling.

Key takeaway

For French pollsters seeking to modernize their methodology and expand their predictive capabilities, adopting Multilevel Regression and Poststratification (MRP) is crucial. This shift would eliminate subjective "pifomètre" adjustments and enable accurate forecasting for legislative and municipal elections, which are currently too difficult and expensive with traditional quota sampling. Your organization should investigate integrating MRP to enhance data integrity and broaden market reach.

Key insights

MRP offers a robust alternative to traditional French polling methods, addressing issues like manual adjustments and limited scope.

Principles

Method

The student applied a Kalman-RTS smoothing algorithm with cross-validated noise levels to raw poll data, then used the smoothed results to analyze trends and advocate for MRP.

In practice

Topics

Best for: Data Scientist, Research Scientist, AI Student

Related on AIssential

Open in AIssential →

Editorial summary, takeaway, and curation by AIssential. Original article published by Statistical Modeling, Causal Inference, and Social Science.