Essex police pause facial recognition camera use after study finds racial bias
Summary
Essex police have suspended their use of live facial recognition (LFR) technology following a study by University of Cambridge academics that identified racial bias. The study, which involved 188 actors, found LFR cameras were "statistically significantly more likely to correctly identify black participants than participants from other ethnic groups," despite overall high accuracy for watchlist identifications and rare incorrect identifications. The Information Commissioner’s Office (ICO) revealed the pause, warning other forces to implement mitigations. This issue differs from concerns about misidentifying innocent people, such as a recent case where a man was arrested for a burglary 100 miles away due to retrospective face scanning software error. The government plans to increase LFR van availability five-fold, with 50 vans for every police force in England and Wales.
Key takeaway
For police forces and technology leaders deploying AI-enabled surveillance, this incident highlights the critical need for rigorous, independent bias testing before and during operational use. Your teams should proactively commission academic studies or third-party audits to identify and mitigate demographic biases in LFR systems. Ensure policies and procedures are revised based on these findings, and continuously monitor results to prevent disproportionate targeting of any community section, safeguarding public trust and legal compliance.
Key insights
Racial bias in live facial recognition systems can lead to disproportionate identification of specific ethnic groups.
Principles
- Bias in AI systems requires continuous monitoring.
- Algorithm overtraining can cause demographic bias.
Method
Academics deployed LFR cameras from marked police vans and observed 188 actors walking past to assess identification accuracy and demographic bias, publishing results to inform policy.
In practice
- Adjust system settings to rectify algorithm overtraining.
- Review LFR policies and procedures for bias risks.
Topics
- Live Facial Recognition
- Algorithmic Bias
- Racial Bias
- Police Technology
- AI Ethics
Best for: CTO, VP of Engineering/Data, Director of AI/ML, AI Ethicist, Policy Maker, AI Operations Specialist
Related on AIssential
Editorial summary, takeaway, and curation by AIssential. Original article published by AI (artificial intelligence) | The Guardian.