Essex police pause facial recognition camera use after study finds racial bias

· Source: AI (artificial intelligence) | The Guardian · Field: Technology & Digital — Artificial Intelligence & Machine Learning, Public Safety & Security, Public Policy & Governance · Depth: Intermediate, short

Summary

Essex police have suspended their use of live facial recognition (LFR) technology following a study by University of Cambridge academics that identified racial bias. The study, which involved 188 actors, found LFR cameras were "statistically significantly more likely to correctly identify black participants than participants from other ethnic groups," despite overall high accuracy for watchlist identifications and rare incorrect identifications. The Information Commissioner’s Office (ICO) revealed the pause, warning other forces to implement mitigations. This issue differs from concerns about misidentifying innocent people, such as a recent case where a man was arrested for a burglary 100 miles away due to retrospective face scanning software error. The government plans to increase LFR van availability five-fold, with 50 vans for every police force in England and Wales.

Key takeaway

For police forces and technology leaders deploying AI-enabled surveillance, this incident highlights the critical need for rigorous, independent bias testing before and during operational use. Your teams should proactively commission academic studies or third-party audits to identify and mitigate demographic biases in LFR systems. Ensure policies and procedures are revised based on these findings, and continuously monitor results to prevent disproportionate targeting of any community section, safeguarding public trust and legal compliance.

Key insights

Racial bias in live facial recognition systems can lead to disproportionate identification of specific ethnic groups.

Principles

Method

Academics deployed LFR cameras from marked police vans and observed 188 actors walking past to assess identification accuracy and demographic bias, publishing results to inform policy.

In practice

Topics

Best for: CTO, VP of Engineering/Data, Director of AI/ML, AI Ethicist, Policy Maker, AI Operations Specialist

Related on AIssential

Open in AIssential →

Editorial summary, takeaway, and curation by AIssential. Original article published by AI (artificial intelligence) | The Guardian.