Law enforcement agencies across the UK effectively campaigned to use a face scanning system known to be biased against women, young people, and individuals from minority ethnic backgrounds, following complaints that a less biased version produced a reduced number of potential suspects.
British police use the national police database to conduct searches using historical face recognition. This procedure entails comparing a “probe image” of a suspect against a repository of over 19 million mugshots to identify potential matches.
The UK interior ministry conceded last week that the system was biased. This acknowledgment came after a study by the government's National Physical Laboratory found it incorrectly matched Black and Asian people and women at significantly higher rates than white men. The ministry stated it “had acted on the findings”.
“This raises the issue of whether facial recognition only becomes useful if users accept biases in ethnicity and sex. Operational ease is a poor argument for disregarding fundamental rights.”
Internal documents show that this discriminatory flaw has been recognized for over twelve months. Furthermore, police forces lobbied to reverse an earlier ruling that was designed to address the problem.
Police bosses were informed of the system's bias in late 2024. The government-ordered laboratory study found the system was more likely to suggest false positives for photos of women, Black people, and those under 40 years old.
In response, the national police leadership body mandated that the confidence threshold required for potential matches be raised to a level where the bias was greatly diminished.
However, this directive was overturned the next month after forces complained that the modified technology was producing fewer “useful lines of inquiry”. NPCC documents show the higher threshold reduced the number of searches resulting in potential matches from 56% to a just under 15%.
Although the authorities declined to specify what setting is now in operation, the recent independent review discovered the system could produce incorrect matches for Black women nearly a hundred times more frequently than for Caucasian women at specific configurations.
The Home Office commented on these results: “Our evaluation identified that in a limited set of circumstances the software is more likely to wrongly flag some demographic groups in its match reports.”
Outlining the effect of the temporary raise to the system's confidence threshold, the NPCC documents state: “This adjustment significantly reduces the impact of discrimination across protected characteristics of ethnicity, generation and gender but had a significant negative impact on operational effectiveness”. The documents further note that police units argued that “a once effective tactic now delivered outcomes of limited benefit”.
Meanwhile, the UK administration has launched a two-and-a-half-month consultation on its plans to expand the use of facial recognition technology. The minister for police the relevant minister has described the tool as the “most significant advance since DNA matching”.
Abimbola Johnson, chair of the independent scrutiny and oversight board for the national policing equality strategy, said: “There was very little discussion in race action plan meetings of the facial recognition rollout even with clear relevance with the strategy's goals.
“These revelations demonstrate once again that the anti-racism commitments the police has undertaken through the equality initiative are not being translated into wider practice. Our reports have cautioned that innovative tools are being implemented in a context where racial disparities, weak scrutiny and faulty information gathering continue to exist.
“Any use of this technology must meet rigorous official guidelines, be subject to external review, and prove it reduces rather than exacerbates racial disparity.”
A government representative said: “We treat the conclusions of the report seriously and we have already taken action. A new algorithm has been externally evaluated and procured, which has demonstrated no measurable discrimination. It will be trialled early next year and will be subject to evaluation.
“The foremost aim is ensuring public safety. This revolutionary tool will support officers to put criminals and rapists behind bars. There is officer review in each stage of the procedure and no arrest or charge would be taken without trained officers carefully reviewing the output.”
A tech journalist and digital strategist with over a decade of experience covering AI, cybersecurity, and startup ecosystems across Europe.