Law enforcement agencies across the UK successfully lobbied to use a facial recognition system known to be biased against females, young people, and individuals from minority ethnic backgrounds, after complaining that a more accurate version generated fewer potential suspects.
British police utilize the police national database (PND) to conduct searches using historical face recognition. This process involves matching a “probe image” of a person of interest against a repository of more than 19 million mugshots to find possible hits.
The UK interior ministry admitted last week that the technology was flawed. This acknowledgment followed a study by the National Physical Laboratory (NPL) found it incorrectly matched people of Black and Asian heritage and females at significantly higher rates than Caucasian males. The Home Office stated it “had acted on the findings”.
“This raises the issue of whether this technology only becomes useful if users tolerate discrimination in ethnicity and gender. Convenience is a weak argument for disregarding basic freedoms.”
Official papers show that this bias has been known about for more than a year. Furthermore, law enforcement argued to overturn an earlier ruling that was designed to address the problem.
Police bosses were notified of the system's bias in late 2024. The Home Office-commissioned laboratory study concluded the system was more likely to produce incorrect matches for images depicting women, individuals of Black ethnicity, and those aged 40 and under.
In response, the national police leadership body ordered that the accuracy setting required for potential matches be increased to a level where the disparity was significantly reduced.
However, this decision was reversed the next month following complaints from police that the adjusted system was generating fewer “investigative leads”. NPCC documents show the stricter setting reduced the number of searches resulting in potential matches from over half to a just under 15%.
Although the Home Office and NPCC refused to say what threshold is now in operation, the latest independent review discovered the system could generate false positives for women of Black heritage almost 100 times more frequently than for Caucasian women at certain settings.
The ministry commented on these findings: “The testing found that in a limited set of circumstances the algorithm is more likely to incorrectly include some demographic groups in its search results.”
Outlining the effect of the brief increase to the system's accuracy setting, the NPCC documents state: “The change greatly lessens the impact of discrimination across protected characteristics of ethnicity, age and sex but had a significant negative impact on operational effectiveness”. The documents add that forces complained that “a once effective tactic returned results of questionable value”.
Meanwhile, the government has launched a two-and-a-half-month consultation on its proposals to expand the use of biometric scanning systems. Policing minister the relevant minister has described the tool as the “biggest breakthrough since genetic fingerprinting”.
Abimbola Johnson, chair of the advisory panel for the police race action plan, commented: “We observed scant discussion through equality strategy sessions of the technology deployment even with obvious cross-over with the plan’s concerns.
“These revelations demonstrate once again that the pledges to combat discrimination the police has made via the equality initiative are not being translated into wider practice. Our reports have warned that new technologies are being implemented in a context where ethnic inequalities, weak scrutiny and faulty information gathering continue to exist.
“Any use of facial recognition must adhere to strict national standards, be subject to external review, and prove it diminishes rather than exacerbates ethnic bias.”
A government representative stated: “The Home Office treat the conclusions of the study seriously and we have implemented changes. A new algorithm has been externally evaluated and procured, which has no statistically significant bias. It will be trialled in the coming months and will be undergo further assessment.
“The foremost aim is ensuring public safety. This revolutionary tool will support officers to put criminals and rapists behind bars. There is officer review in each stage of the process and no further action would be taken without trained officers meticulously examining the output.”
Lena is a digital design expert with over a decade of experience in UI/UX and creative technology, passionate about sharing innovative design solutions.