UN Experts Sound Alarm Over AI-enhanced Racial Profiling
Mohammad Ali (@ChaudhryMAli88) Published November 26, 2020 | 05:03 PM
Countries must do more to combat racial profiling, UN rights experts said Thursday, warning that artificial intelligence programmes like facial recognition and predictive policing risked reinforcing the harmful practice
Geneva, (APP - UrduPoint / Pakistan Point News - 26th Nov, 2020 ) :Countries must do more to combat racial profiling, UN rights experts said Thursday, warning that artificial intelligence programmes like facial recognition and predictive policing risked reinforcing the harmful practice.
Racial profiling is not new but the technologies once seen as tools for bringing more objectivity and fairness to policing appear in many places to be making the problem worse.
"There is a great risk that (AI technologies will) reproduce and reinforce biases and aggravate or lead to discriminatory practices," Jamaican human rights expert Verene Shepherd told AFP.
She is one of the 18 independent experts who make up the UN Committee on the Elimination of Racial Discrimination (CERD), which on Thursday published guidance on how countries worldwide should work to end racial profiling by law enforcement.
The committee, which monitors compliance by 182 signatory countries to the International Convention on the Elimination of All Forms of Racial Discrimination, raised particular concern over the use of AI algorithms for so-called "predictive policing" and "risk assessment".
The systems have been touted to help make better use of limited police budgets, but research suggests it can increase deployments to communities which have already been identified, rightly or wrongly, as high-crime zones.
"Historical arrest data about a neighbourhood may reflect racially biased policing practices," Shepherd warned.
"Such data will deepen the risk of over-policing in the same neighbourhood, which in turn may lead to more arrests, creating a dangerous feedback loop." When artificial intelligence and algorithms use biased historical data, their profiling predictions will reflect that.
"Bad data in, bad results out," Shepherd said.
"We are concerned about what goes into making those assumptions and those predictions." The CERD recommendations also take issue with the growing use of facial recognition and surveillance technologies in policing.
Shepherd said the committee had received a number of complaints about misidentification by such technologies, sometimes with dire consequences, but did not provide specific examples.
The issue came to the forefront with the wrongful arrest in Detroit earlier this year of an African American man, Robert Williams, based on a flawed algorithm which identified him as a robbery suspect.
Various studies show facial recognition systems developed in Western countries are far less accurate in distinguishing darker-skinned faces, perhaps because they rely on databases containing more white, male faces.
"We have had complaints of such misidentification because of where the technologies are coming from, who is making them, and what samples they have in their system," Shepherd said.
"It is a real concern." CERD is calling for countries to regulate private companies that develop, sell or operate algorithmic profiling systems for law enforcement.
Countries have a responsibility to ensure that such systems comply with international human rights law, it said, stressing the importance of transparency in design and application.
The committee insisted the public should be informed when such systems are being used and told how they work, what data sets are being used and what safeguards are in place to prevent rights abuses.
The recommendations meanwhile go beyond the impact of new technologies, urging countries to introduce laws against all forms of racial discrimination by law enforcement.
"Racial profiling precedes these technologies," Shepherd said.
She said 2020 -- a year marked by surging racial tensions in many parts of the world -- was a good time to present the new guidelines.
The committee, she said, "hopes that the intensification and globalisation of Black Lives Matter ... and other campaigns calling for attention to discrimination against certain vulnerable groups will help (underline) the importance of the recommendations."
Recent Stories
Pre-Order Your Coolest vivo Y100 Today
SC suspends PHC ruling against allocation of SIC reserved seats
ADB reaffirms continued support to Pakistan
OIC Contact Group on Jammu & Kashmir calls for early resolution of J&K dispute
Yango joins hands with Discover Pakistan to present and preserve the country’s ..
Saudi govt, companies consider Pakistan high priority economic opportunity: Ibra ..
Saudi Crown Prince expected to visit Pakistan this month
Currency Rate In Pakistan - Dollar, Euro, Pound, Riyal Rates On 6 May 2024
Today Gold Rate in Pakistan 06 May 2024
Dubai Mum Becomes the First Ever Pakistani Woman to Climb 11 of the 14 Highest M ..
Over 37% Tobacco tax increase suggested to save lives, boost revenue
Mohsin Naqvi has offered a substantial incentive, pledging $100,000 to every pla ..
More Stories From World
-
'Sound of silence' for troubled Milan as Juve inch towards Champions League
1 hour ago -
Pakistan's sesame seeds export to China increases nearly 29% in Q1 2024
1 hour ago -
Belgium's far right struggles to break through media ban
1 hour ago -
Military-ruled Chad votes for president in bloody transition
1 hour ago -
Mbappe and PSG aim to seize moment in Champions League semi-final
2 hours ago -
Israel army says about 100,000 people being evacuated from east Rafah
2 hours ago
-
Putin orders nuclear drills with troops near Ukraine
2 hours ago -
China's Shenzhen home to more superchargers than petrol stations
2 hours ago -
Ode to joy: How Austria shaped Beethoven's Ninth
2 hours ago -
Lebanon's Hezbollah says fired dozens of rockets at Israeli base
2 hours ago -
China to expedite building modern eco-environment monitoring system
3 hours ago -
Putin orders nuclear drills with troops near Ukraine
3 hours ago