- Amy Schumer addresses her ‘Growing’ pains in new Netflix special 6 Months Ago
- This Bitcoin tie is everyone’s favorite part of the Theranos documentary Today 1:56 PM
- Trump’s social media guru gets suspended on Facebook Today 1:51 PM
- YouTube time traveler says he saw a dinosaur—in the future Today 1:47 PM
- Why is Netflix changing the viewing order for ‘Love, Death & Robots’? Today 12:47 PM
- Elizabeth Holmes’ deep voice captivates and confuses the internet Today 12:40 PM
- These cat purses have everything you need (including balls) Today 12:22 PM
- Smooth dude gets girl’s number with a ‘choose your own adventure’ RPG on Tinder Today 12:20 PM
- Beto O’Rourke reportedly pranked his wife with a ‘verdant turd’ Today 12:13 PM
- The Disney-Fox deal is finalized Today 12:08 PM
- Beto likes to stand on counters—and there are memes to prove it Today 10:47 AM
- House promises April vote on bill to restore net neutrality rules Today 9:58 AM
- Here’s how many YouTube subscribers Shane Dawson lost for his old bestiality joke Today 9:26 AM
- Drag queen spreads joy to toddler, world with ‘Baby Shark’ performance Today 9:21 AM
- How many ‘chuggas’ should come before choo choo? Today 9:10 AM
Report: NYPD helped IBM secretly develop technology that identifies people by skin color
Ervins Strauhmanis/Flickr (CC-BY)
The NYPD has stopped using the technology.
According to confidential documents obtained by the Intercept, IBM has developed object recognition technology capable of identifying people by physical characteristics like skin color with help from the New York Police Department.
With secret access to NYPD-captured videos, IBM developed this technology to allow police to search camera footage for persons with a specific hair color, facial hair type, or skin color, the Intercept reports. The development of this technology dates back to 2012, when counterterrorism officials gained access to skin color-searching capabilities.
NYPD spokesperson Peter Donald said that this feature was only ever used “for evaluation purposes” and when a test version of the tech was available. The NYPD focused its testing on other parameters like clothing colors or characteristics in order to avoid potential allegations of racial profiling. The organization eventually decided against using IBM’s analytics in its surveillance efforts and stopped using the technology in 2016. When approached with an updated version that could identify people by ethnicity around that time, NYPD rejected the product.
Still, the developmental partnership was kept secret, and the technology was developed without public consent, which privacy and civil liberties advocates found concerning.
The potential for facial and object recognition technology to be used (or abused) by police enforcement has been a growing concern of citizens, privacy advocates, and tech company employees. Earlier this year, it came to light that law enforcement agencies had begun testing pilots with Amazon Rekognition, the company’s cloud-based facial recognition technology.
In a damning test meant to highlight the technology’s potential for racial bias, the American Civil Liberties Union used Rekognition on photos of Congress members. It misidentified 28 of the legislators, primarily Black and Latino, as criminals. Amazon said, however, that the ACLU used the technology in an unusual way and not with optimal settings in place.
Amazon workers have since protested against the technology being used by law enforcement arms such as Immigrations and Customs Enforcement.
Former IBM researcher Rick Kjeldsen told the Intercept that IBM’s technology was originally destined for self-driving cars or for use on the internet, but following 9/11, the company realized it had potential in the counterterrorism space. The technology originally focused on object recognition specifically but was later honed to identify persons by age, “head color,” gender, and skin color. Some of the IBM researchers had qualms about the technology if its accuracy improved in the future.
NYPD told the Intercept that its collaboration with IBM was about “finding a way to shorten the time to catch the bad people” after a crime. IBM did not respond to the Intercept’s questions about the collaboration or why it wasn’t made public knowledge.
Read the Intercept’s full report here.
Christina Bonnington is a tech reporter who specializes in consumer gadgets, apps, and the trends shaping the technology industry. Her work has also appeared in Gizmodo, Wired, Refinery29, Slate, Bicycling, and Outside Magazine. She is based in the San Francisco Bay Area and has a background in electrical engineering.