
Artificial intelligence can mimic the biases of their human creators as they make their way into everyday life. The new study, released late Thursday, warns of the potential of abuse and threats to privacy and civil liberties from facial-detection technology.
Matt Wood, general manager of artificial intelligence with Amazon’s cloud-computing unit, said the study uses a “facial analysis” and not “facial recognition” technology. Wood said facial analysis “can spot faces in videos or images and assign generic attributes such as wearing glasses; recognition is a different technique by which an individual face is matched to faces in videos and images.”
In a Friday post on the Medium website, MIT Media Lab researcher Joy Buolamwini responded that companies should check all systems that analyze human faces for bias.
“If you sell one system that has been shown to have bias on human faces, it is doubtful your other face-based products are also completely bias free,” she wrote.
Amazon’s reaction shows that it isn’t taking the “really grave concerns revealed by this study seriously,” said Jacob Snow, an attorney with the American Civil Liberties Union.
Buolamwini and Inioluwa Deborah Raji of the University of Toronto said they studied Amazon’s technology because the company has marketed it to law enforcement. Raji’s LinkedIn account says she is currently a research mentee for artificial intelligence at Google, which competes with Amazon in offering cloud-computing services.
Wood said Amazon has updated its technology since the study and done its own analysis with “zero false positive matches.”
Amazon’s website credits Rekognition for helping the Washington County Sheriff Office in Oregon speed up how long it took to identify suspects from hundreds of thousands of photo records.