Nav: Home

Facial recognition software has a gender problem

October 29, 2019

With a brief glance at a single face, emerging facial recognition software can now categorize the gender of many men and women with remarkable accuracy.

But if that face belongs to a transgender person, such systems get it wrong more than one third of the time, according to new University of Colorado Boulder research.

"We found that facial analysis services performed consistently worse on transgender individuals, and were universally unable to classify non-binary genders," said lead author Morgan Klaus Scheuerman, a PhD student in the Information Science department. "While there are many different types of people out there, these systems have an extremely limited view of what gender looks like."

The study comes at a time when facial analysis technologies - which use hidden cameras to assess and characterize certain features about an individual - are becoming increasingly prevalent, embedded in everything from smartphone dating apps and digital kiosks at malls to airport security and law enforcement surveillance systems.

Previous research suggests they tend to be most accurate when assessing the gender of white men, but misidentify women of color as much as one-third of the time.

"We knew there were inherent biases in these systems around race and ethnicity and we suspected there would also be problems around gender," said senior author Jed Brubaker, an assistant professor of Information Science. "We set out to test this in the real world."

Researchers collected 2,450 images of faces from Instagram, each of which had been labeled by its owner with a hashtag indicating their gender identity. The pictures were then divided into seven groups of 350 images (#women, #man, #transwoman, #transman, #agender, #agenderqueer, #nonbinary) and analyzed by four of the largest providers of facial analysis services (IBM, Amazon, Microsoft and Clarifai).

Notably, Google was not included because it does not offer gender recognition services.

On average, the systems were most accurate with photos of cisgender women (those born female and identifying as female), getting their gender right 98.3% of the time. They categorized cisgender men accurately 97.6% of the time.

But trans men were wrongly identified as women up to 38% of the time.

And those who identified as agender, genderqueer or nonbinary - indicating that they identify as neither male or female - were mischaracterized 100 percent of the time.

"These systems don't know any other language but male or female, so for many gender identities it is not possible for them to be correct," says Brubaker.

The study also suggests that such services identify gender based on outdated stereotypes.

When Scheuerman, who is male and has long hair, submitted his own picture, half categorized him as female.

The researchers could not get access to the training data, or image inputs used to "teach" the system what male and female looks like, but previous research suggests they assess things like eye position, lip fullness, hair length and even clothing.

"These systems run the risk of reinforcing stereotypes of what you should look like if you want to be recognized as a man or a woman. And that impacts everyone," said Scheuerman.

The market for facial recognition services is projected to double by 2024, as tech developers work to improve human-robot interaction and more carefully target ads to shoppers. Already, Brubaker notes, people engage with facial recognition technology every day to gain access to their smartphones or log into their computers.

If it has a tendency to misgender certain, already vulnerable, populations that could have grave consequences.

For instance, a match-making app could set someone up on a date with the wrong gender, leading to a potentially dangerous situation. Or a mismatch between the gender a facial recognition program sees and the documentation a person carries could lead to problems getting through airport security, says Scheuerman.

He is most concerned that such systems reaffirm notions that transgender people don't fit in.

"People think of computer vision as futuristic, but there are lots of people who could be left out of this so-called future," he said.

The authors say they'd like to see tech companies move away from gender classification entirely and stick to more specific labels like "long hair" or "make-up" when assessing images.

"When you walk down the street you might look at someone and presume that you know what their gender is, but that is a really quaint idea from the '90s and it is not what the world is like anymore," said Brubaker. "As our vision and our cultural understanding of what gender is has evolved. The algorithms driving our technological future have not. That's deeply problematic."
-end-
The research will be presented in November at the ACM Conference on Computer Supported Cooperative Work in Austin, Texas.

University of Colorado at Boulder

Related Airport Security Articles:

Focus on food security and sustainability
The number of malnourished people is increasing worldwide. More than two billion people suffer from a lack of micronutrients.
Researchers reveal ultra-fast bomb detection method that could upgrade airport security
Researchers from the University of Surrey have revealed a new ultra-fast method to detect materials that could be used to build explosives.
Eliminating infamous security threats
Speculative memory side-channel attacks like Meltdown and Spectre are security vulnerabilities in computers.
UBC study: Publicizing a firm's security levels may strengthen security over time
New research from the UBC Sauder School of Business has quantified the security levels of more than 1,200 Pan-Asian companies in order to determine whether increased awareness of one's security levels leads to improved defense levels against cybercrime.
Optimizing airport flight patterns take a toll on human health
Health costs associated with noise from changing flight patterns over populated urban landscapes far outweigh the benefits of reduced flight times, according to a new study.
The cause of low-level turbulence around Hong Kong International Airport
The occurrence of low-level turbulence around Hong Kong International Airport, which can influence the landing and departure of aircraft and is closely related to aviation safety, is an important topic of study.
Shh! Proven security for your secrets
Researchers show the security of their cipher based on chaos theory.
A library for food security
Researchers are uncovering the genome of cowpeas, also known as black-eyed peas, in response to challenging growing conditions and the need for food security.
Bring your own (security) disaster
Bring your own device (BYOD) to work is common practice these days.
Satellites, airport visibility readings shed light on troops' exposure to air pollution
Veterans Affairs researchers and colleagues are looking to satellites and airport visibility readings to learn about hazardous air conditions facing deployed troops.
More Airport Security News and Airport Security Current Events

Trending Science News

Current Coronavirus (COVID-19) News

Top Science Podcasts

We have hand picked the top science podcasts of 2020.
Now Playing: TED Radio Hour

Clint Smith
The killing of George Floyd by a police officer has sparked massive protests nationwide. This hour, writer and scholar Clint Smith reflects on this moment, through conversation, letters, and poetry.
Now Playing: Science for the People

#562 Superbug to Bedside
By now we're all good and scared about antibiotic resistance, one of the many things coming to get us all. But there's good news, sort of. News antibiotics are coming out! How do they get tested? What does that kind of a trial look like and how does it happen? Host Bethany Brookeshire talks with Matt McCarthy, author of "Superbugs: The Race to Stop an Epidemic", about the ins and outs of testing a new antibiotic in the hospital.
Now Playing: Radiolab

Dispatch 6: Strange Times
Covid has disrupted the most basic routines of our days and nights. But in the middle of a conversation about how to fight the virus, we find a place impervious to the stalled plans and frenetic demands of the outside world. It's a very different kind of front line, where urgent work means moving slow, and time is marked out in tiny pre-planned steps. Then, on a walk through the woods, we consider how the tempo of our lives affects our minds and discover how the beats of biology shape our bodies. This episode was produced with help from Molly Webster and Tracie Hunte. Support Radiolab today at Radiolab.org/donate.