New tool improves fairness of online search rankings

August 18, 2020

ITHACA, N.Y. - When you search for something on the internet, do you scroll through page after page of suggestions - or pick from the first few choices?

Because most people choose from the tops of these lists, they rarely see the vast majority of the options, creating a potential for bias in everything from hiring to media exposure to e-commerce.

In a new paper, Cornell University researchers introduce a tool they've developed to improve the fairness of online rankings without sacrificing their usefulness or relevance.

"If you could examine all your choices equally and then decide what to pick, that may be considered ideal. But since we can't do that, rankings become a crucial interface to navigate these choices," said computer science doctoral student Ashudeep Singh, co-first author of "Controlling Fairness and Bias in Dynamic Learning-to-Rank," which won the Best Paper Award at the Association for Computing Machinery SIGIR Conference on Research and Development in Information Retrieval.

"For example, many YouTubers will post videos of the same recipe, but some of them get seen way more than others, even though they might be very similar," Singh said. "And this happens because of the way search results are presented to us. We generally go down the ranking linearly and our attention drops off fast."

The researchers' method, called FairCo, gives roughly equal exposure to equally relevant choices and avoids preferential treatment for items that are already high on the list. This can correct the unfairness inherent in existing algorithms, which can exacerbate inequality and political polarization, and curtail personal choice.

"What ranking systems do is they allocate exposure. So how do we make sure that everybody receives their fair share of exposure?" said Thorsten Joachims, professor of computer science and information science, and the paper's senior author. "What constitutes fairness is probably very different in, say, an e-commerce system and a system that ranks resumes for a job opening. We came up with computational tools that let you specify fairness criteria, as well as the algorithm that will provably enforce them."

Algorithms seek the most relevant items to searchers, but because the vast majority of people choose one of the first few items in a list, small differences in relevance can lead to huge discrepancies in exposure. For example, if 51% of the readers of a news publication prefer opinion pieces that skew conservative, and 49% prefer essays that are more liberal, all of the top stories highlighted on the home page could conceivably lean conservative, according to the paper.

"When small differences in relevance lead to one side being amplified, that often causes polarization, where some people tend to dominate the conversation and other opinions get dropped without their fair share of attention," Joachims said. "You might want to use it in an e-commerce system to make sure that if you're producing a product that 30% of people like, you're getting a certain amount of exposure based on that. Or if you have a resume database, you could formulate safeguards to make sure it's not discriminating by race or gender."
-end-
The research was partly supported by the National Science Foundation and by Workday.

Cornell University

Related Lead Articles from Brightsurf:

Lead-free magnetic perovskites
Scientists at Linköping University, Sweden, working with the perovskite family of materials have taken a step forwards and developed an optoelectronic magnetic double perovskite.

Researchers devise new method to get the lead out
Researchers in the lab of Daniel Giammar, in McKelvey School of Engineering have devised a simple, quick and inexpensive way to quantify how much lead is trapped by a water filter.

Preventing lead poisoning at the source
Using a variety of public records, researchers from Case Western Reserve University examined every rental property in Cleveland from 2016-18 on factors related to the likelihood that the property could have lead-safety problems.

Silicones may lead to cell death
Silicone molecules from breast implants can initiate processes in human cells that lead to cell death.

Poor diet can lead to blindness
An extreme case of 'fussy' or 'picky' eating caused a young patient's blindness, according to a new case report published today [2 Sep 2019] in Annals of Internal Medicine.

What's more powerful, word-of-mouth or following someone else's lead?
Researchers from the University of Pittsburgh, UCLA and the University of Texas published new research in the INFORMS journal Marketing Science, that reveals the power of word-of-mouth in social learning, even when compared to the power of following the example of someone we trust or admire.

UTI discovery may lead to new treatments
Sufferers of recurring urinary tract infections (UTIs) could expect more effective treatments thanks to University of Queensland-led research.

Increasing frailty may lead to death
A new study published in Age and Ageing indicates that frail patients in any age group are more likely to die than those who are not frail.

Discovery could lead to munitions that go further, much faster
Researchers from the U.S. Army and top universities discovered a new way to get more energy out of energetic materials containing aluminum, common in battlefield systems, by igniting aluminum micron powders coated with graphene oxide.

Shorter sleep can lead to dehydration
Adults who sleep just six hours per night -- as opposed to eight -- may have a higher chance of being dehydrated, according to a study by Penn State.

Read More: Lead News and Lead Current Events
Brightsurf.com is a participant in the Amazon Services LLC Associates Program, an affiliate advertising program designed to provide a means for sites to earn advertising fees by advertising and linking to Amazon.com.