Nav: Home

The (extra) eyes have it

June 21, 2017

Your doctor is an expert with many years of experience. So when she tells you, upon reviewing all the fancy tomographic imaging you had done, that the tenderness in your breast is just some minor irritation, you want to believe her and leave it at that.

But is she right?

According to researchers at UC Santa Barbara a second pair of eyes studying those same images looks to be more beneficial than previously thought when searching for hard-to-find objects in a "noisy" field -- especially when that searcher is under time pressure and other constraints. The scientists' findings, detailed in the paper "The Wisdom of Crowds for Visual Search," are published in the Proceedings of the National Academy of Sciences.

"We show that the benefits in having more people do the task will be larger when individuals cannot exhaustively search the entire image," said Mordechai Juni, a postdoctoral researcher in UCSB's Department of Psychological & Brain Sciences and lead author of the study conducted with Professor Miguel Eckstein. In a fast-paced world with increasing amounts of visual information -- closed-circuit TV, geospatial imaging and medical tomography, to name a few -- tapping into the wisdom of crowds might be especially useful. Each individual is unlikely to look at all regions of all images.

The study builds on a longstanding concept that the aggregated answers of a large group of people are usually more accurate than the response of a single expert. A classic example occurred at an English county fair in 1907, when the averaged estimates of a crowd of people vying to guess the weight of an ox came closer than those of each individual entry, including those of cattle experts.

"It appears then, in this particular instance, that the vox populi is correct to within one per cent of the real value," concluded Sir Francis Galton, who conducted that study.

The benefit of the "wisdom of crowds" has been found in human judgments in the domains of estimation, detection (where the location of the target is familiar), identification and prediction. However, until now, the value of that phenomenon with regard to visual search had not been well studied.

In this preliminary work, the researchers used an eye-tracking device to record the visual scan paths of a group of undergraduate students. They did so first with a search task (requiring a yes or no response to the presence of a hard-to-find object anywhere on a field), then a single-location task (requiring a yes or no response to the presence of a hard-to-detect object in a fixed and known position on a field). Their results demonstrated that the aggregated responses -- weighted with the observers' confidence -- in the search task showed better than expected performance compared to the single-location task.

"In the single-location task, all observers are looking at the exact location where the hard-to-detect object might be, and so they are all processing the same visual information," said Juni. "But in the search task, observers' scan paths take different patterns, and those who happen to gaze directly at the hard-to-find object tend to be highly confident that it is present -- because the object is easy to detect when fixated -- whereas those who do not gaze directly at the object tend to respond that it is absent, because the object is very difficult to detect in the visual periphery."

The greater benefits for the search task, Juni explained, are "dependent on tapping into the very high confidence of those in the group who happened to gaze directly at the object."

In this search scenario, the researchers say, the 'wisdom of crowds' is more nuanced than simple majority voting, which is highly effective in single-location tasks when the relevant information is present and accessible to all.

"As long as there's some element of individual knowledge that we could tap into, you could do really well, and maybe even close to optimal in terms of the group performance," Juni said. He cited Condorcet's jury theorem, which indicates that if voters are more likely than not to give correct answers individually, the chance of collectively arriving at the correct answer via majority voting increases with group size.

But, in scenarios where individuals are more likely than not to give incorrect answers (due to, say, erroneous or lack of information), increasing group size might be detrimental for majority voting as even experts who tend to give correct answers will be swept away with the minority.

In many real-world scenarios where visual search is employed, the tendency toward error is present, whether it's lack of time to perform exhaustive searches, lack of resolution in the images, too large a search field or too many images to search through. Think: search-and-rescue of planes downed in the ocean, military surveillance during times of conflict, or physicians dealing with an exponential rise in the number of images per exam.

"In those cases, majority voting would be ineffective, whereas the averaged responses of a group of observers could be very beneficial if those who happen to gaze directly at the searched-for-object express very high confidence that they found it," Juni said.

"The next step is to verify and see if this actually happens with the large data volumes of modern 3D medical image technology," said Eckstein. The results might raise questions over how medical diagnoses are made in the U.S. and other countries that do not typically perform multiple independent readings to find, say, breast cancer as they do in much of Europe, Australia and New Zealand. According to the researchers, combining responses from multiple readings with technologies that generate many images per exam could result in considerable gains.

"We think some of this work could potentially cause us to rethink how we should do it in the U.S. for newer 3D imaging technologies," Juni said.

University of California - Santa Barbara

Related Breast Cancer Articles:

Does MRI plus mammography improve detection of new breast cancer after breast conservation therapy?
A new article published by JAMA Oncology compares outcomes for combined mammography and MRI or ultrasonography screenings for new breast cancers in women who have previously undergone breast conservation surgery and radiotherapy for breast cancer initially diagnosed at 50 or younger.
Blood test offers improved breast cancer detection tool to reduce use of breast biopsy
A Clinical Breast Cancer study demonstrates Videssa Breast can inform better next steps after abnormal mammogram results and potentially reduce biopsies up to 67 percent.
Surgery to remove unaffected breast in early breast cancer increases
The proportion of women in the United States undergoing surgery for early-stage breast cancer who have preventive mastectomy to remove the unaffected breast increased significantly in recent years, particularly among younger women, and varied substantially across states.
Breast cancer patients with dense breast tissue more likely to develop contralateral disease
Breast cancer patients with dense breast tissue have almost a two-fold increased risk of developing disease in the contralateral breast, according to new research from The University of Texas MD Anderson Cancer.
Some early breast cancer patients benefit more from breast conservation than from mastectomy
Breast conserving therapy (BCT) is better than mastectomy for patients with some types of early breast cancer, according to results from the largest study to date, presented at ECC2017.
One-third of breast cancer patients not getting appropriate breast imaging follow-up exam
An annual mammogram is recommended after treatment for breast cancer, but nearly one-third of women diagnosed with breast cancer aren't receiving this follow-up exam, according to new findings presented at the 2016 Annual Clinical Congress of the American College of Surgeons.
Low breast density worsens prognosis in breast cancer
Even though dense breast tissue is a risk factor for breast cancer, very low mammographic breast density is associated with a worse prognosis in breast cancer patients.
Is breast conserving therapy or mastectomy better for early breast cancer?
Young women with early breast cancer face a difficult choice about whether to opt for a mastectomy or breast conserving therapy (BCT).
Breast density and outcomes of supplemental breast cancer screening
In a study appearing in the April 26 issue of JAMA, Elizabeth A.
Full dose radiotherapy to whole breast may not be needed in early breast cancer
Five years after breast-conserving surgery, radiotherapy focused around the tumor bed is as good at preventing recurrence as irradiating the whole breast, with fewer side effects, researchers from the UK have found in the large IMPORT LOW trial.

Related Breast Cancer Reading:

Best Science Podcasts 2019

We have hand picked the best science podcasts for 2019. Sit back and enjoy new science podcasts updated daily from your favorite science news services and scientists.
Now Playing: TED Radio Hour

Digital Manipulation
Technology has reshaped our lives in amazing ways. But at what cost? This hour, TED speakers reveal how what we see, read, believe — even how we vote — can be manipulated by the technology we use. Guests include journalist Carole Cadwalladr, consumer advocate Finn Myrstad, writer and marketing professor Scott Galloway, behavioral designer Nir Eyal, and computer graphics researcher Doug Roble.
Now Playing: Science for the People

#529 Do You Really Want to Find Out Who's Your Daddy?
At least some of you by now have probably spit into a tube and mailed it off to find out who your closest relatives are, where you might be from, and what terrible diseases might await you. But what exactly did you find out? And what did you give away? In this live panel at Awesome Con we bring in science writer Tina Saey to talk about all her DNA testing, and bioethicist Debra Mathews, to determine whether Tina should have done it at all. Related links: What FamilyTreeDNA sharing genetic data with police means for you Crime solvers embraced...