Nav: Home

Brain appears to have different mechanisms for reconciling sight and sound

March 31, 2016

A new UCLA psychology study provides insights into how the brain combines sound and vision. The research suggests that there is not one sole mechanism in the brain that governs how much our senses work together to process information.

Among the implications of the study: It might not be as easy as many people had assumed to categorize the way in which we perceive and learn.

"We should be cautious not to make blanket statements about how we process information, like 'I'm a visual learner,'" said Ladan Shams, an associate professor of psychology in the UCLA College and senior author of the research. "That's not necessarily true across the board. For example, your brain may combine sights and sounds a lot in one task -- watching TV, for example -- but only a little in another task -- such as playing the piano."

The researchers found that people's vision frequently influenced their hearing when they tried to identify the specific location of sounds and flashes of light, and that their hearing influenced vision when they counted the sounds and flashes.

In one part of the study, 59 participants, mostly UCLA undergraduates, were seated in front of a computer monitor with speakers on either side and asked to count the number of flashes of light on the screen and beeps played on the speakers. Sometimes they only saw flashes, sometimes they only heard beeps and sometimes they both saw flashes and heard beeps -- in which case the numbers could vary, up to four of each. The researchers presented 360 combinations of beeps and flashes in a one-hour period.

"When people have to process different numbers of beeps and flashes, it's really hard -- the senses blend together," said Brian Odegaard, a UCLA postdoctoral scholar who was the study's lead author. "Most people, when presented with two beeps and one flash, mistakenly said they saw two flashes, while a few participants could accurately tease apart lights and sounds."

Shams explained that most people are pretty good at identifying visual stimuli if no other senses are involved, but in the experiment, what participants saw was typically affected by what they heard.

"When there's sound, many people get fooled into thinking that there are fewer or more flashes," she said.

In the second part of the study, subjects were asked to sit facing a black screen, behind which were five speakers. A projector mounted overhead was used to flash bursts of light onto the screen, at the same spots where the speakers were located.

The researchers played brief bursts of sound and triggered flashes of light, in various combinations, and asked participants to identify where they originated. The participants used a computer mouse to point at the part of the screen where they thought the sounds and flashes occurred; each was presented with 525 trials.

When the flash and sound occurred in different locations from each other, most participants struggled to correctly identify where the sound occurred. The effect was similar to what happens when people watch a ventriloquist with a puppet or a magician using misdirection to pull off an illusion, Odegaard said.

Given that the two tasks both involved brief sights and sounds, the researchers figured that the people who were fooled less on one task would be fooled less on the other as well, but the researchers were surprised to find no correlation in how much subjects combined the two senses on the two tasks.

A week later, the participants were given both of the same tasks again. The results were the same --although they performed consistently on each individual task, their abilities to bind the two senses in the two different tests showed no correlation.

The research is published online in Psychological Science, and will be in the journal's April print edition.

People vary in how much their hearing and vision interact, Shams explained. For example, some find it easier to understand someone who is speaking when they are looking at the speaker. Some are better able, when driving, to estimate how fast other vehicles are traveling using both visual and aural cues.

"This finding suggests that if you find a strategy of combining your senses that helps you perform a given task, stick with it," she said.

This study was the first to test the same group of people in both a spatial task and counting task. In future research, Shams and Odegaard hope to discover whether we can learn to modify how our brain combines sounds and sights, and if so, how.
Shams' laboratory is funded by the National Science Foundation (BCS-1057969); this study was also funded by a UCLA Academic Senate Grant.

University of California - Los Angeles

Related Brain Articles:

Transplanting human nerve cells into a mouse brain reveals how they wire into brain circuits
A team of researchers led by Pierre Vanderhaeghen and Vincent Bonin (VIB-KU Leuven, Université libre de Bruxelles and NERF) showed how human nerve cells can develop at their own pace, and form highly precise connections with the surrounding mouse brain cells.
Brain scans reveal how the human brain compensates when one hemisphere is removed
Researchers studying six adults who had one of their brain hemispheres removed during childhood to reduce epileptic seizures found that the remaining half of the brain formed unusually strong connections between different functional brain networks, which potentially help the body to function as if the brain were intact.
Alcohol byproduct contributes to brain chemistry changes in specific brain regions
Study of mouse models provides clear implications for new targets to treat alcohol use disorder and fetal alcohol syndrome.
Scientists predict the areas of the brain to stimulate transitions between different brain states
Using a computer model of the brain, Gustavo Deco, director of the Center for Brain and Cognition, and Josephine Cruzat, a member of his team, together with a group of international collaborators, have developed an innovative method published in Proceedings of the National Academy of Sciences on Sept.
BRAIN Initiative tool may transform how scientists study brain structure and function
Researchers have developed a high-tech support system that can keep a large mammalian brain from rapidly decomposing in the hours after death, enabling study of certain molecular and cellular functions.
Wiring diagram of the brain provides a clearer picture of brain scan data
In a study published today in the journal BRAIN, neuroscientists led by Michael D.
Blue Brain Project releases first-ever digital 3D brain cell atlas
The Blue Brain Cell Atlas is like ''going from hand-drawn maps to Google Earth'' -- providing previously unavailable information on major cell types, numbers and positions in all 737 brain regions.
Landmark study reveals no benefit to costly and risky brain cooling after brain injury
A landmark study, led by Monash University researchers, has definitively found that the practice of cooling the body and brain in patients who have recently received a severe traumatic brain injury, has no impact on the patient's long-term outcome.
Brain cells called astrocytes have unexpected role in brain 'plasticity'
Researchers from the Salk Institute have shown that astrocytes -- long-overlooked supportive cells in the brain -- help to enable the brain's plasticity, a new role for astrocytes that was not previously known.
Largest brain study of 62,454 scans identifies drivers of brain aging
In the largest known brain imaging study, scientists from Amen Clinics (Costa Mesa, CA), Google, John's Hopkins University, University of California, Los Angeles and the University of California, San Francisco evaluated 62,454 brain SPECT (single photon emission computed tomography) scans of more than 30,000 individuals from 9 months old to 105 years of age to investigate factors that accelerate brain aging.
More Brain News and Brain Current Events

Trending Science News

Current Coronavirus (COVID-19) News

Top Science Podcasts

We have hand picked the top science podcasts of 2020.
Now Playing: TED Radio Hour

Listen Again: Reinvention
Change is hard, but it's also an opportunity to discover and reimagine what you thought you knew. From our economy, to music, to even ourselves–this hour TED speakers explore the power of reinvention. Guests include OK Go lead singer Damian Kulash Jr., former college gymnastics coach Valorie Kondos Field, Stockton Mayor Michael Tubbs, and entrepreneur Nick Hanauer.
Now Playing: Science for the People

#562 Superbug to Bedside
By now we're all good and scared about antibiotic resistance, one of the many things coming to get us all. But there's good news, sort of. News antibiotics are coming out! How do they get tested? What does that kind of a trial look like and how does it happen? Host Bethany Brookeshire talks with Matt McCarthy, author of "Superbugs: The Race to Stop an Epidemic", about the ins and outs of testing a new antibiotic in the hospital.
Now Playing: Radiolab

Dispatch 6: Strange Times
Covid has disrupted the most basic routines of our days and nights. But in the middle of a conversation about how to fight the virus, we find a place impervious to the stalled plans and frenetic demands of the outside world. It's a very different kind of front line, where urgent work means moving slow, and time is marked out in tiny pre-planned steps. Then, on a walk through the woods, we consider how the tempo of our lives affects our minds and discover how the beats of biology shape our bodies. This episode was produced with help from Molly Webster and Tracie Hunte. Support Radiolab today at