Nav: Home

Brain appears to have different mechanisms for reconciling sight and sound

March 31, 2016

A new UCLA psychology study provides insights into how the brain combines sound and vision. The research suggests that there is not one sole mechanism in the brain that governs how much our senses work together to process information.

Among the implications of the study: It might not be as easy as many people had assumed to categorize the way in which we perceive and learn.

"We should be cautious not to make blanket statements about how we process information, like 'I'm a visual learner,'" said Ladan Shams, an associate professor of psychology in the UCLA College and senior author of the research. "That's not necessarily true across the board. For example, your brain may combine sights and sounds a lot in one task -- watching TV, for example -- but only a little in another task -- such as playing the piano."

The researchers found that people's vision frequently influenced their hearing when they tried to identify the specific location of sounds and flashes of light, and that their hearing influenced vision when they counted the sounds and flashes.

In one part of the study, 59 participants, mostly UCLA undergraduates, were seated in front of a computer monitor with speakers on either side and asked to count the number of flashes of light on the screen and beeps played on the speakers. Sometimes they only saw flashes, sometimes they only heard beeps and sometimes they both saw flashes and heard beeps -- in which case the numbers could vary, up to four of each. The researchers presented 360 combinations of beeps and flashes in a one-hour period.

"When people have to process different numbers of beeps and flashes, it's really hard -- the senses blend together," said Brian Odegaard, a UCLA postdoctoral scholar who was the study's lead author. "Most people, when presented with two beeps and one flash, mistakenly said they saw two flashes, while a few participants could accurately tease apart lights and sounds."

Shams explained that most people are pretty good at identifying visual stimuli if no other senses are involved, but in the experiment, what participants saw was typically affected by what they heard.

"When there's sound, many people get fooled into thinking that there are fewer or more flashes," she said.

In the second part of the study, subjects were asked to sit facing a black screen, behind which were five speakers. A projector mounted overhead was used to flash bursts of light onto the screen, at the same spots where the speakers were located.

The researchers played brief bursts of sound and triggered flashes of light, in various combinations, and asked participants to identify where they originated. The participants used a computer mouse to point at the part of the screen where they thought the sounds and flashes occurred; each was presented with 525 trials.

When the flash and sound occurred in different locations from each other, most participants struggled to correctly identify where the sound occurred. The effect was similar to what happens when people watch a ventriloquist with a puppet or a magician using misdirection to pull off an illusion, Odegaard said.

Given that the two tasks both involved brief sights and sounds, the researchers figured that the people who were fooled less on one task would be fooled less on the other as well, but the researchers were surprised to find no correlation in how much subjects combined the two senses on the two tasks.

A week later, the participants were given both of the same tasks again. The results were the same --although they performed consistently on each individual task, their abilities to bind the two senses in the two different tests showed no correlation.

The research is published online in Psychological Science, and will be in the journal's April print edition.

People vary in how much their hearing and vision interact, Shams explained. For example, some find it easier to understand someone who is speaking when they are looking at the speaker. Some are better able, when driving, to estimate how fast other vehicles are traveling using both visual and aural cues.

"This finding suggests that if you find a strategy of combining your senses that helps you perform a given task, stick with it," she said.

This study was the first to test the same group of people in both a spatial task and counting task. In future research, Shams and Odegaard hope to discover whether we can learn to modify how our brain combines sounds and sights, and if so, how.
Shams' laboratory is funded by the National Science Foundation (BCS-1057969); this study was also funded by a UCLA Academic Senate Grant.

University of California - Los Angeles

Related Brain Articles:

Scientists predict the areas of the brain to stimulate transitions between different brain states
Using a computer model of the brain, Gustavo Deco, director of the Center for Brain and Cognition, and Josephine Cruzat, a member of his team, together with a group of international collaborators, have developed an innovative method published in Proceedings of the National Academy of Sciences on Sept.
BRAIN Initiative tool may transform how scientists study brain structure and function
Researchers have developed a high-tech support system that can keep a large mammalian brain from rapidly decomposing in the hours after death, enabling study of certain molecular and cellular functions.
Wiring diagram of the brain provides a clearer picture of brain scan data
In a study published today in the journal BRAIN, neuroscientists led by Michael D.
Blue Brain Project releases first-ever digital 3D brain cell atlas
The Blue Brain Cell Atlas is like ''going from hand-drawn maps to Google Earth'' -- providing previously unavailable information on major cell types, numbers and positions in all 737 brain regions.
Landmark study reveals no benefit to costly and risky brain cooling after brain injury
A landmark study, led by Monash University researchers, has definitively found that the practice of cooling the body and brain in patients who have recently received a severe traumatic brain injury, has no impact on the patient's long-term outcome.
More Brain News and Brain Current Events

Best Science Podcasts 2019

We have hand picked the best science podcasts for 2019. Sit back and enjoy new science podcasts updated daily from your favorite science news services and scientists.
Now Playing: TED Radio Hour

Erasing The Stigma
Many of us either cope with mental illness or know someone who does. But we still have a hard time talking about it. This hour, TED speakers explore ways to push past — and even erase — the stigma. Guests include musician and comedian Jordan Raskopoulos, neuroscientist and psychiatrist Thomas Insel, psychiatrist Dixon Chibanda, anxiety and depression researcher Olivia Remes, and entrepreneur Sangu Delle.
Now Playing: Science for the People

#537 Science Journalism, Hold the Hype
Everyone's seen a piece of science getting over-exaggerated in the media. Most people would be quick to blame journalists and big media for getting in wrong. In many cases, you'd be right. But there's other sources of hype in science journalism. and one of them can be found in the humble, and little-known press release. We're talking with Chris Chambers about doing science about science journalism, and where the hype creeps in. Related links: The association between exaggeration in health related science news and academic press releases: retrospective observational study Claims of causality in health news: a randomised trial This...