Virtual reality technology opens new doors of (spatial) perception

May 09, 2018

WASHINGTON, D.C., May 9, 2018 -- We rely on our ears to tell us where sounds -- from the chirp of a bird to the call of your name in a crowd -- are coming from. Locating and discriminating sound sources is extremely complex because the brain has to process spatial information from many, sometimes conflicting, cues. Using virtual reality and other immersive technologies, researchers are able to use new methods to investigate how we make sense of the word with sound.

"These technologies allow us to bring the real world into the lab and, ultimately, the lab into the real world," said G. Christopher Stecker, associate professor of hearing and speech sciences at Vanderbilt University. Stecker uses these immersive tools to probe auditory spatial awareness in naturalistic, yet controlled settings. He foresees that these technologies will yield improved hearing aids, more accurate diagnoses of auditory disorders, and video games with richer sound experiences.

This 360-degree view helps us direct our attention to where sounds originate -- crucial for navigating the environment to avoid danger, like detecting an oncoming car.

At the 175th Meeting of the Acoustical Society of America, held May 7-11, 2018, in Minneapolis, Minnesota, Stecker will survey his team's use of virtual reality and augmented auditory reality to study how people use explicit and implicit sound cues.

In an ongoing study, subjects wear head-mounted displays, immersing them in a parklike setting, and are told to turn their heads in the direction they hear sound. In the background, doctoral student Travis Moore manipulates two essential locational cues. The first is a difference in time -- measured in millionths of a second -- when sound waves reach each ear. The other is the difference in sound pressure levels registered in each ear.

Consistent with earlier work, Moore has found considerable variability in how much weight subjects' brains assign to each cue. "This is an important step because we really don't know how this process of integrating two cues plays out in real-world listening tasks," Stecker said.

Another ongoing study, meant to simulate a busy cocktail party, looks at how differences in acoustics and the resultant differences in sound qualities, echoes and reverberations influence spatial awareness. "In the ear, there's a very clear representation of sound frequency and intensity, or loudness, but place has to be computed by the brain," Stecker said. "The ear doesn't know where things are. The brain figures it out."

Stecker imagines that studies examining these more implicit aspects of spatial awareness could lead to augmented reality devices that remotely render realistic virtual versions of people. "Consider a chat with your grandmother," Stecker said. "This kind of technology could make it look and sound as if she were sitting on the couch across from you. To achieve that on the sound side, we will need to make the acoustics of that simulation indistinguishable from the real world."
-end-
Presentation 3aAA1 "Validating auditory spatial awareness with virtual reality and vice-versa," by G. Christopher Stecker, is at 8:55 a.m. CDT, May 9, 2018, in room Nicollet C at the Hyatt Regency Minneapolis.

MORE MEETING INFORMATION

The 175th Meeting of the Acoustical Society of America

The meeting is being held May 7-11, 2018, in Minneapolis, Minnesota.

USEFUL LINKS

Main meeting website: http://acousticalsociety.org/asa-meetings/

Technical program: http://acousticalsociety.org/program-of-175th-meeting-of-the-acoustical-society-of-america/

Meeting/Hotel site: http://acousticalsociety.org/asa-meetings/

Press Room: http://acoustics.org/world-wide-press-room/

WORLD WIDE PRESS ROOM

In the coming weeks, ASA's Worldwide Press Room will be updated with additional tips on dozens of newsworthy stories and with lay language papers, which are 300- to 500-word summaries of presentations written by scientists for a general audience and accompanied by photos, audio and video. You can visit the site during the meeting at http://acoustics.org/current-meeting/.

PRESS REGISTRATION

We will grant free registration to credentialed journalists and professional freelance journalists. If you are a reporter and would like to attend, contact Emilie Lorditch (elorditc@aip.org, 301-209-3029), who can also help with setting up interviews and obtaining images, sound clips or background information.

LIVE MEDIA WEBCAST

A press briefing featuring a selection of newsworthy research will be webcast live from the conference on Tuesday, May 8, 2018; register at http://aipwebcasting.com/webcast/registration/518asa.php to watch online. Topics and times to be announced.

ABOUT THE ACOUSTICAL SOCIETY OF AMERICA

The Acoustical Society of America (ASA) is the premier international scientific society in acoustics devoted to the science and technology of sound. Its 7,000 members worldwide represent a broad spectrum of the study of acoustics. ASA publications include The Journal of the Acoustical Society of America (the world's leading journal on acoustics), Acoustics Today magazine, books, and standards on acoustics. The society also holds two major scientific meetings each year. For more information about ASA, visit our website at http://www.acousticalsociety.org.

Acoustical Society of America

Related Brain Articles from Brightsurf:

Glioblastoma nanomedicine crosses into brain in mice, eradicates recurring brain cancer
A new synthetic protein nanoparticle capable of slipping past the nearly impermeable blood-brain barrier in mice could deliver cancer-killing drugs directly to malignant brain tumors, new research from the University of Michigan shows.

Children with asymptomatic brain bleeds as newborns show normal brain development at age 2
A study by UNC researchers finds that neurodevelopmental scores and gray matter volumes at age two years did not differ between children who had MRI-confirmed asymptomatic subdural hemorrhages when they were neonates, compared to children with no history of subdural hemorrhage.

New model of human brain 'conversations' could inform research on brain disease, cognition
A team of Indiana University neuroscientists has built a new model of human brain networks that sheds light on how the brain functions.

Human brain size gene triggers bigger brain in monkeys
Dresden and Japanese researchers show that a human-specific gene causes a larger neocortex in the common marmoset, a non-human primate.

Unique insight into development of the human brain: Model of the early embryonic brain
Stem cell researchers from the University of Copenhagen have designed a model of an early embryonic brain.

An optical brain-to-brain interface supports information exchange for locomotion control
Chinese researchers established an optical BtBI that supports rapid information transmission for precise locomotion control, thus providing a proof-of-principle demonstration of fast BtBI for real-time behavioral control.

Transplanting human nerve cells into a mouse brain reveals how they wire into brain circuits
A team of researchers led by Pierre Vanderhaeghen and Vincent Bonin (VIB-KU Leuven, Université libre de Bruxelles and NERF) showed how human nerve cells can develop at their own pace, and form highly precise connections with the surrounding mouse brain cells.

Brain scans reveal how the human brain compensates when one hemisphere is removed
Researchers studying six adults who had one of their brain hemispheres removed during childhood to reduce epileptic seizures found that the remaining half of the brain formed unusually strong connections between different functional brain networks, which potentially help the body to function as if the brain were intact.

Alcohol byproduct contributes to brain chemistry changes in specific brain regions
Study of mouse models provides clear implications for new targets to treat alcohol use disorder and fetal alcohol syndrome.

Scientists predict the areas of the brain to stimulate transitions between different brain states
Using a computer model of the brain, Gustavo Deco, director of the Center for Brain and Cognition, and Josephine Cruzat, a member of his team, together with a group of international collaborators, have developed an innovative method published in Proceedings of the National Academy of Sciences on Sept.

Read More: Brain News and Brain Current Events
Brightsurf.com is a participant in the Amazon Services LLC Associates Program, an affiliate advertising program designed to provide a means for sites to earn advertising fees by advertising and linking to Amazon.com.