Illinois research team introduces wearable audio dataset

May 14, 2019

Researchers studying wearable listening technology now have a new data set to use, thanks to University of Illinois at Urbana-Champaign graduate student Ryan Corey and his team.

Debuting at the International Conference on Acoustics, Speech, and Signal Processing (ICASSP) this week, the first-of-its-kind wearable microphone impulse response data set is invaluable to audio research for two reasons: First, the data includes up to 80 microphones instead of the usual two showing how is heard on different parts of the body, and second, the data is available for free under an open-access license.

"We believe hearing aids, smart headphones and all listening devices would work better if they had a lot of microphones, but most products only have two," said Corey. "There isn't data out there for more than that. Even the work that has been done with more didn't include open-access data sets."

The data set consists of more than 8,000 acoustic impulse responses measured at 80 different position on the body. The 80 microphones were tested on five different hat/headphone styles and with six different types of clothing. The sound in the recordings came from 24 different directions to simulate noisy crowds.

The group, including Corey's adviser, Professor Andrew Singer from the Coordinated Science Laboratory (CSL), and former undergraduate student Naoki Tsuda, spent weeks placing 80 microphones all over a mannequin and Corey himself in the CSL Augmented Listening Laboratory. They then recorded acoustic impulse responses to study the acoustics of the body and whether or not clothes plays a difference in how microphones pick up noise. The collected data is used by the team in the paper being presented at ICASSP this week, but they wanted the data to go farther.

"We've been frustrated when trying to use data sets that aren't open," said Corey. "Wearable arrays are important and more people should research it. Having this data out there will make it more convenient to do so."

Future researchers can use the data to simulate wearable microphone arrays with different numbers of microphones at different points on the body. Many humans are already wearing multiple devices with microphones, and this data could help take advantage of that. Engineers can use it to design new products and study performance tradeoffs for different applications. A few of the potential applications for the data include augmented reality, speech recognition, and acoustic event detection, among others. Without the data set created by the CSL team, each researcher would have to build their own prototypes and test them, which is time-consuming and expensive.

The presentation takes place on Tuesday, May 14, in Brighton, UK. Singer, Fox Family Professor in Electrical and Computer Engineering, and Corey hope the presentation will raise awareness of the dataset, encourage others to use it, and give them to opportunity to receive feedback.

"This is the best-attended conference for audio signal processing, so I'll be able to introduce the data set to a lot of researchers who could potentially take advantage of it, build on it, and give us feedback for future improvement," said Corey.
The data set is available under a Creative Commons Attribution License at the University of Illinois Library's Illinois Data Bank archives. Corey also has written about the dataset on the lab's blog.

University of Illinois College of Engineering

Related Acoustics Articles from Brightsurf:

Minor fluctuations in sound make it hard to identify in which concert hall music is played
The volume and timbre of music have a significant impact on how people perceive the acoustics in a concert hall, according to two recent studies carried out by the research group of Aalto University Professor Tapio Lokki.

Acoustics put a fresh spin on electron transitions
Electrons are very much at the mercy of magnetic fields, which scientists can manipulate to control the electrons and their angular momentum -- i.e. their 'spin.'

Two-face god in sound: Directionality beyond spin-directed acoustics
Understanding unidirectional and topological wave phenomena requires the unveiling of intrinsic geometry and symmetry for wave dynamics.

Fish scattering sound waves has impact on aquaculture
Fisheries acoustics have been studied for over 40 years to assess biomass and optimize aquaculture applications, and researchers in France have examined the phenomenon of how fish scatter acoustic waves in a dense school of fish contained in an open-sea cage.

Can 3D-printing musical instruments produce better sound than traditional instruments?
Music is an art, but it is also a science involving vibrating reeds and strings, sound waves and resonances.

Finding meaning in 'Rick and Morty,' one burp at a time
One of the first things viewers of 'Rick and Morty' might notice about Rick is his penchant for punctuating his speech with burps.

Atom music lets listeners experience atomic world through sound
Atoms absorb and release energy in the form of photons that we perceive as different colors, which can be passed through a prism that reveals the atom's spectrum as colored lines.

Ultrasound techniques give warning signs of preterm births
Ultrasound can be used to examine cervix tissue and improve diagnostics, which is essential for predicting preterm births, and ultrasound data is used to compare two techniques for evaluating changes in cervical tissue throughout pregnancy.

Restaurant acoustics that schmeckt
Acoustics consultant Klaus Genuit says that new ISO guidelines for defining, measuring and evaluating soundscapes are a big step forward in guiding the creation of audibly fine restaurants.

How Nigerian music can help you choose a ripe watermelon
The quickest way to decide if a watermelon is ripe or not is by tapping on it.

Read More: Acoustics News and Acoustics Current Events is a participant in the Amazon Services LLC Associates Program, an affiliate advertising program designed to provide a means for sites to earn advertising fees by advertising and linking to