Nav: Home

Sound waves bypass visual limitations to recognize human activity

May 28, 2019

WASHINGTON, D.C., May 28, 2019 -- Video cameras continue to gain widespread use to monitor human activities for surveillance, health care, home use and more, but there are privacy and environmental limitations in how well they work. Acoustical waves, such as sounds and other forms of vibrations, are an alternative medium that may bypass those limitations.

Unlike electromagnetic waves, such as those used in radar, acoustical waves can be used not only to find objects but also to identify them. As described in a new paper in the May 28 issue of Applied Physics Letters, from AIP Publishing, the researchers used a two-dimensional acoustic array and convolutional neural networks to detect and analyze the sounds of human activity and identify those activities.

"If the identification accuracy is high enough, a large number of applications could be implemented," said Xinhua Guo, associate professor at Wuhan University of Technology. "For example, a medical alarm system could be activated if a person falls at home and it is detected. Thus, immediate help could be provided and with little privacy leaked at the same time."

By using a two-dimensional acoustic array with 256 receivers and four ultrasonic transmitters, the researchers were able to gather data related to four different human activities -- sitting, standing, walking and falling. They used a 40-kilohertz signal to bypass any potential contamination from ordinary room noise and distinguish it from the identifying sounds.

Their tests achieved an overall accuracy of 97.5% for time-domain data and 100% for frequency-domain data. The scientists also tested arrays with fewer receivers (eight and four) and found them to produce results with lower accuracy of the human activity.

Guo said acoustic systems are a better detection device than vision-based systems because of the lack of widespread acceptance of cameras due to privacy issues. In addition, low lighting or smoke can also hamper vision recognition, but sound waves are not affected by those special environmental situations.

"In future, we will go on studying complex activity and situation of random positioning," Guo said. "As we know, human activities are complicated, taking falling as an example, and can present in various postures. We are hoping to collect more datasets of falling activity to reach higher accuracy."

Guo said they will be experimenting with various numbers of sensors and their effectiveness in detecting and determining human activities. He said there is an optimal number for the array that would make this viable for commercial and personal use in homes and buildings.
The article, "A single feature for human activity recognition using two-dimensional acoustic array," is authored by Xinhua Guo, Rongcheng Su, Chaoyue Hu, Xiaodong Ye, Huachun Wu and Kentaro Nakamura. The article will appear in Applied Physics Letters on May 28, 2019 (DOI: 10.1063/1.5096572). After that date, it can be accessed at


Applied Physics Letters features concise, rapid reports on significant new findings in applied physics. The journal covers new experimental and theoretical research on applications of physics phenomena related to all branches of science, engineering, and modern technology.

American Institute of Physics

Related Sound Waves Articles:

Cooling magnets with sound
Today, most quantum experiments are carried out with the help of light, including those in nanomechanics, where tiny objects are cooled with electromagnetic waves to such an extent that they reveal quantum properties.
Fish scattering sound waves has impact on aquaculture
Fisheries acoustics have been studied for over 40 years to assess biomass and optimize aquaculture applications, and researchers in France have examined the phenomenon of how fish scatter acoustic waves in a dense school of fish contained in an open-sea cage.
Using sound waves to remotely target drugs to tumors
The lack of a clinically viable method to track and direct cancer drugs to tumors is a big problem for targeted therapeutics.
Sound waves bypass visual limitations to recognize human activity
Video cameras continue to gain widespread use, but there are privacy and environmental limitations in how well they work.
It's a one-way street for sound waves in this new technology
Imagine being able to hear people whispering in the next room, while the raucous party in your own room is inaudible to the whisperers.
'Meta-mirror' reflects sound waves in any direction
Researchers at Duke University have constructed a 'meta-mirror' device capable of perfectly reflecting sound waves in any direction.
A study by the UC3M researches the limits of topological insulators using sound waves
Research in which the Universidad Carlos III de Madrid (UC3M) is taking part analyses the future of topological insulators using sound waves, meaning materials that behave like acoustic insulators in their interior, but at the same time allow the movement of sound waves at their surface.
KU Leuven researchers use sound waves to prevent small chemical reactors from clogging up
Companies are keen to use miniature chemical reactors to make pharmaceuticals and fine chemicals, but are discouraged by their tendency to clog up.
Revealing hidden information in sound waves
By essentially turning down the pitch of sound waves, University of Michigan engineering researchers have devised a way to unlock greater amounts of data from acoustic fields than ever before.
Stop -- hey, what's that sound?
In a new study, researchers were able to see where in the brain, and how quickly -- in milliseconds -- the brain's neurons transition from processing the sound of speech to processing the language-based words of the speech.
More Sound Waves News and Sound Waves Current Events

Trending Science News

Current Coronavirus (COVID-19) News

Top Science Podcasts

We have hand picked the top science podcasts of 2020.
Now Playing: TED Radio Hour

Teaching For Better Humans 2.0
More than test scores or good grades–what do kids need for the future? This hour, TED speakers explore how to help children grow into better humans, both during and after this time of crisis. Guests include educators Richard Culatta and Liz Kleinrock, psychologist Thomas Curran, and writer Jacqueline Woodson.
Now Playing: Science for the People

#556 The Power of Friendship
It's 2020 and times are tough. Maybe some of us are learning about social distancing the hard way. Maybe we just are all a little anxious. No matter what, we could probably use a friend. But what is a friend, exactly? And why do we need them so much? This week host Bethany Brookshire speaks with Lydia Denworth, author of the new book "Friendship: The Evolution, Biology, and Extraordinary Power of Life's Fundamental Bond". This episode is hosted by Bethany Brookshire, science writer from Science News.
Now Playing: Radiolab

One of the most consistent questions we get at the show is from parents who want to know which episodes are kid-friendly and which aren't. So today, we're releasing a separate feed, Radiolab for Kids. To kick it off, we're rerunning an all-time favorite episode: Space. In the 60's, space exploration was an American obsession. This hour, we chart the path from romance to increasing cynicism. We begin with Ann Druyan, widow of Carl Sagan, with a story about the Voyager expedition, true love, and a golden record that travels through space. And astrophysicist Neil de Grasse Tyson explains the Coepernican Principle, and just how insignificant we are. Support Radiolab today at