Nav: Home

Object identification and interaction with a smartphone knock

October 02, 2019

A KAIST team has featured a new technology, "Knocker", which identifies objects and executes actions just by knocking on it with the smartphone. Software powered by machine learning of sounds, vibrations, and other reactions will perform the users' directions.

What separates Knocker from existing technology is the sensor fusion of sound and motion. Previously, object identification used either computer vision technology with cameras or hardware such as RFID (Radio Frequency Identification) tags. These solutions all have their limitations. For computer vision technology, users need to take pictures of every item. Even worse, the technology will not work well in poor lighting situations. Using hardware leads to additional costs and labor burdens.

Knocker, on the other hand, can identify objects even in dark environments only with a smartphone, without requiring any specialized hardware or using a camera. Knocker utilizes the smartphone's built-in sensors such as a microphone, an accelerometer, and a gyroscope to capture a unique set of responses generated when a smartphone is knocked against an object. Machine learning is used to analyze these responses and classify and identify objects.

The research team under Professor Sung-Ju Lee from the School of Computing confirmed the applicability of Knocker technology using 23 everyday objects such as books, laptop computers, water bottles, and bicycles. In noisy environments such as a busy café or on the side of a road, it achieved 83% identification accuracy. In a quiet indoor environment, the accuracy rose to 98%.

The team believes Knocker will open a new paradigm of object interaction. For instance, by knocking on an empty water bottle, a smartphone can automatically order new water bottles from a merchant app. When integrated with IoT devices, knocking on a bed's headboard before going to sleep could turn off the lights and set an alarm. The team suggested and implemented 15 application cases in the paper, presented during the 2019 ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp 2019) held in London last month.

Professor Sung-Ju Lee said, "This new technology does not require any specialized sensor or hardware. It simply uses the built-in sensors on smartphones and takes advantage of the power of machine learning. It's a software solution that everyday smartphone users could immediately benefit from." He continued, "This technology enables users to conveniently interact with their favorite objects."
-end-
The research was supported in part by the Next-Generation Information Computing Development Program through the National Research Foundation of Korea funded by the Ministry of Science and ICT and an Institute for Information & Communications Technology Promotion (IITP) grant funded by the Ministry of Science and ICT.

The Korea Advanced Institute of Science and Technology (KAIST)

Related Smartphone Articles:

Smartphone app reminds heart patients to take their pills
Heart patients using a smartphone app reminder are more likely to take their medication than those who receive written instructions, according to a study presented at the 45th Argentine Congress of Cardiology (SAC 2019).
Object identification and interaction with a smartphone knock
A KAIST team has featured a new technology, 'Knocker', which identifies objects and executes actions just by knocking on it with the smartphone.
Smartphone typing speeds catching up with keyboards
The largest experiment to date on mobile typing sheds new light on average performance of touchscreen typing and factors impacting the text input speed.
Which comes first: Smartphone dependency or depression?
New research suggests a person's reliance on his or her smartphone predicts greater loneliness and depressive symptoms, as opposed to the other way around.
Unlock your smartphone with earbuds
A University at Buffalo-led research team is developing EarEcho, a biometric tool that uses modified wireless earbuds to authenticate smartphone users via the unique geometry of their ear canal.
Are there health consequences associated with not using a smartphone?
Many studies have examined the health effects of smartphone abuse, but a new study looks at the sociodemographic features and health indicators of people who have a smartphone but do not use it regularly.
Using a smartphone to detect norovirus
University of Arizona researchers have developed a simple, portable and inexpensive way to detect minute amounts of norovirus.
Manipulating brain cells by smartphone
Researchers have developed a soft neural implant that can be wirelessly controlled using a smartphone.
Scientists can now manipulate brain cells using smartphone
A team of scientists in Korea and the United States have invented a device that can control neural circuits using a tiny brain implant controlled by a smartphone.
Smartphone virus scanner is not what you think
The current leading method to assess the presence of viruses and other biological markers of disease is effective but large and expensive.
More Smartphone News and Smartphone Current Events

Top Science Podcasts

We have hand picked the top science podcasts of 2019.
Now Playing: TED Radio Hour

Risk
Why do we revere risk-takers, even when their actions terrify us? Why are some better at taking risks than others? This hour, TED speakers explore the alluring, dangerous, and calculated sides of risk. Guests include professional rock climber Alex Honnold, economist Mariana Mazzucato, psychology researcher Kashfia Rahman, structural engineer and bridge designer Ian Firth, and risk intelligence expert Dylan Evans.
Now Playing: Science for the People

#540 Specialize? Or Generalize?
Ever been called a "jack of all trades, master of none"? The world loves to elevate specialists, people who drill deep into a single topic. Those people are great. But there's a place for generalists too, argues David Epstein. Jacks of all trades are often more successful than specialists. And he's got science to back it up. We talk with Epstein about his latest book, "Range: Why Generalists Triumph in a Specialized World".
Now Playing: Radiolab

Dolly Parton's America: Neon Moss
Today on Radiolab, we're bringing you the fourth episode of Jad's special series, Dolly Parton's America. In this episode, Jad goes back up the mountain to visit Dolly's actual Tennessee mountain home, where she tells stories about her first trips out of the holler. Back on the mountaintop, standing under the rain by the Little Pigeon River, the trip triggers memories of Jad's first visit to his father's childhood home, and opens the gateway to dizzying stories of music and migration. Support Radiolab today at Radiolab.org/donate.