Stretch-sensing glove captures interactive hand poses accurately

July 23, 2019

Capturing interactive hand poses in real time and with realistic results is a well-examined problem in computing, particularly human-centered computing and motion capture technology. Human hands are complex--an intricate system of flexors, extensors, and sensory capabilities serving as our primary means to manipulate physical objects and communicate with one another. The accurate motion capture of hands is relevant and important for many applications, such as gaming, augmented and virtual reality domains, robotics, and biomedical industries.

A global team of computer scientists from ETH Zurich and New York University have further advanced this area of research by developing a user-friendly, stretch-sensing data glove to capture real-time, interactive hand poses with much more precision.

The research team, including Oliver Glauser, Shihao Wu, Otmar Hilliges, and Olga Sorkine-Hornung of ETH Zurich and Daniele Panozzo of NYU, will demonstrate their innovative glove at SIGGRAPH 2019, held 28 July-1 August in Los Angeles. This annual gathering showcases the world's leading professionals, academics, and creative minds at the forefront of computer graphics and interactive techniques.

The main advantage of their stretch-sensing gloves, say the researchers, is that they do not require a camera-based set-up--or any additional external equipment--and could begin tracking hand poses in real time with only minimal calibration.

"To our best knowledge, our gloves are the first accurate hand-capturing data gloves based solely on stretch sensors," says Glauser, a lead author of the work and a PhD student at ETH Zurich. "The gloves are soft and thin, making them very comfortable and unobtrusive to wear, even while having 44 embedded sensors. They can be manufactured at a low cost with tools commonly available in fabrication labs."

Glauser and collaborators set out to overcome some persisting challenges in the replication of accurate hand poses. In this work, they addressed hurdles such as capturing the hand motions in real time in a variety of environments and settings, as well as using only user-friendly equipment and an easy-to-learn approach for set-up. They demonstrate that their stretch-sensing soft gloves are successful in accurately computing hand poses in real-time, even while the user is holding a physical object, and in conditions such as low lighting.

The researchers utilized a silicone compound in the shape of a hand equipped with 44 stretch sensors and attached this to a glove made of soft, thin fabric. To reconstruct the hand pose from the sensor readings, the researchers use a data-driven model that exploits the layout of the sensor itself. The model is trained only once; and to gather training data, the researchers use an inexpensive, off-the-shelf hand pose reconstruction system.

For the study, they compare the accuracy of their sensor gloves to two state-of-the-art commercial glove products. In all but one hand pose, the researchers' novel, stretch-sensing gloves received the lowest error return for each interactive pose.

In future work, the team intends to explore how a similar sensor approach could be used to track a whole arm to get the global position and orientation of the glove, or perhaps even a full body suit. Currently the researchers have fabricated medium-sized gloves, and they would like to expand to other sizes and shapes.

"This is an already well-studied problem but we found new ways to address it in terms of the sensors employed in our design and our data-driven model," notes Glauser. "What is also exciting about this work is the multidisciplinary nature of working on this problem. It required expertise from various fields, including material science, fabrication, electrical engineering, computer graphics, and machine learning."
-end-
For the paper and video, visit the group's project page.

About ACM, ACM SIGGRAPH, and SIGGRAPH 2019

ACM, the Association for Computing Machinery, is the world's largest educational and scientific computing society, uniting educators, researchers, and professionals to inspire dialogue, share resources, and address the field's challenges.

ACM SIGGRAPH is a special interest group within ACM that serves as an interdisciplinary community where researchers, artists, and technologists collide to progress applications in computer graphics and interactive techniques. The SIGGRAPH conference is the world's leading annual interdisciplinary educational experience for inspiring transformative advancements across the disciplines of computer graphics and interactive techniques.

SIGGRAPH 2019, the 46th annual conference hosted by ACM SIGGRAPH, will take place from 28 July-1 August at the Los Angeles Convention Center. To register for SIGGRAPH 2019 and hear from the authors themselves, visit s2019.siggraph.org/register.

Association for Computing Machinery

Related Data Articles from Brightsurf:

Keep the data coming
A continuous data supply ensures data-intensive simulations can run at maximum speed.

Astronomers are bulging with data
For the first time, over 250 million stars in our galaxy's bulge have been surveyed in near-ultraviolet, optical, and near-infrared light, opening the door for astronomers to reexamine key questions about the Milky Way's formation and history.

Novel method for measuring spatial dependencies turns less data into more data
Researcher makes 'little data' act big through, the application of mathematical techniques normally used for time-series, to spatial processes.

Ups and downs in COVID-19 data may be caused by data reporting practices
As data accumulates on COVID-19 cases and deaths, researchers have observed patterns of peaks and valleys that repeat on a near-weekly basis.

Data centers use less energy than you think
Using the most detailed model to date of global data center energy use, researchers found that massive efficiency gains by data centers have kept energy use roughly flat over the past decade.

Storing data in music
Researchers at ETH Zurich have developed a technique for embedding data in music and transmitting it to a smartphone.

Life data economics: calling for new models to assess the value of human data
After the collapse of the blockchain bubble a number of research organisations are developing platforms to enable individual ownership of life data and establish the data valuation and pricing models.

Geoscience data group urges all scientific disciplines to make data open and accessible
Institutions, science funders, data repositories, publishers, researchers and scientific societies from all scientific disciplines must work together to ensure all scientific data are easy to find, access and use, according to a new commentary in Nature by members of the Enabling FAIR Data Steering Committee.

Democratizing data science
MIT researchers are hoping to advance the democratization of data science with a new tool for nonstatisticians that automatically generates models for analyzing raw data.

Getting the most out of atmospheric data analysis
An international team including researchers from Kanazawa University used a new approach to analyze an atmospheric data set spanning 18 years for the investigation of new-particle formation.

Read More: Data News and Data Current Events
Brightsurf.com is a participant in the Amazon Services LLC Associates Program, an affiliate advertising program designed to provide a means for sites to earn advertising fees by advertising and linking to Amazon.com.