Gesture recognition

December 18, 2008

A system that can recognize human gestures could provide a new way for people with physical disabilities to interact with computers. A related system for the able bodied could also be used to make virtual worlds more realistic. The system is described in detail in a forthcoming issue of the International Journal of Arts and Technology.

Manolya Kavakli of the Virtual and Interactive Simulations of Reality Research Group, at Macquarie University, Sydney, Australia, explains how standard input devices - keyboard and computer mouse, do not closely mimic natural hand motions such as drawing and sketching. Moreover, these devices have not been developed for ergonomic use nor for people with disabilities.

She and her colleagues have developed a computer system architecture that can carry out "gesture recognition". In this system, the person wears "datagloves" which have illuminated LEDs that are tracked by two pairs of computer webcams working to produce an all-round binocular view. This allows the computer to monitor the person's hand or shoulder movements. This input can then be fed to a program, a game, or simulator, or to control a character, an avatar, in a 3D virtual environment.

"We developed two gesture recognition systems: DESigning In virtual Reality (DesIRe) and DRiving for disabled (DRive). DesIRe allows any user to control dynamically in real-time simulators or other programs. DRive allows a quadriplegic person to control a car interface using input from just two LEDs on an over-shoulder garment. For more precise gestures, a DataGlove user can gesture using their fingers.

The system architecture include the following components: Vizard Virtual Reality Toolkit, an immersive projection system (VISOR), an optical tracking system (specifically the Precision Position Tracker (PPT) system) and a data input system, Kavakli explains. The DataGlove input is quite simplistic at the moment, but future work will lead to an increase in sensitivity to specific gestures, such as grasping, strumming, stroking, and other hand movements.
-end-
"Gesture recognition in virtual reality" by Manolya Kavakli in Int. J. Arts and Technology, 2008, 1, 215-229

Inderscience Publishers

Related Disabilities Articles from Brightsurf:

College students with disabilities at greater risk for substance abuse
College students with physical and cognitive disabilities use illicit drugs more, and have a higher prevalence of drug use disorder, than their non-disabled peers, according to a Rutgers study.

Asthma among children with developmental disabilities
How common asthma was among children with various developmental disabilities (including attention-deficit/hyperactivity disorder, autism spectrum disorder and vision, hearing or speech delay) was compared to children without disabilities in this survey study.

Children with developmental disabilities more likely to develop asthma
Children with developmental disabilities or delay are more at risk of developing asthma, according to a new study published in JAMA Network Open led by public health researchers at The University of Texas Health Science Center at Houston (UTHealth) as part of the Center for Pediatric Population Health.

Self-help groups empower caregivers of children with disabilities
Caregivers in low-income settings will be able to respond to the challenges of bringing up children with disabilities, thanks to a new model created by the University of East Anglia (UEA) and the Kenya Medical Research Institute (KEMRI).

Unintended pregnancy rates higher among women with disabilities, study says
Pregnancies among women with disabilities are 42% more likely to be unintended than pregnancies among women without disabilities, says a new report published in the journal Perspectives on Sexual and Reproductive Health.

More medical students are telling their schools about disabilities, and getting a response
The percentage of medical students who told their schools that they have a disability rose sharply in recent years, a new study shows.

The unpopular truth about biases toward people with disabilities
Needing to ride in a wheelchair can put the brakes on myriad opportunities -- some less obvious than one might think.

How to improve care for patients with disabilities? We need more providers like them
When it comes to patients with disabilities, the chance of getting a clinician 'like them' is extremely low, which may lead to patients' reluctance to seek care or follow prescribed interventions and treatments.

Progress to restore movement in people with neuromotor disabilities
A study published in the advanced edition of April 12, 2019 in the journal Neural Computation shows that approaches based on Long Short-Term Memory decoders could provide better algorithms for neuroprostheses that employ Brain-Machine Interfaces to restore movement in patients with severe neuromotor disabilities.

Certain physical disabilities may affect outcomes in kidney transplant recipients
Compared with kidney transplant recipients who did not report a disability, recipients with a visual disability were at higher risk of organ failure and recipients with a walking disability were at higher risk of early death.

Read More: Disabilities News and Disabilities Current Events
Brightsurf.com is a participant in the Amazon Services LLC Associates Program, an affiliate advertising program designed to provide a means for sites to earn advertising fees by advertising and linking to Amazon.com.