Nav: Home

Hand that sees offers new hope to amputees

May 03, 2017

A new generation of prosthetic limbs which will allow the wearer to reach for objects automatically, without thinking -- just like a real hand -- are to be trialled for the first time.

Led by biomedical engineers at Newcastle University, UK, and funded by the Engineering and Physical Sciences Research Council (EPSRC), the bionic hand is fitted with a camera which instantaneously takes a picture of the object in front of it, assesses its shape and size and triggers a series of movements in the hand.

Bypassing the usual processes which require the user to see the object, physically stimulate the muscles in the arm and trigger a movement in the prosthetic limb, the hand 'sees' and reacts in one fluid movement.

A small number of amputees have already trialled the new technology and now the Newcastle University team are working with experts at Newcastle upon Tyne Hospitals NHS Foundation Trust to offer the 'hands with eyes' to patients at Newcastle's Freeman Hospital.

Publishing their findings today in the Journal of Neural Engineering, co-author on the study Dr Kianoush Nazarpour, a Senior Lecturer in Biomedical Engineering at Newcastle University, explains:

"Prosthetic limbs have changed very little in the past 100 years -- the design is much better and the materials' are lighter weight and more durable but they still work in the same way.

"Using computer vision, we have developed a bionic hand which can respond automatically -- in fact, just like a real hand, the user can reach out and pick up a cup or a biscuit with nothing more than a quick glance in the right direction.

"Responsiveness has been one of the main barriers to artificial limbs. For many amputees the reference point is their healthy arm or leg so prosthetics seem slow and cumbersome in comparison.

"Now, for the first time in a century, we have developed an 'intuitive' hand that can react without thinking."

Artificial vision for artificial hands

Recent statistics show that in the UK there are around 600 new upper-limb amputees every year, of which 50% are in the age range of 15-54 years old. In the US there are 500,000 upper limb amputees a year.

Current prosthetic hands are controlled via myoelectric signals - that is electrical activity of the muscles recorded from the skin surface of the stump.

Controlling them, says Dr Nazarpour, takes practice, concentration and, crucially, time.

Using neural networks -- the basis for Artificial Intelligence -- lead author on the study Ghazal Ghazaei showed the computer numerous object images and taught it to recognise the 'grip' needed for different objects.

"We would show the computer a picture of, for example, a stick," explains Miss Ghazaei, who carried out the work as part of her PhD in the School of Electrical and Electronic Engineering at Newcastle University. "But not just one picture, many images of the same stick from different angles and orientations, even in different light and against different backgrounds and eventually the computer learns what grasp it needs to pick that stick up.

"So the computer isn't just matching an image, it's learning to recognise objects and group them according to the grasp type the hand has to perform to successfully pick it up. "It is this which enables it to accurately assess and pick up an object which it has never seen before -- a huge step forward in the development of bionic limbs."

Grouping objects by size, shape and orientation, according to the type of grasp that would be needed to pick them up, the team programmed the hand to perform four different 'grasps': palm wrist neutral (such as when you pick up a cup); palm wrist pronated (such as picking up the TV remote); tripod (thumb and two fingers) and pinch (thumb and first finger).

Using a 99p camera fitted to the prosthesis, the hand 'sees' an object, picks the most appropriate grasp and sends a signal to the hand -- all within a matter of milliseconds and ten times faster than any other limb currently on the market.

"One way would have been to create a photo database of every single object but clearly that would be a massive task and you would literally need every make of pen, toothbrush, shape of cup -- the list is endless," says Dr Nazarpour.

"The beauty of this system is that it's much more flexible and the hand is able to pick up novel objects -- which is crucial since in everyday life people effortlessly pick up a variety of objects that they have never seen before."

First step towards a fully connected bionic hand

The work is part of a larger research project to develop a bionic hand that can sense pressure and temperature and transmit the information back to the brain.

Led by Newcastle University and involving experts from the universities of Leeds, Essex, Keele, Southampton and Imperial College London, the aim is to develop novel electronic devices that connect to the forearm neural networks to allow two-way communications with the brain.

Reminiscent of Luke Skywalker's artificial hand, the electrodes in the bionic limb would wrap around the nerve endings in the arm. This would mean for the first time the brain could communicate directly with the prosthesis.

The 'hand that sees', explains Dr Nazarpour, is an interim solution that will bridge the gap between current designs and the future.

"It's a stepping stone towards our ultimate goal," he says. "But importantly, it's cheap and it can be implemented soon because it doesn't require new prosthetics -- we can just adapt the ones we have."

Anne Ewing, Advanced Occupational Therapist at Newcastle upon Tyne Hospitals NHS Foundation Trust, has been working with Dr Nazarpour and his team.

"I work with upper limb amputee patients which is extremely rewarding, varied and at times challenging," she said.

"We always strive to put the patient at the heart of everything we do and so make sure that any interventions are client centred to ensure patients' individual goals are met either with a prosthesis or alternative method of carrying out a task.

"This project in collaboration with Newcastle University has provided an exciting opportunity to help shape the future of upper limb prosthetics, working towards achieving patients' prosthetic expectations and it is wonderful to have been involved."

Case Study -- Doug McIntosh, 56, from Aberdeen, Scotland

"For me it was literally a case of life or limb," says Doug McIntosh, who lost his right arm in 1997 through cancer.

"I had developed a rare form of cancer called epithelial sarcoma, which develops in the deep tissue under the skin, and the doctors had no choice but to amputate the limb to save my life.

"Losing an arm and battling cancer with three young children was life changing. I left my job as a life support supervisor in the diving industry and spent a year fund-raising for cancer charities.

"It was this and my family that motivated me and got me through the hardest times."

Since then, Doug has gone on to be an inspiration to amputees around the world. Becoming the first amputee to cycle from John O'Groats to Land's End in 100hrs, cycle around the coast line of Britain, he has run three London Marathons, cycled The Dallaglio Flintoff Cycle Slam 2012 and 2014 and in 2014 cycled with the British Lions Rugby Team to Murrayfield Rugby Stadium for "Walking with Wounded" Charity. He is currently preparing to do Mont Ventoux this September, three cycle climbs in one day for Cancer Research UK and Maggie's Cancer Centres. Involved in the early trials of the first myoelectric prosthetic limbs, Doug has been working with the Newcastle team to trail the new hand that sees.

"The problem is there's nothing yet that really comes close to feeling like the real thing," explains the father-of-three who lives in Westhill, Aberdeen with his wife of 32 years, Diane.

"Some of the prosthetics look very realistic but they feel slow and clumsy when you have a working hand to compare them to.

"In the end I found it easier just to do without and learn to adapt. When I do use a prosthesis I use a split hook which doesn't look pretty but does the job."

But he says the new, responsive hand being developed in Newcastle is a 'huge leap forward'.

"This offers for the first time a real alternative for upper limb amputees," he says.

"For me, one of the ways of dealing with the loss of my hand was to be very open about it and answer people's questions. But not everyone wants that and so to have the option of a hand that not only looks realistic but also works like a real hand would be an amazing breakthrough and transform the recovery time -- both physically and mentally -- for many amputees."
-end-


Newcastle University

Related Cancer Articles:

UCI researchers uncover cancer cell vulnerabilities; may lead to better cancer therapies
A new University of California, Irvine-led study reveals a protein responsible for genetic changes resulting in a variety of cancers, may also be the key to more effective, targeted cancer therapy.
Breast cancer treatment costs highest among young women with metastic cancer
In a fight for their lives, young women, age 18-44, spend double the amount of older women to survive metastatic breast cancer, according to a large statewide study by the University of North Carolina at Chapel Hill.
Cancer mortality continues steady decline, driven by progress against lung cancer
The cancer death rate declined by 29% from 1991 to 2017, including a 2.2% drop from 2016 to 2017, the largest single-year drop in cancer mortality ever reported.
Stress in cervical cancer patients associated with higher risk of cancer-specific mortality
Psychological stress was associated with a higher risk of cancer-specific mortality in women diagnosed with cervical cancer.
Cancer-sniffing dogs 97% accurate in identifying lung cancer, according to study in JAOA
The next step will be to further fractionate the samples based on chemical and physical properties, presenting them back to the dogs until the specific biomarkers for each cancer are identified.
Moffitt Cancer Center researchers identify one way T cell function may fail in cancer
Moffitt Cancer Center researchers have discovered a mechanism by which one type of immune cell, CD8+ T cells, can become dysfunctional, impeding its ability to seek and kill cancer cells.
More cancer survivors, fewer cancer specialists point to challenge in meeting care needs
An aging population, a growing number of cancer survivors, and a projected shortage of cancer care providers will result in a challenge in delivering the care for cancer survivors in the United States if systemic changes are not made.
New cancer vaccine platform a potential tool for efficacious targeted cancer therapy
Researchers at the University of Helsinki have discovered a solution in the form of a cancer vaccine platform for improving the efficacy of oncolytic viruses used in cancer treatment.
American Cancer Society outlines blueprint for cancer control in the 21st century
The American Cancer Society is outlining its vision for cancer control in the decades ahead in a series of articles that forms the basis of a national cancer control plan.
Oncotarget: Cancer pioneer employs physics to approach cancer in last research article
In the cover article of Tuesday's issue of Oncotarget, James Frost, MD, PhD, Kenneth Pienta, MD, and the late Donald Coffey, Ph.D., use a theory of physical and biophysical symmetry to derive a new conceptualization of cancer.
More Cancer News and Cancer Current Events

Trending Science News

Current Coronavirus (COVID-19) News

Top Science Podcasts

We have hand picked the top science podcasts of 2020.
Now Playing: TED Radio Hour

Warped Reality
False information on the internet makes it harder and harder to know what's true, and the consequences have been devastating. This hour, TED speakers explore ideas around technology and deception. Guests include law professor Danielle Citron, journalist Andrew Marantz, and computer scientist Joy Buolamwini.
Now Playing: Science for the People

#576 Science Communication in Creative Places
When you think of science communication, you might think of TED talks or museum talks or video talks, or... people giving lectures. It's a lot of people talking. But there's more to sci comm than that. This week host Bethany Brookshire talks to three people who have looked at science communication in places you might not expect it. We'll speak with Mauna Dasari, a graduate student at Notre Dame, about making mammals into a March Madness match. We'll talk with Sarah Garner, director of the Pathologists Assistant Program at Tulane University School of Medicine, who takes pathology instruction out of...
Now Playing: Radiolab

What If?
There's plenty of speculation about what Donald Trump might do in the wake of the election. Would he dispute the results if he loses? Would he simply refuse to leave office, or even try to use the military to maintain control? Last summer, Rosa Brooks got together a team of experts and political operatives from both sides of the aisle to ask a slightly different question. Rather than arguing about whether he'd do those things, they dug into what exactly would happen if he did. Part war game part choose your own adventure, Rosa's Transition Integrity Project doesn't give us any predictions, and it isn't a referendum on Trump. Instead, it's a deeply illuminating stress test on our laws, our institutions, and on the commitment to democracy written into the constitution. This episode was reported by Bethel Habte, with help from Tracie Hunte, and produced by Bethel Habte. Jeremy Bloom provided original music. Support Radiolab by becoming a member today at Radiolab.org/donate.     You can read The Transition Integrity Project's report here.