DIY tools TalkBox and SenseBox help people with disabilities to communicate

February 11, 2020

Researchers at the University of Maryland, Baltimore County (UMBC) have developed do-it-yourself (DIY) assistive technology prototypes that are revolutionizing how people with disabilities can access tools that will help them interact with the world.

Foad Hamidi, assistant professor of information systems, and his collaborators at York University in Canada and the Pamoja Community Based Organization in Kenya have created research-based assistive technology platforms for people with different abilities and in different cultural contexts to learn how to use simple computers to communicate. Importantly, the development of platform prototypes has been grounded in close collaboration among researchers and community members in Kenya and the U.S. The Institute of Electrical and Electronics Engineers (IEEE) has published the results in IEEE Pervasive Computing.

In the field of assistive technology, costs often prohibit many people with disabilities and their families from accessing useful communication technologies. Existing tools that facilitate communication are especially hard to individualize and can be costly, explains Hamidi. However, computers have steadily become less expensive to distribute and easier to use. This makes computer-based assistive technologies more accessible to people with disabilities, both inside and outside of the U.S.

Hamidi and his team have worked to develop and test two platforms: SenseBox and TalkBox. These platforms are open source and only require a Raspberry Pi (an inexpensive microcomputer), low-cost sensors, and a speaker to operate.

TalkBox allows users to communicate by touching images on an attached surface to play audio files stored within the system. The images and sounds can be customized during assembly, depending on an individual's unique needs. For example, TalkBox can be adapted to fit on a wheelchair, and it can include individualized visual elements. The TalkBox could display illustrations of faces showing different expressions, which a student could use to express an emotion. Numerous adjustments are available to the user, making the technology extremely customizable.

SenseBox relies on a similar model of stimuli being translated into audio, but it operates using tactile objects, which are recognized by sensors. These tactile objects are embedded with radio frequency identification (RFID) tags, similar to how objects are tagged in stores. The objects can be 3-D printed, which permits extensive customization.

TalkBox was successfully used in Kenya by a special education teacher who was able to input the names of all of his students onto the device to be used in class. This application of the device led to a noticeable increase in participation and inclusion. The success of the tool within that classroom has already led to an increased interest in the technology for other potential stakeholders in Kenya. The researchers hope to work with community members in Kenyan universities and healthcare facilities to expand the availability of this tool, and help stakeholders learn how to use it.

In the U.S., SenseBox was used by a speech-language pathologist and a nonverbal client with low vision and autism spectrum disorder. The client was able to play his favorite music by holding the desired CD case to the device, which was a major stepping stone in his communication. Previously, he had difficulty using other devices to achieve this same goal of playing his favorite artist.

The success of these DIY devices rests on the fact that people with limited experience using technology can quickly learn how to use the tools and teach others how to use them. Hamidi and his research partners see their close collaboration with those who will be using TalkBox and SenseBox as essential to ensuring the tools are tailored to meet their needs.

The researchers continue to explore how best they can scale up the use of these new tools to support people with disabilities who are seeking new ways to communicate in a broad range of cultural contexts.

University of Maryland Baltimore County

Related Disabilities Articles from Brightsurf:

College students with disabilities at greater risk for substance abuse
College students with physical and cognitive disabilities use illicit drugs more, and have a higher prevalence of drug use disorder, than their non-disabled peers, according to a Rutgers study.

Asthma among children with developmental disabilities
How common asthma was among children with various developmental disabilities (including attention-deficit/hyperactivity disorder, autism spectrum disorder and vision, hearing or speech delay) was compared to children without disabilities in this survey study.

Children with developmental disabilities more likely to develop asthma
Children with developmental disabilities or delay are more at risk of developing asthma, according to a new study published in JAMA Network Open led by public health researchers at The University of Texas Health Science Center at Houston (UTHealth) as part of the Center for Pediatric Population Health.

Self-help groups empower caregivers of children with disabilities
Caregivers in low-income settings will be able to respond to the challenges of bringing up children with disabilities, thanks to a new model created by the University of East Anglia (UEA) and the Kenya Medical Research Institute (KEMRI).

Unintended pregnancy rates higher among women with disabilities, study says
Pregnancies among women with disabilities are 42% more likely to be unintended than pregnancies among women without disabilities, says a new report published in the journal Perspectives on Sexual and Reproductive Health.

More medical students are telling their schools about disabilities, and getting a response
The percentage of medical students who told their schools that they have a disability rose sharply in recent years, a new study shows.

The unpopular truth about biases toward people with disabilities
Needing to ride in a wheelchair can put the brakes on myriad opportunities -- some less obvious than one might think.

How to improve care for patients with disabilities? We need more providers like them
When it comes to patients with disabilities, the chance of getting a clinician 'like them' is extremely low, which may lead to patients' reluctance to seek care or follow prescribed interventions and treatments.

Progress to restore movement in people with neuromotor disabilities
A study published in the advanced edition of April 12, 2019 in the journal Neural Computation shows that approaches based on Long Short-Term Memory decoders could provide better algorithms for neuroprostheses that employ Brain-Machine Interfaces to restore movement in patients with severe neuromotor disabilities.

Certain physical disabilities may affect outcomes in kidney transplant recipients
Compared with kidney transplant recipients who did not report a disability, recipients with a visual disability were at higher risk of organ failure and recipients with a walking disability were at higher risk of early death.

Read More: Disabilities News and Disabilities Current Events is a participant in the Amazon Services LLC Associates Program, an affiliate advertising program designed to provide a means for sites to earn advertising fees by advertising and linking to