Stanford increasing access to 3D modeling through touch-based display

October 29, 2019

With the goal of increasing access to making, engineers at Stanford University have collaborated with members of the blind and visually impaired community to develop a touch-based display that mimics the geometry of 3D objects designed on a computer.

Creating a 3D object with computer software is often the first step in producing it physically and can be burdensome for people who are blind or visually impaired. Even with 3D modeling software that has more accessible ways of inputting designs, they still have to evaluate their work by either creating a physical version they can touch or by listening to a description provided by a sighted person.

"Design tools empower users to create and contribute to society but, with every design choice, they also limit who can and cannot participate," said Alexa Siu, a graduate student in mechanical engineering at Stanford, who developed, tested and refined the system featured in this research. "This project is about empowering a blind user to be able to design and create independently without relying on sighted mediators because that reduces creativity, agency and availability."

This work is part of a larger effort within the lab of Sean Follmer, assistant professor of mechanical engineering, to develop tactile displays - displays that relay information through touch - for various purposes, such as human-computer interaction and new ways of sharing or explaining 3D information. Siu presented the current work on Oct. 29 at the International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS). Although the display she presented is a prototype, the lab hopes to make a version that is less expensive, larger and able to create shapes in greater detail.

Joshua Miele, co-author on the paper, is a blind scientist, designer and educator who helped develop the system while he was associate director of technology research and development at the Smith-Kettlewell Rehabilitation Engineering Research Center. "It opens up the possibility of blind people being, not just consumers of the benefits of fabrication technology, but agents in it, creating our own tools from 3D modeling environments that we would want or need - and having some hope of doing it in a timely manner," he said.

Greater understanding

The display is reminiscent of a pin art toy in that it forms shapes from a field of tall, rectangular pegs that move up and down. By inputting the specifications of their desired shape in the accompanying 3D modeling program, users can evaluate their creation via the touchable display. Whenever they alter the shape, they can command the display to render it anew. This tactile display is considered 2.5D rather than 3D because the bottom of the display doesn't change shape.

The researchers co-designed this system with people who are blind or visually impaired, a process that was integral to making it address the actual needs of its users. In the end, the team produced a system that can rotate a 3D model, zoom in and zoom out on an object, and show it in split sections - such as showing the top and bottom of a cup beside each other. Users can also feel the shape with multiple fingers or their whole hand, which enhances the information they can interpret from the display.

"What really is so awesome is that I can view various perspectives of the object and not just the object in its single state," said Son Kim, an assistive technology specialist for the Vista Center for the Blind in Palo Alto and co-author of the paper. "That offers greater dimension to understanding the object that you're attempting to make. And that's the same opportunity that a sighted peer would have, where they too would be able to view various perspectives of their target object."

The team had five people who were blind or visually impaired test the platform and the system received very positive feedback, including requests from the users to keep the models they created during testing.

"Personally, I believe that access to tools and access to making is something that's incredibly important and incredibly powerful," said Follmer, who is senior author of the paper. "So to hear about the types of devices and objects and 3D models that they wanted to create was the most exciting part."

Scale and resolution

With the success of this early-stage process of co-design and testing, the researchers would like to improve the scale, affordability and resolution of the pin display - currently, each pin is rather large, so the display can't show much detail.

"The feedback we received showed that, even with this coarse display, we can still get meaningful interactions," said Siu. "That suggests there's a lot of potential in the future for this kind of system."

The researchers would also like to explore alternatives to the software program, which requires some programming skills and is reliant on text-based communication. One option may be a system where users physically adjust the pins, which causes the code to change and match what they formed.

"I really am excited about this project," said Kim. "If it moves toward implementation or mass distribution in such a way that is cost-effective that would enable future, visually-impaired or blind designers coming out of college to have a tool, which would give that person or persons the level of accessibility to enhance their learning; it contributes to the principle of individual, universal access and promotes independence."
This research was funded by the National Science Foundation. Follmer is also a member of Stanford Bio-X.

To read all stories about Stanford science, subscribe to the biweekly Stanford Science Digest.

Stanford University

Related Blind Articles from Brightsurf:

Identifying the blind spots of soil biodiversity
Soils harbour a substantial part of the world's biodiversity, yet data on the patterns and processes taking place below ground does not represent all relevant ecosystems and taxa.

Strong convictions can blind us to information that challenges them
When people are highly confident in a decision, they take in information that confirms their decision, but fail to process information which contradicts it, finds a UCL brain imaging study, published in Nature Communications.

A tactile robot finger with no blind spots
Researchers at Columbia Engineering announced today that they have introduced a new type of robotic finger with a sense of touch.

Exposing blind spots in the carbon budget space
The impact of 1°C of global heating is already having devastating impacts on communities and ecosystems across the globe.

Optic nerve stimulation to aid the blind
EPFL scientists are investigating new ways to provide visual signals to the blind by directly stimulating the optic nerve.

Identifying artificial intelligence 'blind spots'
A novel model developed by MIT and Microsoft researchers identifies instances in which autonomous systems have 'learned' from training examples that don't match what's actually happening in the real world.

Seeing and avoiding the 'blind spot' in atomic force measurements
Researchers have discovered a 'blind spot' in atomic force microscopy -- a powerful tool capable of measuring the force between two atoms, imaging the structure of individual cells and the motion of biomolecules.

Giant flightless birds were nocturnal and possibly blind
If you encountered an elephant bird today, it would be hard to miss.

'Blind' Cheetah 3 robot can climb stairs littered with obstacles
MIT's Cheetah 3 robot can now leap and gallop across rough terrain, climb a staircase littered with debris, and quickly recover its balance when suddenly yanked or shoved, all while essentially blind.

Researchers map brain of blind patient who can see motion
Since the visual processing centres of her brain went dark after a stroke, a Scottish woman has been unable to see objects.

Read More: Blind News and Blind Current Events is a participant in the Amazon Services LLC Associates Program, an affiliate advertising program designed to provide a means for sites to earn advertising fees by advertising and linking to