Fighting virtual reality sickness

June 14, 2016

New York, NY--June 14, 2016--Columbia Engineering Professor Steven K. Feiner and Ajoy Fernandes MS'16 have developed a method of combating virtual reality (VR) sickness that can be applied to consumer head-worn VR displays, such as the Oculus Rift, HTC Vive, Sony PlayStation VR, and Google Cardboard. Their approach dynamically, yet subtly, changes the user's field of view (FOV) in response to visually perceived motion, as the user virtually traverses an environment while remaining physically stationary. The study showed that by strategically and automatically manipulating FOV, the degree of VR sickness experienced by participants can be significantly reduced. Furthermore, the researchers accomplished this without decreasing the participants' sense of presence in the virtual environment, and without the majority of the participants even being aware of the intervention. The study was presented at IEEE 3DUI 2016 (IEEE Symposium on 3D User Interfaces) on March 20, where it won the Best Paper Award.

VIDEO: https://youtu.be/lHzCmfuJYa4

"2016 is the year of VR and it's estimated that over 200 million VR headsets will be sold by 2020," says Computer Science Professor Feiner, who directs the Computer Graphics and User Interfaces Lab. "But VR sickness, which has symptoms similar to motion sickness, poses a barrier for many users of this immersive technology. People who experience VR sickness will often stop using their headsets, as they feel nauseated and uncomfortable."

Feiner and Fernandes developed an approach that focused on the VR user's FOV, changing it in a way that many participants found imperceptible. "I was aware of work on change blindness--a concept in perceptual psychology that explains why people sometimes do not notice what would seem to be an obvious change in a scene," explains Fernandes, who himself has suffered from VR sickness. "So I wondered if this could be applied to VR: could we change a participant's FOV without them noticing?"

The team specifically targeted scenarios in which users move in the virtual environment in a way that intentionally differs from how they move in the real world. These include games in which they are physically standing or sitting on a couch in their living room, while walking, running, driving, or flying in the virtual world. In these scenarios, the visual motion cues that users see are at odds with the physical motion cues that they receive from their inner ears' vestibular system, the cues that provide us with our sense of motion, equilibrium, and spatial orientation. When the visual and vestibular cues conflict, users can feel quite uncomfortable, even nauseated.

In many cases, decreasing the field of view can decrease these symptoms. But decreasing FOV can also decrease the user's sense of presence in the virtual environment, making the experience less compelling. Feiner and Fernandes focused on subtly decreasing FOV in situations when a larger FOV would be likely to cause VR sickness (when the mismatch between physical and virtual motion increases) and restoring it when VR sickness is less likely to occur (when the mismatch decreases). They developed software that functions as a pair of "dynamic FOV restrictors" and can partially obscure each eye's view with a virtual soft-edged cutout. They then determined how much the user's field of view should be reduced, and the speed with which it should be reduced and then restored, and tested the system.

Their multi-day user study divided 30 voluntary participants into two groups. One group explored a VR environment without the dynamic FOV restrictors on one day and with the restrictors on a second day. This order was reversed for the second group. When study participants used the FOV restrictors, they felt more comfortable and stayed in the virtual environment longer than they did without the restrictors. Two kinds of restrictors were used, one of which was designed to be more subtle than the other. Most of the participants who used the more subtle restrictors did not notice them, and all those who did notice them said they would prefer to have them in future VR experiences.

Feiner and Fernandes plan next to look into how FOV restrictors could help acclimate users to VR experiences. For this study, they used soft-edged, circular cutouts and now want to explore using different cutout shapes and textures. They are also interested in going beyond their current study, in which they reduced FOV as a simple function of speed and angular velocity, to instead see the effect of reducing FOV based on parameters such as heart rate or optical flow.

"Virtual reality has the potential to profoundly change how we interact with people, machines, and information," Feiner says. "It is critical that the experience be both comfortable and compelling, and we think we've found a way."

Feiner and Fernandes' team, which has filed a provisional patent through Columbia Technology Ventures, included Luis Tolosa and Matthieu Gavaudan who helped coordinate and run the user study, and Carmine Elvezio and Mengu Sukan who gave feedback and suggestions.
-end-
This research was funded in part by the National Science Foundation under Grants IIS-0905569 and IIS-1514429.

LINKS

PAPER: S. Fernandes and S.K. Feiner, "Combating VR sickness through subtle dynamic field-of-view modification," 2016 IEEE Symposium on 3D User Interfaces (3DUI), Greenville, SC, USA, 2016, pp. 201-210. doi: 10.1109/3DUI.2016.7460053

URL: http://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=7460053&isnumber=7460014

VIDEO: https://youtu.be/lHzCmfuJYa4

http://www.engineering.columbia.edu/

http://www.cs.columbia.edu/~feiner/

http://graphics.cs.columbia.edu/home/home/

Columbia University School of Engineering and Applied Science

Related Virtual Reality Articles from Brightsurf:

Virtual reality helps measure vulnerability to stress
Behavioral scientists at EPFL have developed a virtual reality test that assesses a person's vulnerability to stress while exploring immersive environments.

Virtual reality forests could help understanding of climate change
The effects of climate change are sometimes difficult to grasp, but now a virtual reality forest, created by geographers, can let people walk through a simulated forest of today and see what various futures may hold for the trees.

New virtual reality software allows scientists to 'walk' inside cells
Virtual reality software which allows researchers to 'walk' inside and analyze individual cells could be used to understand fundamental problems in biology and develop new treatments for disease.

From virtual to reality! Virtual training improves physical and cognitive functions
Researchers at the Smart-Aging Research Center (IDAC) at Tohoku University have developed an innovative training protocol that, utilizing immersive virtual reality (IVR), leads to real physical and cognitive benefits.

Virtual and augmented reality: warnings about the ethical dangers
Research on virtual reality started in the eighties, but it is now that good quality is available to the public and it can become a mass consumer product soon.

Easing the burden of coronavirus with virtual reality
A new article discusses the psychological stresses imposed by the coronavirus pandemic and suggests that virtual reality can help alleviate the psychological impact of the need for social isolation.

Virtual reality makes empathy easier
Virtual reality activates brain networks that increase your ability to identify with other people, according to new research published in eNeuro.

Physiotherapy could be done at home using virtual reality
Virtual reality could help physiotherapy patients complete their exercises at home successfully thanks to researchers at WMG, University of Warwick, who managed to combine VR technology with 3D motion capture.

Using virtual reality to help individuals with autism spectrum disorder
Novel interventions using virtual reality to aid individuals with autism spectrum disorder (ASD) handle common scenarios may include helping youngsters navigate air travel.

Virtual reality illuminates the power of opioid-associated memories
The brain acts differently when remembering environments associated with drug use.

Read More: Virtual Reality News and Virtual Reality Current Events
Brightsurf.com is a participant in the Amazon Services LLC Associates Program, an affiliate advertising program designed to provide a means for sites to earn advertising fees by advertising and linking to Amazon.com.