Nav: Home

Fighting virtual reality sickness

June 14, 2016

New York, NY--June 14, 2016--Columbia Engineering Professor Steven K. Feiner and Ajoy Fernandes MS'16 have developed a method of combating virtual reality (VR) sickness that can be applied to consumer head-worn VR displays, such as the Oculus Rift, HTC Vive, Sony PlayStation VR, and Google Cardboard. Their approach dynamically, yet subtly, changes the user's field of view (FOV) in response to visually perceived motion, as the user virtually traverses an environment while remaining physically stationary. The study showed that by strategically and automatically manipulating FOV, the degree of VR sickness experienced by participants can be significantly reduced. Furthermore, the researchers accomplished this without decreasing the participants' sense of presence in the virtual environment, and without the majority of the participants even being aware of the intervention. The study was presented at IEEE 3DUI 2016 (IEEE Symposium on 3D User Interfaces) on March 20, where it won the Best Paper Award.

VIDEO: https://youtu.be/lHzCmfuJYa4

"2016 is the year of VR and it's estimated that over 200 million VR headsets will be sold by 2020," says Computer Science Professor Feiner, who directs the Computer Graphics and User Interfaces Lab. "But VR sickness, which has symptoms similar to motion sickness, poses a barrier for many users of this immersive technology. People who experience VR sickness will often stop using their headsets, as they feel nauseated and uncomfortable."

Feiner and Fernandes developed an approach that focused on the VR user's FOV, changing it in a way that many participants found imperceptible. "I was aware of work on change blindness--a concept in perceptual psychology that explains why people sometimes do not notice what would seem to be an obvious change in a scene," explains Fernandes, who himself has suffered from VR sickness. "So I wondered if this could be applied to VR: could we change a participant's FOV without them noticing?"

The team specifically targeted scenarios in which users move in the virtual environment in a way that intentionally differs from how they move in the real world. These include games in which they are physically standing or sitting on a couch in their living room, while walking, running, driving, or flying in the virtual world. In these scenarios, the visual motion cues that users see are at odds with the physical motion cues that they receive from their inner ears' vestibular system, the cues that provide us with our sense of motion, equilibrium, and spatial orientation. When the visual and vestibular cues conflict, users can feel quite uncomfortable, even nauseated.

In many cases, decreasing the field of view can decrease these symptoms. But decreasing FOV can also decrease the user's sense of presence in the virtual environment, making the experience less compelling. Feiner and Fernandes focused on subtly decreasing FOV in situations when a larger FOV would be likely to cause VR sickness (when the mismatch between physical and virtual motion increases) and restoring it when VR sickness is less likely to occur (when the mismatch decreases). They developed software that functions as a pair of "dynamic FOV restrictors" and can partially obscure each eye's view with a virtual soft-edged cutout. They then determined how much the user's field of view should be reduced, and the speed with which it should be reduced and then restored, and tested the system.

Their multi-day user study divided 30 voluntary participants into two groups. One group explored a VR environment without the dynamic FOV restrictors on one day and with the restrictors on a second day. This order was reversed for the second group. When study participants used the FOV restrictors, they felt more comfortable and stayed in the virtual environment longer than they did without the restrictors. Two kinds of restrictors were used, one of which was designed to be more subtle than the other. Most of the participants who used the more subtle restrictors did not notice them, and all those who did notice them said they would prefer to have them in future VR experiences.

Feiner and Fernandes plan next to look into how FOV restrictors could help acclimate users to VR experiences. For this study, they used soft-edged, circular cutouts and now want to explore using different cutout shapes and textures. They are also interested in going beyond their current study, in which they reduced FOV as a simple function of speed and angular velocity, to instead see the effect of reducing FOV based on parameters such as heart rate or optical flow.

"Virtual reality has the potential to profoundly change how we interact with people, machines, and information," Feiner says. "It is critical that the experience be both comfortable and compelling, and we think we've found a way."

Feiner and Fernandes' team, which has filed a provisional patent through Columbia Technology Ventures, included Luis Tolosa and Matthieu Gavaudan who helped coordinate and run the user study, and Carmine Elvezio and Mengu Sukan who gave feedback and suggestions.
-end-
This research was funded in part by the National Science Foundation under Grants IIS-0905569 and IIS-1514429.

LINKS

PAPER: S. Fernandes and S.K. Feiner, "Combating VR sickness through subtle dynamic field-of-view modification," 2016 IEEE Symposium on 3D User Interfaces (3DUI), Greenville, SC, USA, 2016, pp. 201-210. doi: 10.1109/3DUI.2016.7460053

URL: http://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=7460053&isnumber=7460014

VIDEO: https://youtu.be/lHzCmfuJYa4

http://www.engineering.columbia.edu/

http://www.cs.columbia.edu/~feiner/

http://graphics.cs.columbia.edu/home/home/

Columbia University School of Engineering and Applied Science

Related Virtual Reality Articles:

New 3-D display takes the eye fatigue out of virtual reality
A new type of 3-D display could solve the long-standing problem eye fatigue when using VR and AR equipment by greatly improving the viewing comfort of these wearable devices.
A glove powered by soft robotics to interact with virtual reality environments
Engineers at UC San Diego are using soft robotics technology to make light, flexible gloves that allow users to feel tactile feedback when they interact with virtual reality environments.
The 'reality' of virtual reality pornography
How the latest digital technology could blur the line between reality and fantasy, pushing the dangers of porn to a whole new level.
Physical keyboards make virtual reality typing easier
What's better than a holographic keyboard? A real one, apparently.
Can virtual reality help us prevent falls in the elderly and others?
Every year, falls lead to hospitalization or death for hundreds of thousands of elderly Americans.
Virtual reality therapy helps decrease pain in hospitalized patients
Virtual reality therapy is effective in significantly reducing pain for hospitalized patients, according to a new Cedars-Sinai study.
Using virtual reality to catch a real ball
Disney Research scientists have found innovative ways to enhance virtual experiences involving interactions with physical objects by showing how a person using a virtual reality system can use it to reliably catch a real ball.
Studying altruism through virtual reality
This new study -- published in the journal Neuropsychologia -- immersed participants in a virtual environment that reproduced a building on fire which they had to evacuate in a hurry, deciding whether to save their lives or help rescue an injured person.
Virtual reality training for 'safety-critical' jobs
New virtual reality training could help prevent accidents in 'safety-critical' industries like the NHS, aviation, the military and nuclear power.
New virtual reality technology may improve motor skills in damaged limbs
New Tel Aviv University research suggests that a combination of traditional physical therapy and technology may improve the motor skills and mobility of an impaired hand by having its healthy partner hand lead by example through virtual reality training.

Related Virtual Reality Reading:

Best Science Podcasts 2019

We have hand picked the best science podcasts for 2019. Sit back and enjoy new science podcasts updated daily from your favorite science news services and scientists.
Now Playing: TED Radio Hour

Moving Forward
When the life you've built slips out of your grasp, you're often told it's best to move on. But is that true? Instead of forgetting the past, TED speakers describe how we can move forward with it. Guests include writers Nora McInerny and Suleika Jaouad, and human rights advocate Lindy Lou Isonhood.
Now Playing: Science for the People

#527 Honey I CRISPR'd the Kids
This week we're coming to you from Awesome Con in Washington, D.C. There, host Bethany Brookshire led a panel of three amazing guests to talk about the promise and perils of CRISPR, and what happens now that CRISPR babies have (maybe?) been born. Featuring science writer Tina Saey, molecular biologist Anne Simon, and bioethicist Alan Regenberg. A Nobel Prize winner argues banning CRISPR babies won’t work Geneticists push for a 5-year global ban on gene-edited babies A CRISPR spin-off causes unintended typos in DNA News of the first gene-edited babies ignited a firestorm The researcher who created CRISPR twins defends...