Nav: Home

Virtual walking system for re-experiencing the journey of another person

October 16, 2019

A research team consisting of Professor Michiteru Kitazaki from the Toyohashi University of Technology, Associate Professor Tomohiro Amemiya from the University of Tokyo, and Professor Yasushi Ikei from Tokyo Metropolitan University have developed a virtual walking system. This system records a person walking, then re-plays it to another user through the oscillating optic flow and synchronous foot vibrations. Psychological experiments confirmed that the sensations of self-motion, walking, leg action, and telepresence provided by the oscillating visual flow combined with foot vibrations are stronger than with randomized-timing vibrations or without any vibrations. These results suggest that oscillating visual scenes and synchronous foot vibrations are effective for creating virtual walking sensations. The virtual walking system can reproduce experiences of walking to people who are a distance away, or who have a disability that could prevent them from walking in the future. This research has been published in the British open access journal "i-Perception" in 15th October 2019.

Walking is a natural and frequent action performed by healthy adults in everyday life. It involves various sensations such as vision, touch, hearing, and proprioception, as well as performing motor commands and actions. Therefore, it would represent a challenge to develop a virtual reality system capable of reproducing the walking sensation.

Recently, to address the above problem, a research team in Japan have developed a virtual walking system with focusing on vision and foot vibrations, because these modalities seem critical and a minimal set to induce walking sensations. The proposed recording system captures the walker's oscillating optic flow with a pair of stereo cameras, and records the timings of feet striking the ground using four microphones embedded in their shoes. The proposed system comprises a head-mounted display (HMD) and four vibrators attached to the heels and the forefeet.

Psychological experiments were conducted to test the virtual walking system. The captured first-person-view scenes with image oscillations caused by the walker's head motion and the foot vibrations at synchronized timings significantly induced the sensations of self-motion, walking, leg action, and telepresence. The synchronous presentation of visual oscillations and foot vibrations was critical for enhancing the virtual walking experience. These results confirm that tactile stimulation on the feet for footsteps is effective for enhancing virtual walking sensations.

Professor Michiteru Kitazaki, a perceptual psychologist at the Toyohashi University of Technology said, "We would like to develop the virtual reality system further, enabling people to walk on strange places such as the Moon or the ocean bottom, and possibly improving the quality of life of people who have walking disabilities. This research is the first step to achieving these goals. Accordingly, we aim to create the virtual sensation of walking using limited modalities, such as vision and tactile sensations."

Associate Professor Tomohiro Amemiya, a young virtual reality researcher whose research specializes in haptics at the University of Tokyo explained "Tactile sensation on the foot-sole can induce a pseudo-walking sensation. The present research demonstrated the psychological evidence for this. In addition, in our other paper published in "Psychological Science", we have found that a similar rhythmic pattern consisting of walking vibrations applied to the soles of the feet facilitated tactile processing when looming sounds were located near the body. The findings suggest that extension of the peripersonal space representation can be enabled by stimulating the soles in the absence of body action, which may automatically drive a motor programing in the brain for walking, leading to a change in spatial cognition around the body."

Professor Yasushi Ikei, a virtual reality expert researcher at Tokyo Metropolitan University said "During the set of related studies, we are developing a full-scale super-presence virtual re-experience system. For example, FiveStar VR (which won the best VR/AR technology award at ACM SIGGRAPH Asia 2018) represents vision, vestibular sense, proprioception, smells, air flow, sounds, and touch to re-experience the experiences of another person (https://youtu.be/mOS5JJBSZ3c). The re-experience system allows expanding our experiences and contributes to skill transfer and improving the quality of life for all people."

In this way, the virtual walking system could expand our experience and improve the quality of life for people that may have future walking disabilities.
-end-
Reference:

Kitazaki M., Hamada, T., Yoshiho, K., Kondo, R., Amemiya, T., Hirota, K., and Ikei, Y. (2019). Virtual walking sensation by pre-recorded oscillating optic flow and synchronous foot vibration. I-Perception, 10(5), 1-14. doi:10.1177/2041669519882448

Amemiya, T., Ikei, Y., and Kitazaki, M. (2019). Remapping Peripersonal Space by Using Foot-Sole Vibrations Without Any Body Movement. Psychological Science, 10.1177/0956797619869337.

Shimizu, K., Sueta, G., Yamaoka, K., Sawamura, K., Suzuki, Y., Yoshida, K., Yem, V., Ikei, Y., Amemiya, T., Sato, M., Hirota, K., and Kitazaki, M. (2018). FiveStar VR: Shareable Travel Experience Through Multisensory Stimulation to the Whole Body. ACM SIGGRAPH Asia 2018, Virtual and Augmented Reality

Funding: This research was supported by the SCOPE program (141203019), Grant-in-Aid for Scientific Research (A) (18H04118), and Grant-in-Aid for Challenging Exploratory Research (16K12477) by MEXT Japan.

Toyohashi University of Technology
1-1 Hibarigaoka, Tempaku
Toyohashi, Aichi Prefecture, 441-8580, JAPAN
Inquiries: Committee for Public Relations
E-mail: press@office.tut.ac.jp

Toyohashi University of Technology was founded in 1976 as a National University of Japan, and is a leading research institute in the fields of mechanical engineering, advanced electronics, information sciences, life sciences, and architecture.

Website: http://www.tut.ac.jp/english/

Toyohashi University of Technology

Related Virtual Reality Articles:

Virtual and augmented reality: warnings about the ethical dangers
Research on virtual reality started in the eighties, but it is now that good quality is available to the public and it can become a mass consumer product soon.
Easing the burden of coronavirus with virtual reality
A new article discusses the psychological stresses imposed by the coronavirus pandemic and suggests that virtual reality can help alleviate the psychological impact of the need for social isolation.
Virtual reality makes empathy easier
Virtual reality activates brain networks that increase your ability to identify with other people, according to new research published in eNeuro.
Physiotherapy could be done at home using virtual reality
Virtual reality could help physiotherapy patients complete their exercises at home successfully thanks to researchers at WMG, University of Warwick, who managed to combine VR technology with 3D motion capture.
Using virtual reality to help individuals with autism spectrum disorder
Novel interventions using virtual reality to aid individuals with autism spectrum disorder (ASD) handle common scenarios may include helping youngsters navigate air travel.
Virtual reality illuminates the power of opioid-associated memories
The brain acts differently when remembering environments associated with drug use.
Virtual reality could help flu vaccination rates
Using a virtual reality simulation to show how flu spreads and its impact on others could be a way to encourage more people to get a flu vaccination, according to a study by researchers at the University of Georgia and the Oak Ridge Associated Universities in Oak Ridge, Tennessee.
Virtual reality becomes more real
Scientists from Skoltech ADASE (Advanced Data Analytics in Science and Engineering) lab have found a way to enhance depth map resolution, which should make virtual reality and computer graphics more realistic.
Is virtual reality the next big thing in art therapy?
Researchers from Drexel University's College of Nursing and Health Professions in the Creative Arts Therapies Department conducted a study to see if virtual reality can be used as an expressive tool in art therapy.
Intuitive in the virtual reality
Through the crafty use of magnetic fields, scientists from HZDR and Johannes Kepler University in Linz have developed the first electronic sensor that can simultaneously process both touchless and tactile stimuli.
More Virtual Reality News and Virtual Reality Current Events

Trending Science News

Current Coronavirus (COVID-19) News

Top Science Podcasts

We have hand picked the top science podcasts of 2020.
Now Playing: TED Radio Hour

Making Amends
What makes a true apology? What does it mean to make amends for past mistakes? This hour, TED speakers explore how repairing the wrongs of the past is the first step toward healing for the future. Guests include historian and preservationist Brent Leggs, law professor Martha Minow, librarian Dawn Wacek, and playwright V (formerly Eve Ensler).
Now Playing: Science for the People

#566 Is Your Gut Leaking?
This week we're busting the human gut wide open with Dr. Alessio Fasano from the Center for Celiac Research and Treatment at Massachusetts General Hospital. Join host Anika Hazra for our discussion separating fact from fiction on the controversial topic of leaky gut syndrome. We cover everything from what causes a leaky gut to interpreting the results of a gut microbiome test! Related links: Center for Celiac Research and Treatment website and their YouTube channel
Now Playing: Radiolab

The Flag and the Fury
How do you actually make change in the world? For 126 years, Mississippi has had the Confederate battle flag on their state flag, and they were the last state in the nation where that emblem remained "officially" flying.  A few days ago, that flag came down. A few days before that, it coming down would have seemed impossible. We dive into the story behind this de-flagging: a journey involving a clash of histories, designs, families, and even cheerleading. This show is a collaboration with OSM Audio. Kiese Laymon's memoir Heavy is here. And the Hospitality Flag webpage is here.