Virtual walking system for re-experiencing the journey of another person

October 16, 2019

A research team consisting of Professor Michiteru Kitazaki from the Toyohashi University of Technology, Associate Professor Tomohiro Amemiya from the University of Tokyo, and Professor Yasushi Ikei from Tokyo Metropolitan University have developed a virtual walking system. This system records a person walking, then re-plays it to another user through the oscillating optic flow and synchronous foot vibrations. Psychological experiments confirmed that the sensations of self-motion, walking, leg action, and telepresence provided by the oscillating visual flow combined with foot vibrations are stronger than with randomized-timing vibrations or without any vibrations. These results suggest that oscillating visual scenes and synchronous foot vibrations are effective for creating virtual walking sensations. The virtual walking system can reproduce experiences of walking to people who are a distance away, or who have a disability that could prevent them from walking in the future. This research has been published in the British open access journal "i-Perception" in 15th October 2019.

Walking is a natural and frequent action performed by healthy adults in everyday life. It involves various sensations such as vision, touch, hearing, and proprioception, as well as performing motor commands and actions. Therefore, it would represent a challenge to develop a virtual reality system capable of reproducing the walking sensation.

Recently, to address the above problem, a research team in Japan have developed a virtual walking system with focusing on vision and foot vibrations, because these modalities seem critical and a minimal set to induce walking sensations. The proposed recording system captures the walker's oscillating optic flow with a pair of stereo cameras, and records the timings of feet striking the ground using four microphones embedded in their shoes. The proposed system comprises a head-mounted display (HMD) and four vibrators attached to the heels and the forefeet.

Psychological experiments were conducted to test the virtual walking system. The captured first-person-view scenes with image oscillations caused by the walker's head motion and the foot vibrations at synchronized timings significantly induced the sensations of self-motion, walking, leg action, and telepresence. The synchronous presentation of visual oscillations and foot vibrations was critical for enhancing the virtual walking experience. These results confirm that tactile stimulation on the feet for footsteps is effective for enhancing virtual walking sensations.

Professor Michiteru Kitazaki, a perceptual psychologist at the Toyohashi University of Technology said, "We would like to develop the virtual reality system further, enabling people to walk on strange places such as the Moon or the ocean bottom, and possibly improving the quality of life of people who have walking disabilities. This research is the first step to achieving these goals. Accordingly, we aim to create the virtual sensation of walking using limited modalities, such as vision and tactile sensations."

Associate Professor Tomohiro Amemiya, a young virtual reality researcher whose research specializes in haptics at the University of Tokyo explained "Tactile sensation on the foot-sole can induce a pseudo-walking sensation. The present research demonstrated the psychological evidence for this. In addition, in our other paper published in "Psychological Science", we have found that a similar rhythmic pattern consisting of walking vibrations applied to the soles of the feet facilitated tactile processing when looming sounds were located near the body. The findings suggest that extension of the peripersonal space representation can be enabled by stimulating the soles in the absence of body action, which may automatically drive a motor programing in the brain for walking, leading to a change in spatial cognition around the body."

Professor Yasushi Ikei, a virtual reality expert researcher at Tokyo Metropolitan University said "During the set of related studies, we are developing a full-scale super-presence virtual re-experience system. For example, FiveStar VR (which won the best VR/AR technology award at ACM SIGGRAPH Asia 2018) represents vision, vestibular sense, proprioception, smells, air flow, sounds, and touch to re-experience the experiences of another person ( The re-experience system allows expanding our experiences and contributes to skill transfer and improving the quality of life for all people."

In this way, the virtual walking system could expand our experience and improve the quality of life for people that may have future walking disabilities.

Kitazaki M., Hamada, T., Yoshiho, K., Kondo, R., Amemiya, T., Hirota, K., and Ikei, Y. (2019). Virtual walking sensation by pre-recorded oscillating optic flow and synchronous foot vibration. I-Perception, 10(5), 1-14. doi:10.1177/2041669519882448

Amemiya, T., Ikei, Y., and Kitazaki, M. (2019). Remapping Peripersonal Space by Using Foot-Sole Vibrations Without Any Body Movement. Psychological Science, 10.1177/0956797619869337.

Shimizu, K., Sueta, G., Yamaoka, K., Sawamura, K., Suzuki, Y., Yoshida, K., Yem, V., Ikei, Y., Amemiya, T., Sato, M., Hirota, K., and Kitazaki, M. (2018). FiveStar VR: Shareable Travel Experience Through Multisensory Stimulation to the Whole Body. ACM SIGGRAPH Asia 2018, Virtual and Augmented Reality

Funding: This research was supported by the SCOPE program (141203019), Grant-in-Aid for Scientific Research (A) (18H04118), and Grant-in-Aid for Challenging Exploratory Research (16K12477) by MEXT Japan.

Toyohashi University of Technology
1-1 Hibarigaoka, Tempaku
Toyohashi, Aichi Prefecture, 441-8580, JAPAN
Inquiries: Committee for Public Relations

Toyohashi University of Technology was founded in 1976 as a National University of Japan, and is a leading research institute in the fields of mechanical engineering, advanced electronics, information sciences, life sciences, and architecture.


Toyohashi University of Technology

Related Virtual Reality Articles from Brightsurf:

Virtual reality helps measure vulnerability to stress
Behavioral scientists at EPFL have developed a virtual reality test that assesses a person's vulnerability to stress while exploring immersive environments.

Virtual reality forests could help understanding of climate change
The effects of climate change are sometimes difficult to grasp, but now a virtual reality forest, created by geographers, can let people walk through a simulated forest of today and see what various futures may hold for the trees.

New virtual reality software allows scientists to 'walk' inside cells
Virtual reality software which allows researchers to 'walk' inside and analyze individual cells could be used to understand fundamental problems in biology and develop new treatments for disease.

From virtual to reality! Virtual training improves physical and cognitive functions
Researchers at the Smart-Aging Research Center (IDAC) at Tohoku University have developed an innovative training protocol that, utilizing immersive virtual reality (IVR), leads to real physical and cognitive benefits.

Virtual and augmented reality: warnings about the ethical dangers
Research on virtual reality started in the eighties, but it is now that good quality is available to the public and it can become a mass consumer product soon.

Easing the burden of coronavirus with virtual reality
A new article discusses the psychological stresses imposed by the coronavirus pandemic and suggests that virtual reality can help alleviate the psychological impact of the need for social isolation.

Virtual reality makes empathy easier
Virtual reality activates brain networks that increase your ability to identify with other people, according to new research published in eNeuro.

Physiotherapy could be done at home using virtual reality
Virtual reality could help physiotherapy patients complete their exercises at home successfully thanks to researchers at WMG, University of Warwick, who managed to combine VR technology with 3D motion capture.

Using virtual reality to help individuals with autism spectrum disorder
Novel interventions using virtual reality to aid individuals with autism spectrum disorder (ASD) handle common scenarios may include helping youngsters navigate air travel.

Virtual reality illuminates the power of opioid-associated memories
The brain acts differently when remembering environments associated with drug use.

Read More: Virtual Reality News and Virtual Reality Current Events is a participant in the Amazon Services LLC Associates Program, an affiliate advertising program designed to provide a means for sites to earn advertising fees by advertising and linking to