Scientists improved eye tracking technology in VR systems

January 22, 2021

The tracking of eye movement is one of the key elements of virtual and amplified reality technologies (VR/AR). A team from MSU together with a professor from RUDN University developed a mathematical model that helps accurately predict the next gaze fixation point and reduces the inaccuracy caused by blinking. The model would make VR/AR systems more realistic and sensitive to user actions. The results of the study were published in the SID Symposium Digest of Technical Papers.

Foveated rendering is a basic technology of VR systems. When a person looks at something, their gaze is focused on the so-called foveated region, and everything else is covered by peripheral vision. Therefore, a computer has to render the images in the foveated region with the highest degree of detail, while other parts require less computational powers. This approach helps improve computational performance and eliminates issues caused by the gap between the limited capabilities of graphic processors and increasing display resolution. However, foveated rendering technology is limited in speed and accuracy of the next gaze fixation point prediction because the movement of a human eye is a complex and largely random process. To solve this issue, a team of researchers from MSU together with a professor from RUDN University developed a mathematical modeling method that helps calculate next gaze fixation points in advance.

"One of the issues with foveated rendering is timely prediction of the next gaze fixation point because vision is a complex stochastic process. We suggested a mathematical model that predicts gaze fixation point changes," said Prof. Viktor Belyaev, a Ph.D. in Technical Sciences from the Department of Mechanics and Mechatronics of RUDN University.

The predictions of the model are based on the study of the so-called saccadic movements (fast and rhythmic movements of the eye). They accompany the shifts of our gaze from one object to another and can suggest the next fixation point. The ratio between the length, range, and maximum speed of saccadic eye movements is determined by certain empirical regularities. However, these models cannot be used by eye trackers to predict eye movements because they are not accurate enough. Therefore, the researchers focused on a mathematical model that helped them obtain saccadic movement parameters. After that, this data was used to calculate the foveated region of an image.

The new method was tested experimentally using a VR helmet and AR glasses. The eye tracker based on the mathematical model was able to detect minor eye movements (3.4 minutes, which is equal to 0.05 degrees), and the inaccuracy amounted to 6.7 minutes (0.11 degrees). Moreover, the team managed to eliminate the calculation error caused by blinking: a filter included in the model reduced the inaccuracy 10 times. The results of the work could be used in VR modeling, video games, and in medicine for surgeries and vision disorders diagnostics.

"We have effectively solved the issue with the foveated rendering technology that existed in the mass production of VR systems. In the future, we plan to calibrate our eye tracker to reduce the impact of display or helmet movements against a user's head," added Prof. Viktor Belyaev from RUDN University.

RUDN University

Related Mathematical Model Articles from Brightsurf:

A mathematical model facilitates inventory management in the food supply chain
A research study in the Diverfarming project integrates transport resources and inventory management in a model that seeks economic efficiency and to avoid shortages

Mathematical modelling to prevent fistulas
It is better to invest in measures that make it easier for women to visit a doctor during pregnancy than measures to repair birth injuries.

Predicting heat death in species more reliable with new mathematical model
An international research with the involvement of the Universitat Autònoma de Barcelona (UAB), published in Science, has developed a new dynamic mathematical model which represents a change in paradigm in predicting the probability of heat-related mortality in small species.

Using a Gaussian mathematical model to define eruptive stages of young volcanic rocks
Precise dating of young samples since the Quaternary has been a difficult problem in the study of volcanoes and surface environment.

Moffitt mathematical model predicts patient outcomes to adaptive therapy
In an article published in Nature Communications, Moffitt Cancer Center researchers provide a closer look at a mathematical model and data showing that individual patient alterations in the prostate-specific antigen (PSA) biomarker early in cancer treatment can predict outcomes to later treatment cycles of adaptive therapy.

New mathematical model can more effectively track epidemics
As COVID-19 spreads worldwide, leaders are relying on mathematical models to make public health and economic decisions.

Mathematical model could lead to better treatment for diabetes
MIT researchers have developed a mathematical model that can predict the behavior of glucose-responsive insulin in humans and in rodents.

New mathematical model reveals how major groups arise in evolution
Researchers at Uppsala University and the University of Leeds presents a new mathematical model of patterns of diversity in the fossil record, which offers a solution to Darwin's ''abominable mystery'' and strengthens our understanding of how modern groups originate.

Mathematical model reveals behavior of cellular enzymes
Mathematical modeling helps researchers to understand how enzymes in the body work to ensure normal functioning.

New mathematical model for amyloid formation
Scientists report on a mathematical model for the formation of amyloid fibrils.

Read More: Mathematical Model News and Mathematical Model Current Events is a participant in the Amazon Services LLC Associates Program, an affiliate advertising program designed to provide a means for sites to earn advertising fees by advertising and linking to