Nav: Home

Getting real with immersive sword fights

June 23, 2020

Sword fights are often the weak link in virtual reality (VR) fighting games, with digital avatars engaging in battle using imprecise, pre-recorded movements that barely reflect the player's actions or intentions. Now a team at the University of Bath, in collaboration with the game development studio Ninja Theory, has found a solution to the challenges of creating realistic VR sword fights: Touche - a data-driven computer model based on machine learning.

Dr Christof Lutteroth, who created Touche with colleague Dr Julian Padget and EngD student Javier Dehesa, said: "Touche increases the realism of a sword fight by generating responsive animations against attacks and eliminating non-reactive behaviour from characters.

"Using our model, a game character can anticipate all possible fight situations and react to them, resulting in a more enjoyable and immersive game experience."

The unpredictability of user actions presents a major conundrum for designers of VR games, explained Dr Lutteroth, who is a senior lecturer in Computer Science, director of Real and Virtual Environments Augmentation Labs (REVEAL) and co-investigator at the Centre for the Analysis of Motion, Entertainment Research and Applications (CAMERA). "VR games offer new freedom for players to interact naturally using motion, but this makes it harder to design games that react to player motions convincingly," he said.

He added: "There are different expectations for screen-based video games. With these, a player presses 'attack' and their character displays a sequence of animations. But in a VR game, the player input is much harder to process."

The Touche framework for VR sword fighting simplifies the necessary technical work to achieve a convincing simulation. It eliminates the need for game designers to add layer upon layer of detail when programming how a character should move in a particular situation (for instance, to block a particular sword attack). Instead, actors wearing motion capture equipment are asked to perform a range of sword fighting movements, and Touche builds a model from these movements. The virtual version of the actor is able to react to different situations in a similar fashion to a flesh-and-blood fighter. Game designers can then fine-tune this model to meet their needs by adjusting high-level parameters, such as how skilled and aggressive the game character should be. All this saves game developers a lot of time and leads to more realistic results.

For the Bath study, 12 volunteers were asked to take part in two three-minute sword fights: for the first fight, they used technology that is currently available and for the second, they used Touche. Touche had a strong positive effect on realism and the perceived sword fighting skills of game characters. Feedback from participants pointed to a convincing preference for Touche, with current sword fights being described as 'unresponsive' and 'clumsy' by comparison.

"Based on this, we are convinced that Touche can deliver more enjoyable, realistic and immersive sword fighting experiences, presenting a more skilled and less repetitive opponent behaviour," said Dr Lutteroth. "I'm convinced this framework is the future for games - not only for sword fighting but also for other types of interaction between game characters. It will save developers a lot of time."

Javier Dehesa Javier, who is based at the Centre for Digital Entertainment, interviewed game developers who had tested this new technology. He said: "Developers see the Touche framework as an important practical step in the industry towards data-driven interaction techniques. We could see this technology appear in commercial games very soon."

Touche: Data-Driven Interactive Sword Fighting in Virtual Reality is published by CHI '20: Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems.

Video to accompany press release: https://vimeo.com/430682565
-end-


University of Bath

Related Virtual Reality Articles:

From virtual to reality! Virtual training improves physical and cognitive functions
Researchers at the Smart-Aging Research Center (IDAC) at Tohoku University have developed an innovative training protocol that, utilizing immersive virtual reality (IVR), leads to real physical and cognitive benefits.
Virtual and augmented reality: warnings about the ethical dangers
Research on virtual reality started in the eighties, but it is now that good quality is available to the public and it can become a mass consumer product soon.
Easing the burden of coronavirus with virtual reality
A new article discusses the psychological stresses imposed by the coronavirus pandemic and suggests that virtual reality can help alleviate the psychological impact of the need for social isolation.
Virtual reality makes empathy easier
Virtual reality activates brain networks that increase your ability to identify with other people, according to new research published in eNeuro.
Physiotherapy could be done at home using virtual reality
Virtual reality could help physiotherapy patients complete their exercises at home successfully thanks to researchers at WMG, University of Warwick, who managed to combine VR technology with 3D motion capture.
Using virtual reality to help individuals with autism spectrum disorder
Novel interventions using virtual reality to aid individuals with autism spectrum disorder (ASD) handle common scenarios may include helping youngsters navigate air travel.
Virtual reality illuminates the power of opioid-associated memories
The brain acts differently when remembering environments associated with drug use.
Virtual reality could help flu vaccination rates
Using a virtual reality simulation to show how flu spreads and its impact on others could be a way to encourage more people to get a flu vaccination, according to a study by researchers at the University of Georgia and the Oak Ridge Associated Universities in Oak Ridge, Tennessee.
Virtual reality becomes more real
Scientists from Skoltech ADASE (Advanced Data Analytics in Science and Engineering) lab have found a way to enhance depth map resolution, which should make virtual reality and computer graphics more realistic.
Is virtual reality the next big thing in art therapy?
Researchers from Drexel University's College of Nursing and Health Professions in the Creative Arts Therapies Department conducted a study to see if virtual reality can be used as an expressive tool in art therapy.
More Virtual Reality News and Virtual Reality Current Events

Trending Science News

Current Coronavirus (COVID-19) News

Top Science Podcasts

We have hand picked the top science podcasts of 2020.
Now Playing: TED Radio Hour

Listen Again: The Power Of Spaces
How do spaces shape the human experience? In what ways do our rooms, homes, and buildings give us meaning and purpose? This hour, TED speakers explore the power of the spaces we make and inhabit. Guests include architect Michael Murphy, musician David Byrne, artist Es Devlin, and architect Siamak Hariri.
Now Playing: Science for the People

#576 Science Communication in Creative Places
When you think of science communication, you might think of TED talks or museum talks or video talks, or... people giving lectures. It's a lot of people talking. But there's more to sci comm than that. This week host Bethany Brookshire talks to three people who have looked at science communication in places you might not expect it. We'll speak with Mauna Dasari, a graduate student at Notre Dame, about making mammals into a March Madness match. We'll talk with Sarah Garner, director of the Pathologists Assistant Program at Tulane University School of Medicine, who takes pathology instruction out of...
Now Playing: Radiolab

What If?
There's plenty of speculation about what Donald Trump might do in the wake of the election. Would he dispute the results if he loses? Would he simply refuse to leave office, or even try to use the military to maintain control? Last summer, Rosa Brooks got together a team of experts and political operatives from both sides of the aisle to ask a slightly different question. Rather than arguing about whether he'd do those things, they dug into what exactly would happen if he did. Part war game part choose your own adventure, Rosa's Transition Integrity Project doesn't give us any predictions, and it isn't a referendum on Trump. Instead, it's a deeply illuminating stress test on our laws, our institutions, and on the commitment to democracy written into the constitution. This episode was reported by Bethel Habte, with help from Tracie Hunte, and produced by Bethel Habte. Jeremy Bloom provided original music. Support Radiolab by becoming a member today at Radiolab.org/donate.     You can read The Transition Integrity Project's report here.