Dartmouth-industry collaborations improve computer graphics

July 24, 2020

HANOVER, N.H. - July 24, 2020 - Researchers at Dartmouth, in collaboration with industry partners, have developed software techniques that make lighting in computer-generated images look more realistic. The research will be presented at the upcoming ACM SIGGRAPH conference, the premier venue for research in computer graphics.

The new techniques focus on "real time" graphics which need to maintain the illusion of interactivity as scenes change in response to user moves. These graphics can be used in applications such as video games, extended reality, and scientific visualization tools.

Both papers demonstrate how developers can create sophisticated lighting effects by adapting a popular rendering technique known as ray tracing.

"Over the last decade, ray tracing has dramatically increased the realism and visual richness of computer-generated images in movies where producing just a single frame can take hours," said Wojciech Jarosz, an associate professor of computer science at Dartmouth who served as the senior researcher for both projects. "Our papers describe two very different approaches for bringing realistic ray-traced lighting to the constraints of real time graphics."

The first project, developed with NVIDIA, envisions the possibilities for future games once developers incorporate NVIDIA's hardware-accelerated RTX ray tracing platform. Recent games have started to use RTX for physically correct shadows and reflections, but quality and complexity of lighting is currently limited by the small number of rays that can be traced per frame.

The new technique, called reservoir-based spatiotemporal importance resampling (ReSTIR), creates realistic lighting and shadows from millions of artificial light sources. The ReSTIR approach dramatically increases the quality of rendering on a computer's graphics card by reusing rays that were traced in neighboring pixels and in prior frames.

The new technique can be integrated into the design of future games and works up to 65 times faster than previous rendering techniques.

"This technology is not just exciting for what it can bring to real-time applications like games, but also its impact in the movie industry and beyond," said Benedikt Bitterli, a PhD student at Dartmouth who served as the first author of a research paper on the technique.

The second project, conducted in collaboration with Activision, describes how the video game publisher has incorporated increasingly realistic lighting effects into its games.

Traditionally, video games create lighting sequences in real time using what are called "baked" solutions: the complex ray-traced illumination is computed only once through a time-consuming process. The lighting created using this technique can be displayed easily during gameplay, but it is constrained to assuming a fixed configuration for a scene. As a result, the lighting cannot easily react to the movement of characters and cameras.

The research paper describes how Activision gradually evolved its "UberBake" system from the static approach to one which can depict subtle lighting changes in response to player interactions, such as turning lights on and off, or opening and closing doors.

Since UberBake was developed over many years to work on current games, it needed to work on a variety of existing hardware, ranging from high-end PCs to previous-generation gaming consoles.

"Video games are used by millions of people around the world," said Dario Seyb, a PhD student at Dartmouth who served as the research paper's co-first author. "With so many people interacting with video games, this technology can have a huge impact."

Dartmouth researchers on both projects are affiliated with the Dartmouth Visual Computing Lab.

"These industry collaborations have been fantastic. They allow our students to work on foundational academic research informed by practical problems in industry, allowing the work to have a more immediate, real-world impact," said Jarosz.

The research papers will be published in ACM Transactions on Graphics and presented at SIGGRAPH 2020 taking place online during the summer.
About Dartmouth

Founded in 1769, Dartmouth is a member of the Ivy League and offers the world's premier liberal arts education, combining its deep commitment to outstanding undergraduate and graduate teaching with distinguished research and scholarship in the arts and sciences and its leading professional schools: the Geisel School of Medicine, the Guarini School of Graduate and Advanced Studies, Thayer School of Engineering and Tuck School of Business.

Dartmouth College

Related Video Games Articles from Brightsurf:

Video games improve the visual attention of expert players
Long-term experiences of action real-time strategy games leads to improvements in temporal visual selective attention.

Study questions video games' effects on violent behavior
A new Contemporary Economic Policy study finds that there is not enough information to support the claim that violent video games lead to acts of violence.

Do video games drive obesity?
Are children, teenagers and adults who spend a lot of time playing video games really more obese?

DeepMind's new gamer AI goes 'for the win' in multiplayer first-person video games
DeepMind researchers have taught artificially intelligent gamers to play a popular 3D multiplayer first-person video game with human-like skills -- a previously insurmountable task.

How does dark play impact the effectiveness of serious video games?
A new study has shown that allowing ''dark play'' in a serious video game intended to practice skills transferable to a real-life setting does not impact the game's effectiveness.

Study: Collaborative video games could increase office productivity
Move over trust falls and ropes courses, turns out playing video games with coworkers is the real path to better performance at the office.

Pitt researcher uses video games to unlock new levels of A.I.
Dr. Jiang designs algorithms that learn decision strategies in complex and uncertain environments like video games.

For blind gamers, equal access to racing video games
Computer Scientist Brian A. Smith has developed the RAD -- a racing auditory display -- to enable visually impaired gamers play the same types of racing games that sighted players play with the same speed, control, and excitement as sighted players.

Video games to improve mobility after a stroke
A joint research by the Basque research center BCBL and the London Imperial College reveals that, after a cerebral infarction, injuries in areas that control attention also cause motility problems.

No evidence to support link between violent video games and behaviour
Researchers at the University of York have found no evidence to support the theory that video games make players more violent.

Read More: Video Games News and Video Games Current Events
Brightsurf.com is a participant in the Amazon Services LLC Associates Program, an affiliate advertising program designed to provide a means for sites to earn advertising fees by advertising and linking to Amazon.com.