Nav: Home

Dartmouth-industry collaborations improve computer graphics

July 24, 2020

HANOVER, N.H. - July 24, 2020 - Researchers at Dartmouth, in collaboration with industry partners, have developed software techniques that make lighting in computer-generated images look more realistic. The research will be presented at the upcoming ACM SIGGRAPH conference, the premier venue for research in computer graphics.

The new techniques focus on "real time" graphics which need to maintain the illusion of interactivity as scenes change in response to user moves. These graphics can be used in applications such as video games, extended reality, and scientific visualization tools.

Both papers demonstrate how developers can create sophisticated lighting effects by adapting a popular rendering technique known as ray tracing.

"Over the last decade, ray tracing has dramatically increased the realism and visual richness of computer-generated images in movies where producing just a single frame can take hours," said Wojciech Jarosz, an associate professor of computer science at Dartmouth who served as the senior researcher for both projects. "Our papers describe two very different approaches for bringing realistic ray-traced lighting to the constraints of real time graphics."

The first project, developed with NVIDIA, envisions the possibilities for future games once developers incorporate NVIDIA's hardware-accelerated RTX ray tracing platform. Recent games have started to use RTX for physically correct shadows and reflections, but quality and complexity of lighting is currently limited by the small number of rays that can be traced per frame.

The new technique, called reservoir-based spatiotemporal importance resampling (ReSTIR), creates realistic lighting and shadows from millions of artificial light sources. The ReSTIR approach dramatically increases the quality of rendering on a computer's graphics card by reusing rays that were traced in neighboring pixels and in prior frames.

The new technique can be integrated into the design of future games and works up to 65 times faster than previous rendering techniques.

"This technology is not just exciting for what it can bring to real-time applications like games, but also its impact in the movie industry and beyond," said Benedikt Bitterli, a PhD student at Dartmouth who served as the first author of a research paper on the technique.

The second project, conducted in collaboration with Activision, describes how the video game publisher has incorporated increasingly realistic lighting effects into its games.

Traditionally, video games create lighting sequences in real time using what are called "baked" solutions: the complex ray-traced illumination is computed only once through a time-consuming process. The lighting created using this technique can be displayed easily during gameplay, but it is constrained to assuming a fixed configuration for a scene. As a result, the lighting cannot easily react to the movement of characters and cameras.

The research paper describes how Activision gradually evolved its "UberBake" system from the static approach to one which can depict subtle lighting changes in response to player interactions, such as turning lights on and off, or opening and closing doors.

Since UberBake was developed over many years to work on current games, it needed to work on a variety of existing hardware, ranging from high-end PCs to previous-generation gaming consoles.

"Video games are used by millions of people around the world," said Dario Seyb, a PhD student at Dartmouth who served as the research paper's co-first author. "With so many people interacting with video games, this technology can have a huge impact."

Dartmouth researchers on both projects are affiliated with the Dartmouth Visual Computing Lab.

"These industry collaborations have been fantastic. They allow our students to work on foundational academic research informed by practical problems in industry, allowing the work to have a more immediate, real-world impact," said Jarosz.

The research papers will be published in ACM Transactions on Graphics and presented at SIGGRAPH 2020 taking place online during the summer.
About Dartmouth

Founded in 1769, Dartmouth is a member of the Ivy League and offers the world's premier liberal arts education, combining its deep commitment to outstanding undergraduate and graduate teaching with distinguished research and scholarship in the arts and sciences and its leading professional schools: the Geisel School of Medicine, the Guarini School of Graduate and Advanced Studies, Thayer School of Engineering and Tuck School of Business.

Dartmouth College

Related Video Games Articles:

Video games improve the visual attention of expert players
Long-term experiences of action real-time strategy games leads to improvements in temporal visual selective attention.
Study questions video games' effects on violent behavior
A new Contemporary Economic Policy study finds that there is not enough information to support the claim that violent video games lead to acts of violence.
Do video games drive obesity?
Are children, teenagers and adults who spend a lot of time playing video games really more obese?
DeepMind's new gamer AI goes 'for the win' in multiplayer first-person video games
DeepMind researchers have taught artificially intelligent gamers to play a popular 3D multiplayer first-person video game with human-like skills -- a previously insurmountable task.
How does dark play impact the effectiveness of serious video games?
A new study has shown that allowing ''dark play'' in a serious video game intended to practice skills transferable to a real-life setting does not impact the game's effectiveness.
Study: Collaborative video games could increase office productivity
Move over trust falls and ropes courses, turns out playing video games with coworkers is the real path to better performance at the office.
Pitt researcher uses video games to unlock new levels of A.I.
Dr. Jiang designs algorithms that learn decision strategies in complex and uncertain environments like video games.
For blind gamers, equal access to racing video games
Computer Scientist Brian A. Smith has developed the RAD -- a racing auditory display -- to enable visually impaired gamers play the same types of racing games that sighted players play with the same speed, control, and excitement as sighted players.
Video games to improve mobility after a stroke
A joint research by the Basque research center BCBL and the London Imperial College reveals that, after a cerebral infarction, injuries in areas that control attention also cause motility problems.
No evidence to support link between violent video games and behaviour
Researchers at the University of York have found no evidence to support the theory that video games make players more violent.
More Video Games News and Video Games Current Events

Trending Science News

Current Coronavirus (COVID-19) News

Top Science Podcasts

We have hand picked the top science podcasts of 2020.
Now Playing: TED Radio Hour

Listen Again: The Power Of Spaces
How do spaces shape the human experience? In what ways do our rooms, homes, and buildings give us meaning and purpose? This hour, TED speakers explore the power of the spaces we make and inhabit. Guests include architect Michael Murphy, musician David Byrne, artist Es Devlin, and architect Siamak Hariri.
Now Playing: Science for the People

#576 Science Communication in Creative Places
When you think of science communication, you might think of TED talks or museum talks or video talks, or... people giving lectures. It's a lot of people talking. But there's more to sci comm than that. This week host Bethany Brookshire talks to three people who have looked at science communication in places you might not expect it. We'll speak with Mauna Dasari, a graduate student at Notre Dame, about making mammals into a March Madness match. We'll talk with Sarah Garner, director of the Pathologists Assistant Program at Tulane University School of Medicine, who takes pathology instruction out of...
Now Playing: Radiolab

What If?
There's plenty of speculation about what Donald Trump might do in the wake of the election. Would he dispute the results if he loses? Would he simply refuse to leave office, or even try to use the military to maintain control? Last summer, Rosa Brooks got together a team of experts and political operatives from both sides of the aisle to ask a slightly different question. Rather than arguing about whether he'd do those things, they dug into what exactly would happen if he did. Part war game part choose your own adventure, Rosa's Transition Integrity Project doesn't give us any predictions, and it isn't a referendum on Trump. Instead, it's a deeply illuminating stress test on our laws, our institutions, and on the commitment to democracy written into the constitution. This episode was reported by Bethel Habte, with help from Tracie Hunte, and produced by Bethel Habte. Jeremy Bloom provided original music. Support Radiolab by becoming a member today at     You can read The Transition Integrity Project's report here.