Project underway to preserve survivor's memories of the Holocaust in virtual form

January 04, 2016

The project is named Interact and has resulted in the creation of mixed reality virtual Holocaust survivors. Projected in 3D, they will give their personal testimony and then be capable of realistically interacting with the audience by responding to a huge variety of questions, using technology named ECA (Embodied Conversational Agent).

It is all made possible by conducting 3D HD stereoscopic video recording sessions with survivors, including their responses to hundreds of the questions deemed most likely to be asked. A computer can instantly detect and analyse the spoken question, so that the virtual survivor provides the appropriate response. The technology known as 'mixed reality' ensures high levels of realism.

Interact will become an important feature of the National Holocaust Centre and Museum in Nottinghamshire. Its partners in developing the system were the design consultancy Bright White, based in York, plus Professor Ma -- a world-leading academic in the increasingly important and varied field of serious games -- who provided research expertise in natural language processing and human computer interaction, which enables computers to 'talk' to humans.

"The purpose is to provide audiences with the rich experience of a human interaction," said Professor Ma. "And it means that in the future, when all the survivors have passed away, we can keep this experience and help future generations better understand the history."

There are thought to 800 Holocaust survivors still living in the UK. Most of those with actual memories of the Nazis and their attempted extermination of the Jews are in their 90s. Although many are still able to give personal testimony -- such as an annual Holocaust Memorial Lecture at the University of Huddersfield -- it is regarded as increasingly urgent to ensure that memories are retained for posterity.

Interact will do this in the most vivid way possible.

A broadly similar project has been in progress at the Shoah Foundation at the University of Southern California, but the system designed and developed by Professor Ma and the Interact partners means that survivors can be recorded at much less individual cost. So far, six have taken part week-long sessions at the Bright White studios, at which they begin by giving their personal testimonies and then provide their responses to questions from a pre-determined list.
The development of Interact has received funding from the Digital R&D Fund for the Arts, jointly funded by the innovation charity NESTA, and the Arts and Humanities Research Council. There has also been financial support from the National Lottery via Arts Council England.

A video presentation describing and demonstrating Interact has been produced and Professor Ma, plus Sarah Coward of the National Holocaust Centre and Museum and Chris Walker of Bright White, have written an in-depth article about the project and its scientific base. Entitled Interact: A Mixed Reality Virtual Survivor for Holocaust Testimonies, it is published by ACM in the Proceedings of the Annual Conference of Computer Human Interaction (OzCHI 2015).

University of Huddersfield

Related Memories Articles from Brightsurf:

Can sleep protect us from forgetting old memories?
Researchers at University of California San Diego School of Medicine report that sleep may help people to learn continuously through their lifetime by encoding new memories and protecting old ones.

Why are memories attached to emotions so strong?
Multiple neurons in the brain must fire in synchrony to create persistent memories tied to intense emotions, new research from Columbia neuroscientists has found.

False memories of crime appear real when retold to others
People are no better than chance at identifying when someone else is recounting a false or real memory of a crime, according to a new UCL study published in Frontiers in Psychology.

Can traumatic memories be erased?
Tokyo, Japan - Scientists from Tokyo Metropolitan University have discovered that Drosophila flies lose long-term memory (LTM) of a traumatic event when kept in the dark, the first confirmation of environmental light playing a role in LTM maintenance.

The way of making memories
How does the brain translate information from the outside world into something we remember?

A new discovery: How our memories stabilize while we sleep
Scientists at the Center for Interdisciplinary Research in Biology (CNRS/Coll├Ęge de France/INSERM) have shown that delta waves emitted while we sleep are not generalized periods of silence during which the cortex rests, as has been described for decades in the scientific literature.

How memories form and fade
Caltech researchers identify the neural processes that make some memories fade rapidly while other memories persist over time.

Firework memories
Recently Weizmann Institute scientists succeeded in recording these rapid bursts of activity -- called 'hippocampal ripples' -- in the human brain, and they were able to demonstrate their importance as a neuronal mechanism underlying the engraving of new memories and their subsequent recall.

Your nose knows when it comes to stronger memories
Memories are stronger when the original experiences are accompanied by unpleasant odors, a team of researchers has found.

Proof it's possible to enhance or suppress memories
Boston University neuroscientist Steve Ramirez and collaborators have published a new paper showing memories are pliable if you know which regions of the brain's hippocampus to stimulate, which could someday enable personalized treatment for people with PTSD, depression and anxiety.

Read More: Memories News and Memories Current Events is a participant in the Amazon Services LLC Associates Program, an affiliate advertising program designed to provide a means for sites to earn advertising fees by advertising and linking to