Nav: Home

These trippy images were designed by AI to super-stimulate monkey neurons

May 02, 2019

To find out which sights specific neurons in monkeys "like" best, researchers designed an algorithm, called XDREAM, that generated images that made neurons fire more than any natural images the researchers tested. As the images evolved, they started to look like distorted versions of real-world stimuli. The work appears May 2 in the journal Cell.

"When given this tool, cells began to increase their firing rate beyond levels we have seen before, even with normal images pre-selected to elicit the highest firing rates," explains co-first author Carlos Ponce, then a post-doctoral fellow in the laboratory of senior author Margaret Livingstone at Harvard Medical School and now a faculty member at Washington University in St. Louis.

"What started to emerge during each experiment were pictures that were reminiscent of shapes in the world but were not actual objects in the world," he says. "We were seeing something that was more like the language cells use with each other."

Researchers have known that neurons in the visual cortex of primate brains respond to complex images, like faces, and that most neurons are quite selective in their image preference. Earlier studies on neuronal preference used many natural images to see which images caused neurons to fire most. However, this approach is limited by the fact that one cannot present all possible images to understand what exactly will best stimulate the cell.

The XDREAM algorithm uses the firing rate of a neuron to guide the evolution of a novel, synthetic image. It goes through a series of images over the course of minutes, mutates them, combines them, and then shows a new series of images. At first, the images looked like noise, but gradually they changed into shapes that resembled faces or something recognizable in the animal's environment, like the food hopper in the animals' room or familiar people wearing surgical scrubs. The algorithm was developed by Will Xiao in the laboratory of Gabriel Kreiman at Children's Hospital and tested on real neurons at Harvard Medical School.

"The big advantage of this approach is that it allows the neuron to build its own preferred images from scratch, using a tool that is not limited by much, that can create anything in the world or even things that don't exist in the world," says Ponce.

"In this way we have evolved a super-stimulus that drives the cell better than any natural stimulus we could guess at," says Livingstone. "This approach allows you to use artificial intelligence to figure out what triggers neurons best. It's a totally unbiased way of asking the cell what it really wants, what would make it fire the most."

From this study, the researchers believe they are seeing that the brain learns to abstract statistically relevant features of its world. "We are seeing that the brain is analyzing the visual scene, and driven by experience, extracting information that is important to the individual over time," says Ponce. "The brain is adapting to its environment and encoding ecologically significant information in unpredictable ways."

The team believes this technology can be applied to any neuron in the brain that responds to sensory information, such as auditory neurons, hippocampal neurons, and prefrontal cortex neurons where memories can be accessed. "This is important because as artificial intelligence researchers develop models that work as well as the brain does - or even better - we will still need to understand which networks are more likely to behave safely and further human goals," Ponce says. "More efficient AI can be grounded by knowledge of how the brain works."
-end-
This work was supported by grants from the National Institutes of Health and the National Science Foundation.

Cell, Ponce, Xiao, and Schade et al.: "Evolving images for visual neurons using a deep generative network reveals coding principles and neuronal preferences" https://www.cell.com/cell/fulltext/S0092-8674(19)30391-5

Cell (@CellCellPress), the flagship journal of Cell Press, is a bimonthly journal that publishes findings of unusual significance in any area of experimental biology, including but not limited to cell biology, molecular biology, neuroscience, immunology, virology and microbiology, cancer, human genetics, systems biology, signaling, and disease mechanisms and therapeutics. Visit: http://www.cell.com/cell. To receive Cell Press media alerts, contact press@cell.com.

Cell Press

Related Neurons Articles:

New tool to identify and control neurons
One of the big challenges in the Neuroscience field is to understand how connections and communications trigger our behavior.
Neurons that regenerate, neurons that die
In a new study published in Neuron, investigators report on a transcription factor that they have found that can help certain neurons regenerate, while simultaneously killing others.
How neurons use crowdsourcing to make decisions
When many individual neurons collect data, how do they reach a unanimous decision?
Neurons can learn temporal patterns
Individual neurons can learn not only single responses to a particular signal, but also a series of reactions at precisely timed intervals.
A turbo engine for tracing neurons
Putting a turbo engine into an old car gives it an entirely new life -- suddenly it can go further, faster.
Brain neurons help keep track of time
Turning the theory of how the human brain perceives time on its head, a novel analysis in mice reveals that dopamine neuron activity plays a key role in judgment of time, slowing down the internal clock.
During infancy, neurons are still finding their places
Researchers have identified a large population of previously unrecognized young neurons that migrate in the human brain during the first few months of life, contributing to the expansion of the frontal lobe, a region important for social behavior and executive function.
How many types of neurons are there in the brain?
For decades, scientists have struggled to develop a comprehensive census of cell types in the brain.
Molecular body guards for neurons
In the brain, patterns of neural activity are perfectly balanced.
Engineering researchers use laser to 'weld' neurons
University of Alberta researchers have developed a method of connecting neurons, using ultrashort laser pulses -- a breakthrough technique that opens the door to new medical research and treatment opportunities.

Related Neurons Reading:

Best Science Podcasts 2019

We have hand picked the best science podcasts for 2019. Sit back and enjoy new science podcasts updated daily from your favorite science news services and scientists.
Now Playing: TED Radio Hour

Anthropomorphic
Do animals grieve? Do they have language or consciousness? For a long time, scientists resisted the urge to look for human qualities in animals. This hour, TED speakers explore how that is changing. Guests include biological anthropologist Barbara King, dolphin researcher Denise Herzing, primatologist Frans de Waal, and ecologist Carl Safina.
Now Playing: Science for the People

#SB2 2019 Science Birthday Minisode: Mary Golda Ross
Our second annual Science Birthday is here, and this year we celebrate the wonderful Mary Golda Ross, born 9 August 1908. She died in 2008 at age 99, but left a lasting mark on the science of rocketry and space exploration as an early woman in engineering, and one of the first Native Americans in engineering. Join Rachelle and Bethany for this very special birthday minisode celebrating Mary and her achievements. Thanks to our Patreons who make this show possible! Read more about Mary G. Ross: Interview with Mary Ross on Lash Publications International, by Laurel Sheppard Meet Mary Golda...