Nav: Home

Learning in the absence of external feedback

April 06, 2016

Rewards act as external factors that influence and reinforce learning processes. Researchers from Charité - Universitätsmedizin Berlin have now been able to show that the brain can produce its own learning signals in cases where no such external feedback is available. A report on the mechanisms underlying these self-generated feedback signals has been published in the current volume of eLife*, and shows clear parallels between the neurobiological processes involved in learning based on external and self-generated feedback.

While learning forms an integral part of our day-to-day lives, there are only certain instances in which we receive external feedback about our performance. A group of researchers, led by Prof. Dr. Philipp Sterzer from the Visual Perception Working Group at Charité's Department of Psychiatry and Psychotherapy, have investigated the neurobiological basis of learning in the absence of external feedback. Using functional magnetic resonance imaging, the researchers measured neural activity levels in the brains of healthy volunteers as they performed challenging perceptual learning tasks. Instead of receiving feedback about their performance, participants were asked to report levels of confidence in their assessment of visual stimuli.

"Our experiments showed that the brain activity levels recorded during confidence-based learning mirrored many of the features previously recorded in relation to external feedback-based learning," says the study's first author, Dr. Matthias Guggenmos. Earlier studies on external, reward-based feedback had shown that participants' brain activity levels at the start of a task reflected their prediction about the upcoming reward. Once the reward had been received, a 'prediction error' was recorded reflecting the difference between predicted and actual reward. As part of the current study, the researchers were able to record an identical response pattern in learning processes not involving external feedback. In this study, the prediction signal corresponded to the participant's own level of confidence, while the prediction error corresponded to the surprise experienced at the discrepancy in the actual level of confidence. "These remarkable parallels suggest that subjective confidence - just like external reward - is a general learning signal, and that it may also play an important role in other types of learning that do not involve feedback, such as school homework assignments," says Dr. Guggenmos.

The study was based on the hypothesis that, in the absence of external signals, the brain may be capable of generating its own feedback signals. "Our assumption was that the level of subjective confidence experienced in relation to one's own perception might be a measure of self-generated feedback," explains Dr. Guggenmos, adding: "The general idea is that the brain reinforces perceptual processes that are associated with a high level of confidence, while avoiding processes associated with a low level of confidence." The researchers were able to explain the participants' answers by using a mathematical model in which external feedback was replaced with subjective confidence. Results also showed a systematic relationship between the strength of the neural confidence signal measured and the actual learning success recorded during the perceptual task, suggesting that confidence signals exert a measurable effect on perceptual learning.
-end-
*Matthias Guggenmos, Gregor Wilbertz, Martin N. Hebart, Philipp Sterzer. Mesolimbic confidence signals guide perceptual learning in the absence of external feedback. Elife. 2016 Mar 29. doi: 10.7554/eLife.13388. http://elifesciences.org/content/5/e13388v1

Contact:
Dr. Matthias Guggenmos
Department of Psychiatry and Psychotherapy
Charité - Universitätsmedizin Berlin
Tel: +49 (30) 450 517 131
Email: matthias.guggenmos@charite.de

Links:
Visual Perception Working Group (AG Visuelle Wahrnehmung)

Charité - Universitätsmedizin Berlin

Related Brain Articles:

Study describes changes to structural brain networks after radiotherapy for brain tumors
Researchers compared the thickness of brain cortex in patients with brain tumors before and after radiation therapy was applied and found significant dose-dependent changes in the structural properties of cortical neural networks, at both the local and global level.
Blue Brain team discovers a multi-dimensional universe in brain networks
Using a sophisticated type of mathematics in a way that it has never been used before in neuroscience, a team from the Blue Brain Project has uncovered a universe of multi-dimensional geometrical structures and spaces within the networks of the brain.
New brain mapping tool produces higher resolution data during brain surgery
Researchers have developed a new device to map the brain during surgery and distinguish between healthy and diseased tissues.
Newborn baby brain scans will help scientists track brain development
Scientists have today published ground-breaking scans of newborn babies' brains which researchers from all over the world can download and use to study how the human brain develops.
New test may quickly identify mild traumatic brain injury with underlying brain damage
A new test using peripheral vision reaction time could lead to earlier diagnosis and more effective treatment of mild traumatic brain injury, often referred to as a concussion.
This is your brain on God: Spiritual experiences activate brain reward circuits
Religious and spiritual experiences activate the brain reward circuits in much the same way as love, sex, gambling, drugs and music, report researchers at the University of Utah School of Medicine.
Brain scientists at TU Dresden examine brain networks during short-term task learning
'Practice makes perfect' is a common saying. We all have experienced that the initially effortful implementation of novel tasks is becoming rapidly easier and more fluent after only a few repetitions.
Balancing time & space in the brain: New model holds promise for predicting brain dynamics
A team of scientists has extended the balanced network model to provide deep and testable predictions linking brain circuits to brain activity.
New view of brain development: Striking differences between adult and newborn mouse brain
Spikes in neuronal activity in young mice do not spur corresponding boosts in blood flow -- a discovery that stands in stark contrast to the adult mouse brain.
Map of teenage brain provides evidence of link between antisocial behavior and brain development
The brains of teenagers with serious antisocial behavior problems differ significantly in structure to those of their peers, providing the clearest evidence to date that their behavior stems from changes in brain development in early life, according to new research led by the University of Cambridge and the University of Southampton, in collaboration with the University of Rome Tor Vergata in Italy.

Related Brain Reading:

Best Science Podcasts 2019

We have hand picked the best science podcasts for 2019. Sit back and enjoy new science podcasts updated daily from your favorite science news services and scientists.
Now Playing: TED Radio Hour

Digital Manipulation
Technology has reshaped our lives in amazing ways. But at what cost? This hour, TED speakers reveal how what we see, read, believe — even how we vote — can be manipulated by the technology we use. Guests include journalist Carole Cadwalladr, consumer advocate Finn Myrstad, writer and marketing professor Scott Galloway, behavioral designer Nir Eyal, and computer graphics researcher Doug Roble.
Now Playing: Science for the People

#530 Why Aren't We Dead Yet?
We only notice our immune systems when they aren't working properly, or when they're under attack. How does our immune system understand what bits of us are us, and what bits are invading germs and viruses? How different are human immune systems from the immune systems of other creatures? And is the immune system so often the target of sketchy medical advice? Those questions and more, this week in our conversation with author Idan Ben-Barak about his book "Why Aren't We Dead Yet?: The Survivor’s Guide to the Immune System".