Learning in the absence of external feedback

April 06, 2016

Rewards act as external factors that influence and reinforce learning processes. Researchers from Charité - Universitätsmedizin Berlin have now been able to show that the brain can produce its own learning signals in cases where no such external feedback is available. A report on the mechanisms underlying these self-generated feedback signals has been published in the current volume of eLife*, and shows clear parallels between the neurobiological processes involved in learning based on external and self-generated feedback.

While learning forms an integral part of our day-to-day lives, there are only certain instances in which we receive external feedback about our performance. A group of researchers, led by Prof. Dr. Philipp Sterzer from the Visual Perception Working Group at Charité's Department of Psychiatry and Psychotherapy, have investigated the neurobiological basis of learning in the absence of external feedback. Using functional magnetic resonance imaging, the researchers measured neural activity levels in the brains of healthy volunteers as they performed challenging perceptual learning tasks. Instead of receiving feedback about their performance, participants were asked to report levels of confidence in their assessment of visual stimuli.

"Our experiments showed that the brain activity levels recorded during confidence-based learning mirrored many of the features previously recorded in relation to external feedback-based learning," says the study's first author, Dr. Matthias Guggenmos. Earlier studies on external, reward-based feedback had shown that participants' brain activity levels at the start of a task reflected their prediction about the upcoming reward. Once the reward had been received, a 'prediction error' was recorded reflecting the difference between predicted and actual reward. As part of the current study, the researchers were able to record an identical response pattern in learning processes not involving external feedback. In this study, the prediction signal corresponded to the participant's own level of confidence, while the prediction error corresponded to the surprise experienced at the discrepancy in the actual level of confidence. "These remarkable parallels suggest that subjective confidence - just like external reward - is a general learning signal, and that it may also play an important role in other types of learning that do not involve feedback, such as school homework assignments," says Dr. Guggenmos.

The study was based on the hypothesis that, in the absence of external signals, the brain may be capable of generating its own feedback signals. "Our assumption was that the level of subjective confidence experienced in relation to one's own perception might be a measure of self-generated feedback," explains Dr. Guggenmos, adding: "The general idea is that the brain reinforces perceptual processes that are associated with a high level of confidence, while avoiding processes associated with a low level of confidence." The researchers were able to explain the participants' answers by using a mathematical model in which external feedback was replaced with subjective confidence. Results also showed a systematic relationship between the strength of the neural confidence signal measured and the actual learning success recorded during the perceptual task, suggesting that confidence signals exert a measurable effect on perceptual learning.
-end-
*Matthias Guggenmos, Gregor Wilbertz, Martin N. Hebart, Philipp Sterzer. Mesolimbic confidence signals guide perceptual learning in the absence of external feedback. Elife. 2016 Mar 29. doi: 10.7554/eLife.13388. http://elifesciences.org/content/5/e13388v1

Contact:
Dr. Matthias Guggenmos
Department of Psychiatry and Psychotherapy
Charité - Universitätsmedizin Berlin
Tel: +49 (30) 450 517 131
Email: matthias.guggenmos@charite.de

Links:
Visual Perception Working Group (AG Visuelle Wahrnehmung)

Charité - Universitätsmedizin Berlin

Related Brain Articles from Brightsurf:

Glioblastoma nanomedicine crosses into brain in mice, eradicates recurring brain cancer
A new synthetic protein nanoparticle capable of slipping past the nearly impermeable blood-brain barrier in mice could deliver cancer-killing drugs directly to malignant brain tumors, new research from the University of Michigan shows.

Children with asymptomatic brain bleeds as newborns show normal brain development at age 2
A study by UNC researchers finds that neurodevelopmental scores and gray matter volumes at age two years did not differ between children who had MRI-confirmed asymptomatic subdural hemorrhages when they were neonates, compared to children with no history of subdural hemorrhage.

New model of human brain 'conversations' could inform research on brain disease, cognition
A team of Indiana University neuroscientists has built a new model of human brain networks that sheds light on how the brain functions.

Human brain size gene triggers bigger brain in monkeys
Dresden and Japanese researchers show that a human-specific gene causes a larger neocortex in the common marmoset, a non-human primate.

Unique insight into development of the human brain: Model of the early embryonic brain
Stem cell researchers from the University of Copenhagen have designed a model of an early embryonic brain.

An optical brain-to-brain interface supports information exchange for locomotion control
Chinese researchers established an optical BtBI that supports rapid information transmission for precise locomotion control, thus providing a proof-of-principle demonstration of fast BtBI for real-time behavioral control.

Transplanting human nerve cells into a mouse brain reveals how they wire into brain circuits
A team of researchers led by Pierre Vanderhaeghen and Vincent Bonin (VIB-KU Leuven, Université libre de Bruxelles and NERF) showed how human nerve cells can develop at their own pace, and form highly precise connections with the surrounding mouse brain cells.

Brain scans reveal how the human brain compensates when one hemisphere is removed
Researchers studying six adults who had one of their brain hemispheres removed during childhood to reduce epileptic seizures found that the remaining half of the brain formed unusually strong connections between different functional brain networks, which potentially help the body to function as if the brain were intact.

Alcohol byproduct contributes to brain chemistry changes in specific brain regions
Study of mouse models provides clear implications for new targets to treat alcohol use disorder and fetal alcohol syndrome.

Scientists predict the areas of the brain to stimulate transitions between different brain states
Using a computer model of the brain, Gustavo Deco, director of the Center for Brain and Cognition, and Josephine Cruzat, a member of his team, together with a group of international collaborators, have developed an innovative method published in Proceedings of the National Academy of Sciences on Sept.

Read More: Brain News and Brain Current Events
Brightsurf.com is a participant in the Amazon Services LLC Associates Program, an affiliate advertising program designed to provide a means for sites to earn advertising fees by advertising and linking to Amazon.com.