Nav: Home

Why visual perception is a decision process

May 12, 2020

Neuroscientists at the Ruhr-Universität Bochum (RUB) together with colleagues at the Freiburg University show that this is not strictly the case. Instead, they show that prediction errors can occasionally appear as visual illusion when viewing rapid image sequences. Thus, rather than being explained away prediction errors remain in fact accessible at final processing stages forming perception. Previous theories of predictive coding need therefore to be revised. The study is reported in Plos One on 4. May 2020.

Our visual system starts making predictions within a few milliseconds

To fixate objects in the outside world, our eyes perform far more than one hundred thousand of rapid movements per day called saccades. However, as soon as our eyes rest about 100 milliseconds, the brain starts making predictions. Differences between previous and current image contents are then forwarded to subsequent processing stages as prediction errors. The advantage to deal with differences instead of complete image information is obvious: similar to video compression techniques the data volume is drastically reduced. Another advantage turns up literally only at second sight: statistically, there is a high probability that the next saccade lands on locations where differences to previous image contents are largest. Thus, calculating potential changes of image content as the differences to previous contents prepares the visual system early on for new input.

To test whether the brain uses indeed such a strategy, the authors presented rapid sequences of two images to human volunteers. In the first image two gratings were superimposed, in the second image only one of the gratings was present. The task was to report the orientation of the last seen single grating. In most cases, the participants correctly reported the orientation of the present orientation, as expected. However, surprisingly, in some cases an orientation was perceived that was exactly orthogonal to the present orientation. That is, participants saw sometimes the difference between the previous superimposed gratings and the present single grating. „Seeing the difference instead of the real current input is here a visual illusion that can be interpreted as directly seeing the prediction error," says Robert Staadt from the Institute of Neural Computation of the RUB, first author of the study.

Avoiding the pigeonhole benefits flexibility

„Within the framework of the predictive coding theory, prediction errors are mostly conceived in the context of higher cognitive functions that are coupled to conscious expectations. However, we demonstrate that prediction errors also play a role in the context of highly dynamic perceptual events that take place within fractions of a second," explains Dr. Dirk Jancke, head of the Optical Imaging Group at the Institute of Neural Computation. The present study reveals that the visual system simultaneously keeps up information about past, current, and possible future image contents. Such strategy allows both stability and flexibility when viewing rapid image sequences. „Altogether, our results support hypotheses that consider perception as a result of a decision process," says Jancke. Hence, prediction errors should not be sorted out too early, as they might become relevant for following events.

Visual perception underlies decision making

In next studies the scientists will scrutinize the sets of parameters that drive the perceptual illusion most effectively. Besides straightforward physical parameters like stimulus duration, brightness, and contrast, other, more elusive factors that characterize psychological features might be involved. The authors' long-term perspective is the development of practical visual tests that can be used for an early diagnosis of cognitive disorders connected to rapid perceptual decision processes.

The study was partly financed through grants of the Collaborative Research Centre (CRC) 874 at RUB, which is supported by the German Research Foundation since 2010. The CRC "Integration and representation of sensory processes" investigates how sensory signals generate neuronal maps, and result in complex behavior and memory formation.

Original publication

Robert Staadt, Sebastian T. Philipp, Joschka L. Cremers, Jürgen Kornmeier, Dirk Jancke: Perception of the difference between past and present stimulus: a rare orientation illusion may indicate incidental access to prediction error-like signals: Plos One, 2020, DOI: 10.1371/journal.pone.0232349,

Press contact

Associate Professor Dr. Dirk Jancke
Optical Imaging Lab
Institute of Neural Computation
Ruhr-Universität Bochum
Phone: +49 234 32 27845

Ruhr-University Bochum

Related Brain Articles:

Human brain size gene triggers bigger brain in monkeys
Dresden and Japanese researchers show that a human-specific gene causes a larger neocortex in the common marmoset, a non-human primate.
Unique insight into development of the human brain: Model of the early embryonic brain
Stem cell researchers from the University of Copenhagen have designed a model of an early embryonic brain.
An optical brain-to-brain interface supports information exchange for locomotion control
Chinese researchers established an optical BtBI that supports rapid information transmission for precise locomotion control, thus providing a proof-of-principle demonstration of fast BtBI for real-time behavioral control.
Transplanting human nerve cells into a mouse brain reveals how they wire into brain circuits
A team of researchers led by Pierre Vanderhaeghen and Vincent Bonin (VIB-KU Leuven, Université libre de Bruxelles and NERF) showed how human nerve cells can develop at their own pace, and form highly precise connections with the surrounding mouse brain cells.
Brain scans reveal how the human brain compensates when one hemisphere is removed
Researchers studying six adults who had one of their brain hemispheres removed during childhood to reduce epileptic seizures found that the remaining half of the brain formed unusually strong connections between different functional brain networks, which potentially help the body to function as if the brain were intact.
Alcohol byproduct contributes to brain chemistry changes in specific brain regions
Study of mouse models provides clear implications for new targets to treat alcohol use disorder and fetal alcohol syndrome.
Scientists predict the areas of the brain to stimulate transitions between different brain states
Using a computer model of the brain, Gustavo Deco, director of the Center for Brain and Cognition, and Josephine Cruzat, a member of his team, together with a group of international collaborators, have developed an innovative method published in Proceedings of the National Academy of Sciences on Sept.
BRAIN Initiative tool may transform how scientists study brain structure and function
Researchers have developed a high-tech support system that can keep a large mammalian brain from rapidly decomposing in the hours after death, enabling study of certain molecular and cellular functions.
Wiring diagram of the brain provides a clearer picture of brain scan data
In a study published today in the journal BRAIN, neuroscientists led by Michael D.
Blue Brain Project releases first-ever digital 3D brain cell atlas
The Blue Brain Cell Atlas is like ''going from hand-drawn maps to Google Earth'' -- providing previously unavailable information on major cell types, numbers and positions in all 737 brain regions.
More Brain News and Brain Current Events

Trending Science News

Current Coronavirus (COVID-19) News

Top Science Podcasts

We have hand picked the top science podcasts of 2020.
Now Playing: TED Radio Hour

Debbie Millman: Designing Our Lives
From prehistoric cave art to today's social media feeds, to design is to be human. This hour, designer Debbie Millman guides us through a world made and remade–and helps us design our own paths.
Now Playing: Science for the People

#574 State of the Heart
This week we focus on heart disease, heart failure, what blood pressure is and why it's bad when it's high. Host Rachelle Saunders talks with physician, clinical researcher, and writer Haider Warraich about his book "State of the Heart: Exploring the History, Science, and Future of Cardiac Disease" and the ails of our hearts.
Now Playing: Radiolab

Insomnia Line
Coronasomnia is a not-so-surprising side-effect of the global pandemic. More and more of us are having trouble falling asleep. We wanted to find a way to get inside that nighttime world, to see why people are awake and what they are thinking about. So what'd Radiolab decide to do?  Open up the phone lines and talk to you. We created an insomnia hotline and on this week's experimental episode, we stayed up all night, taking hundreds of calls, spilling secrets, and at long last, watching the sunrise peek through.   This episode was produced by Lulu Miller with Rachael Cusick, Tracie Hunte, Tobin Low, Sarah Qari, Molly Webster, Pat Walters, Shima Oliaee, and Jonny Moens. Want more Radiolab in your life? Sign up for our newsletter! We share our latest favorites: articles, tv shows, funny Youtube videos, chocolate chip cookie recipes, and more. Support Radiolab by becoming a member today at