As you look around, mental images bounce between right and left brain

February 08, 2021

Ask anyone from an NFL quarterback scanning the field for open receivers, to an air traffic controller monitoring the positions of planes, to a mom watching her kids run around at the park: We depend on our brain to hold what we see in mind, even as we shift our gaze around and even temporarily look away. This capability of "visual working memory" feels effortless, but a new MIT study shows that the brain works hard to keep up. Whenever a key object shifts across our field of view--either because it moved or our eyes did--the brain immediately transfers a memory of it by re-encoding it among neurons in the opposite brain hemisphere.

The finding, published in Neuron by neuroscientists at The Picower Institute for Learning and Memory, explains via experiments in animals how we can keep continuous track of what's important to us, even though our visual system's basic wiring requires mapping what we see on our left in the right side of our brain and what we see on our right in the left side of the brain.

"You need to know where things are in the real world, regardless of where you happen to be looking or how you are oriented at a given moment," said study lead author Scott Brincat, a postdoctoral researcher in the lab of Picower Professor Earl Miller, the senior author. "But the representation that your brain gets from the outside world changes every time you move your eyes around."

In their experiments, Brincat, Miller and co-authors found that when an object switches sides in the field of view, the brain rapidly employs a telltale change in the synchrony of brain wave frequencies to shepherd the memory information from one side of the brain to the other. The transfer, which occurs in mere milliseconds, recruits a new group of neurons in the prefrontal cortex of the opposite brain hemisphere to store the memory. This new ensemble of neurons encodes the object based on its new position, but the brain continues to recognize it as the object that used to be in the other hemisphere's field of view.

That ability--to remember that something is the same thing no matter how it's moving around relative to our eyes--is what gives us the freedom to control where we look, Miller said. A quarterback can decide to shift his gaze from the left side of the field to the right side without having to fear that he'll instantly forget that those left-side receivers are still there, even if changing the gaze position has substantially shifted them within, or even out of, his field of view.

"If you didn't have that, we would just be simple creatures who could only react to whatever is coming right at us in the environment, that's all," Miller said. "But because we can hold things in mind, we can have volitional control over what we do. We don't have to react to something now, we can save it for later."

Shifting sides

In the lab, the researchers measured the activity of hundreds of neurons in the prefrontal cortex of both brain hemispheres as animals played a game. They had to fix their gaze on one side of a screen as an image of an object (e.g. a banana) appeared briefly in the middle of the screen. The object thus appeared on one or the other side of their field of view, and due to the brain's crossed wiring, it was processed in the opposite cortical hemisphere. The animal had to hold the image in mind, then indicate if a subsequently presented image was of a different object (e.g. an apple). On some trials, though, while the original object was held in working memory the animals were cued to switch their gaze from one side to the other, effectively changing which side of their field of view the remembered image was on.

Animals were accurate in remembering whether the images they were presented matched, but their performance suffered just a little bit in cases where they had to shift their gaze. Brincat said the error suggests that having to keep up with the shift is not as easy for the brain as it seems.

"It feels trivial to us, but it apparently isn't," he said.

To analyze their measurements in the brain, the team trained a computer program called a decoder to identify patterns in the raw data of neural activity that indicated the memory of the object image. As expected, that analysis showed that the brain encoded information about each image in the hemisphere opposite of where it was in the field of view. But more remarkably, it also showed that in cases where the animals shifted their gaze across the screen, neural activity encoding the memory information shifted from one brain hemisphere to the other.

The team also measured the overall rhythms of the neurons' collective activity, or brain waves. They found that the transfer of a memory from one hemisphere to the other consistently occurred with a signature change in those rhythms. As the transfer occurred, the synchrony across hemispheres of very low frequency "theta" waves (~4-10 Hz) and high frequency "beta" waves (~17-40 Hz) rose and the synchrony of "alpha/beta" waves (~11-17 Hz) declined.

This push-and-pull pattern of rhythms closely resembles one that Miller's lab has found in many studies of how the cortex employs rhythms to transmit information. Increases in the combination of very low and higher frequency rhythms allows sensory information (i.e. representations of what the animal just saw) to be encoded or recalled. A power increase in the alpha/beta frequency range inhibits that encoding, acting as a sort of gate on sensory information processing.

"This is another form of gating," Miller said. "This time alpha/beta is gating the memory transfer between hemispheres."

Spotting a surprise

While the rhythm patterns seemed consistent with prior studies, the researchers were surprised by another finding of the study: Given the same object image in the same spot in the field of view, the prefrontal cortex employed different neurons if it was initially seen at that location vs. transferred from the other hemisphere. In other words, animals seeing a banana in the left side of their vision recruited a different neural ensemble to represent that memory than they did if the banana was previously seen on the right and then transferred to that spot.

To Miller, the finding has an intriguing implication. Neuroscientists once thought that individual neurons were the basic unit of function in the brain and more recently have begun to think that instead ensembles of neurons are. The new findings, however, suggest that even the same information could still be encoded by different, arbitrarily assembled ensembles.

"Perhaps even ensembles aren't the functional units of the brain," Miller speculated. "So what is the functional unit of the brain? It's the computational space that brain network activity creates."
In addition to Brincat and Miller the paper's other authors are Jacob Donoghue, Meredith Mahnke, Simon Kornblith and Mikael Lundqvist.

The National Institute of Mental Health, Office of Naval Research, the JPB Foundation, and the National Institute of General Medical Sciences funded the research.

Picower Institute at MIT

Related Neurons Articles from Brightsurf:

Paying attention to the neurons behind our alertness
The neurons of layer 6 - the deepest layer of the cortex - were examined by researchers from the Okinawa Institute of Science and Technology Graduate University to uncover how they react to sensory stimulation in different behavioral states.

Trying to listen to the signal from neurons
Toyohashi University of Technology has developed a coaxial cable-inspired needle-electrode.

A mechanical way to stimulate neurons
Magnetic nanodiscs can be activated by an external magnetic field, providing a research tool for studying neural responses.

Extraordinary regeneration of neurons in zebrafish
Biologists from the University of Bayreuth have discovered a uniquely rapid form of regeneration in injured neurons and their function in the central nervous system of zebrafish.

Dopamine neurons mull over your options
Researchers at the University of Tsukuba have found that dopamine neurons in the brain can represent the decision-making process when making economic choices.

Neurons thrive even when malnourished
When animal, insect or human embryos grow in a malnourished environment, their developing nervous systems get first pick of any available nutrients so that new neurons can be made.

The first 3D map of the heart's neurons
An interdisciplinary research team establishes a new technological pipeline to build a 3D map of the neurons in the heart, revealing foundational insight into their role in heart attacks and other cardiac conditions.

Mapping the neurons of the rat heart in 3D
A team of researchers has developed a virtual 3D heart, digitally showcasing the heart's unique network of neurons for the first time.

How to put neurons into cages
Football-shaped microscale cages have been created using special laser technologies.

A molecule that directs neurons
A research team coordinated by the University of Trento studied a mass of brain cells, the habenula, linked to disorders like autism, schizophrenia and depression.

Read More: Neurons News and Neurons Current Events is a participant in the Amazon Services LLC Associates Program, an affiliate advertising program designed to provide a means for sites to earn advertising fees by advertising and linking to