Nav: Home

Mountain splendor? Scientists know where your eyes will look

December 04, 2018

New Haven, Conn. -- Using precise brain measurements, Yale researchers predicted how people's eyes move when viewing natural scenes, an advance in understanding the human visual system that can improve a host of artificial intelligence efforts, such as the development of driverless cars, said the researchers.

"We are visual beings and knowing how the brain rapidly computes where to look is fundamentally important," said Yale's Marvin Chun, Richard M. Colgate Professor of Psychology, professor of neuroscience and co-author of new research published Dec. 4 in the journal Nature Communications.

Eye movements have been extensively studied, and researchers can tell with some certainty where a gaze will be directed at different elements in the environment. What hasn't been understood is how the brain orchestrates this ability, which is so fundamental to survival.

In a previous example of "mind reading," Chun's group successfully reconstructed facial images viewed while people were scanned in an MRI machine, based on their brain imaging data alone.

In the new paper, Chun and lead author Thomas P. O'Connell took a similar approach and showed that by analyzing the brain responses to complex, natural scenes, they could predict where people would direct their attention and gaze. This was made possible by analyzing the brain data with deep convolutional neural networks -- models that are extensively used in artificial intelligence (AI).

"The work represents a perfect marriage of neuroscience and data science," Chun said.

The findings have a myriad of potential applications -- such as testing competing artificial intelligence systems that categorize images and guide driverless cars.

"People can see better than AI systems can," Chun said. "Understanding how the brain performs its complex calculations is an ultimate goal of neuroscience and benefits AI efforts."
-end-


Yale University

Related Neuroscience Articles:

Diabetes-Alzheimer's link explored at Neuroscience 2019
Surprising links exist between diabetes and Alzheimer's disease, and researchers are beginning to unpack the pathology that connects the two.
Organoid research revealed at Neuroscience 2019
Mini-brains, also called organoids, may offer breakthroughs in clinical research by allowing scientists to study human brain cells without a human subject.
The neuroscience of autism: New clues for how condition begins
UNC School of Medicine scientists found that a gene mutation linked to autism normally works to organize the scaffolding of brain cells called radial progenitors necessary for the orderly formation of the brain.
Harnessing reliability for neuroscience research
Neuroscientists are amassing the large-scale datasets needed to study individual differences and identify biomarkers.
Blue Brain solves a century-old neuroscience problem
In a front-cover paper published in Cerebral Cortex, EPFL's Blue Brain Project, a Swiss Brain Research Initiative, explains how the shapes of neurons can be classified using mathematical methods from the field of algebraic topology.
Characterizing pig hippocampus could improve translational neuroscience
Researchers have taken further steps toward developing a superior animal model of neurological conditions such as traumatic brain injury and epilepsy, according to a study of miniature pigs published in eNeuro.
The neuroscience of human vocal pitch
Among primates, humans are uniquely able to consciously control the pitch of their voices, making it possible to hit high notes in singing or stress a word in a sentence to convey meaning.
Study tackles neuroscience claims to have disproved 'free will'
For several decades, some researchers have argued that neuroscience studies prove human actions are driven by external stimuli -- that the brain is reactive and free will is an illusion.
New approaches in neuroscience show it's not all in your head
Our own unique experiences shape how we view the world and respond to the events in our lives.
The neuroscience of cuttlefish camouflage
Unlike squid, bottom-dwelling cuttlefish may be able to put one key aspect of their camouflage on autopilot.
More Neuroscience News and Neuroscience Current Events

Best Science Podcasts 2019

We have hand picked the best science podcasts for 2019. Sit back and enjoy new science podcasts updated daily from your favorite science news services and scientists.
Now Playing: TED Radio Hour

Rethinking Anger
Anger is universal and complex: it can be quiet, festering, justified, vengeful, and destructive. This hour, TED speakers explore the many sides of anger, why we need it, and who's allowed to feel it. Guests include psychologists Ryan Martin and Russell Kolts, writer Soraya Chemaly, former talk radio host Lisa Fritsch, and business professor Dan Moshavi.
Now Playing: Science for the People

#538 Nobels and Astrophysics
This week we start with this year's physics Nobel Prize awarded to Jim Peebles, Michel Mayor, and Didier Queloz and finish with a discussion of the Nobel Prizes as a way to award and highlight important science. Are they still relevant? When science breakthroughs are built on the backs of hundreds -- and sometimes thousands -- of people's hard work, how do you pick just three to highlight? Join host Rachelle Saunders and astrophysicist, author, and science communicator Ethan Siegel for their chat about astrophysics and Nobel Prizes.