Nav: Home

Babies' first words can be predicted based on visual attention, IU study finds

December 05, 2016

BLOOMINGTON, Ind. -- Indiana University psychologists have shown that a baby's most likely first words are based upon their visual experience, laying the foundation for a new theory of infant language learning.

The findings also suggest new possibilities for the treatment of children with language deficits and autism.

Drawing on theories of statistical learning, IU researcher Linda Smith and colleagues found that the number of times an object enters an infant's field of vision "tips the scales" in favor of associating certain words with certain objects.

The research appears in the journal of the Royal Society Philosophical Transactions B in a special issue on statistical learning.

"We think that children's first words are predictable based on their visual experience with objects and the prevalence of those objects in their visual world," said Smith, a professor in the IU Bloomington College of Arts and Sciences' Department of Psychological and Brain Sciences and senior author on the study.

"Visual memory may be the initial key to getting words stuck on objects -- familiar visual objects like table, shirt, bottle or spoon," she added. "It's an aggregated experience; those very first words may be learned -- slowly and incrementally -- for a few visually pervasive objects. This may be how infants begin to break into language before their first birthday."

The study's results could also help inform interventions for children with delayed speech and other language disorders.

"Difficulty learning words could stem from visual processing problems," Smith added. "Children who are late talkers have slow or age-delayed visual processing skills for objects, for example. Children with autism have object-processing problems as well."

Although many researchers have studied infants' first words to understand learning, Smith said none have approached the question from the visual side.

"While studying language acquisition from the 'word side' may benefit those studying later stages of language learning -- at the ages of 18 months to 3 years -- it cannot account for how children break into language," she said.

Under the new theory, which Smith and colleagues call the Pervasiveness Hypothesis, a few highly prevalent objects stand out to infants among the "clutter" of other less frequent objects to become their first words.

To conduct their study, IU researchers looked at videos that showed the visual field of eight children -- five girls and three boys -- between 8 and 10 months old, the period before children engage in verbal interactions with parents and caregivers.

The videos came from head-mounted cameras worn by the children an average of 4.4 hours. Caregivers were told the cameras would observe children's daily activities, not words or objects specifically. Caregivers could choose when to activate the camera.

For the purpose of the study, researchers observed mealtime scenes, defined as any eating by anyone at any time or location -- in cars, at playtime or in a high chair, for example. The recordings yielded 917,207 mealtime frames, with one image sampled every five seconds. Five objects were recorded for each frame: a total of 745 objects.

Using an accepted method to index child vocabulary, the researchers then divided the named objects into "first nouns," which are acquired by half of all 16-month-olds; "early nouns," which are known by half of all 30-month-olds; and "late nouns," which are acquired at later stages of learning.

First nouns include words such as table, shirt, chair, bowl, cup, bottle, food, spoon and plate.

The study's results revealed a strong correlation between the most frequently appearing objects and "first nouns," with the top 15 of these words appearing in the images collected by the study.

"The comparison of first and early nouns was particularly striking, since both sets of object names are acquired quite early in childhood and refer to objects common in households with infants," said Elizabeth Clerkin, a Ph.D. student in the IU Bloomington Department of Psychological and Brain Sciences and first author on the study.

"That infants' visual environment during mealtime consistently involves a very small number of objects -- and the names of these high-frequency objects are among those normally learned first by infants -- suggests visual experience is doing the heavy lifting in very early word learning," she added.

Whether children who experience speech disorders are not picking up visual regularities in the environment or simply live in households with fewer regularities, Smith said it's vital to explore the role of both words and vision in language learning.

"Taking account of the visual brings a whole new dimension of word-learning into view," she added. "If all you ever worry about is the word side of word-learning, you may be missing half the problem: visual cues that aid language learning."
-end-
In addition to Smith and Clerkin, co-authors on the study are professor Chen Yu and laboratory technician Elizabeth Hart of the IU Bloomington Department of Psychological and Brain Sciences and Georgia Institute of Technology professor James M. Rehg.

This research is supported in part by the National Science Foundation. The study grew out of a larger NSF grant to IU to create a collection of over 500 million images to track the visual regularities in the lives of children from birth through age 24 months.

Indiana University

Related Language Articles:

Why the language-ready brain is so complex
In a review article published in Science, Peter Hagoort, professor of Cognitive Neuroscience at Radboud University and director of the Max Planck Institute for Psycholinguistics, argues for a new model of language, involving the interaction of multiple brain networks.
Do as i say: Translating language into movement
Researchers at Carnegie Mellon University have developed a computer model that can translate text describing physical movements directly into simple computer-generated animations, a first step toward someday generating movies directly from scripts.
Learning language
When it comes to learning a language, the left side of the brain has traditionally been considered the hub of language processing.
Learning a second alphabet for a first language
A part of the brain that maps letters to sounds can acquire a second, visually distinct alphabet for the same language, according to a study of English speakers published in eNeuro.
Sign language reveals the hidden logical structure, and limitations, of spoken language
Sign languages can help reveal hidden aspects of the logical structure of spoken language, but they also highlight its limitations because speech lacks the rich iconic resources that sign language uses on top of its sophisticated grammar.
Lying in a foreign language is easier
It is not easy to tell when someone is lying.
American sign language and English language learners: New linguistic research supports the need for policy changes
A new study of the educational needs of students who are native users of American Sign Language (ASL) shows glaring disparities in their treatment by the U.S Department of Education.
The language of facial expressions
University of Miami Psychology Professor Daniel Messinger collaborated with researchers at Western University in Canada to show that our brains are pre-wired to perceive wrinkles around the eyes as conveying more intense and sincere emotions.
The universal language of hormones
Bioinformatics specialists from the University of W├╝rzburg have studied a specific class of hormones which is relevant for plants, bacteria and indirectly for humans, too.
Stretching language to its limit
A disregard for human traditions, the brutality of predation, sacrifice, and sexual desire are ingrained in languages across cultures.
More Language News and Language Current Events

Best Science Podcasts 2019

We have hand picked the best science podcasts for 2019. Sit back and enjoy new science podcasts updated daily from your favorite science news services and scientists.
Now Playing: TED Radio Hour

Rethinking Anger
Anger is universal and complex: it can be quiet, festering, justified, vengeful, and destructive. This hour, TED speakers explore the many sides of anger, why we need it, and who's allowed to feel it. Guests include psychologists Ryan Martin and Russell Kolts, writer Soraya Chemaly, former talk radio host Lisa Fritsch, and business professor Dan Moshavi.
Now Playing: Science for the People

#538 Nobels and Astrophysics
This week we start with this year's physics Nobel Prize awarded to Jim Peebles, Michel Mayor, and Didier Queloz and finish with a discussion of the Nobel Prizes as a way to award and highlight important science. Are they still relevant? When science breakthroughs are built on the backs of hundreds -- and sometimes thousands -- of people's hard work, how do you pick just three to highlight? Join host Rachelle Saunders and astrophysicist, author, and science communicator Ethan Siegel for their chat about astrophysics and Nobel Prizes.