Scientists Watch As Listener's Brain Predicts Speaker's Words

September 12, 2008

Scientists at the University of Rochester have shown for the first time that our brains automatically consider many possible words and their meanings before we've even heard the final sound of the word.

Previous theories have proposed that listeners can only keep pace with the rapid rate of spoken language-up to 5 syllables per second-by anticipating a small subset of all words known by the listener, much like Google search anticipates words and phrases as you type. This subset consists of all words that begin with the same sounds, such as "candle", "candy," and "cantaloupe," and makes the task of understanding the specific word more efficient than waiting until all the sounds of the word have been presented.

But until now, researchers had no way to know if the brain also considers the meanings of these possible words. The new findings are the first time that scientists, using an MRI scanner, have been able to actually see this split-second brain activity. The study was a team effort among former Rochester graduate student Kathleen Pirog Revill, now a postdoctoral researcher at Georgia Tech, and three faculty members in the Department of Brain and Cognitive Sciences at the University of Rochester.

"We had to figure out a way to catch the brain doing something so fast that it happens literally between spoken syllables," says Michael Tanenhaus, the Beverly Petterson Bishop and Charles W. Bishop Professor. "The best tool we have for brain imaging of this sort is functional MRI, but an fMRI takes a few seconds to capture an image, so people thought it just couldn't be done."

But it could be done. It just took inventing a new language to do it.

With William R. Kenan Professor Richard Aslin and Professor Daphne Bavelier, Pirog Revill focused on a tiny part of the brain called "V5," which is known to be activated when a person sees motion. The idea was to teach undergraduates a set of invented words, some of which meant "movement," and then to watch and see if the V5 area became activated when the subject heard words that sounded similar to the ones that meant "movement."

For instance, as a person hears the word "kitchen," the Rochester team would expect areas of the brain that would normally become active when a person thought of words like "kick" to momentarily show increased blood flow in an fMRI scan. But the team couldn't use English words because a word as simple as "kick" has so many nuances of meaning. To one person it might mean to kick someone in anger, to another it might mean to be kicked, or to kick a winning goal. The team had to create a set of words that had similar beginning syllables, but with different ending syllables and distinct meanings-one of which meant motion of the sort that would activate the V5 area.

The team created a computer program that showed irregular shapes and gave the shapes specific names, like "goki." They also created new verb words. Some, like "biduko" meant "the shape will move across the screen," whereas some, like "biduka," meant the shape would just change color.

After a number of students learned the new words well enough, the team tested them as they lay in an fMRI scanner. The students would see one of the shapes on a monitor and hear "biduko," or "biduka." Though only one of the words actually meant "motion," the V5 area of the brain still activated for both, although less so for the color word than for the motion word. The presence of some activation to the color word shows that the brain, for a split-second, considered the motion meaning of both possible words before it heard the final, discriminating syllable-ka rather than ko.

"Frankly, we're amazed we could detect something so subtle," says Aslin. "But it just makes sense that your brain would do it this way. Why wait until the end of the word to try to figure out what its meaning is? Choosing from a little subset is much faster than trying to match a finished word against every word in your vocabulary."

The Rochester team is already planning more sophisticated versions of the test that focus on other areas of the brain besides V5-such as areas that activate for specific sounds or touch sensations. Bavelier says they're also planning to watch the brain sort out meaning when it is forced to take syntax into account. For instance, "blind venetian" and "venetian blind" are the same words but mean completely different things. How does the brain narrow down the meaning in such a case? How does the brain take the conversation's context into consideration when zeroing in on meaning?

"This opens a doorway into how we derive meaning from language," says Tanenhaus. "This is a new paradigm that can be used in countless ways to study how the brain responds to very brief events. We're very excited to see where it will lead us."

The University of Rochester

---

---

	Language, Culture and Communication (6th Edition) by Nancy Bonvillain (Author) For courses in Language and Culture, and Sociolinguistics   Using data from cultures and languages throughout the world to highlight both similarities and differences in human languages, Language, Culture and Communication explores the many interconnections among language, culture, and communicative meaning.  It examines the multi-faceted meanings and uses of language and emphasizes the ways that language encapsulates speakers' meanings and intentions.
	Language, an introduction to the study of speech by Edward Sapir (Author) This is a reproduction of a book published before 1923. This book may have occasional imperfections such as missing or blurred pages, poor pictures, errant marks, etc. that were either part of the original artifact, or were introduced by the scanning process. We believe this work is culturally important, and despite the imperfections, have elected to bring it back into print as part of our continuing commitment to the preservation of printed works worldwide. We appreciate your understanding of the imperfections in the preservation process, and hope you enjoy this valuable book.
	Language, Proof, and Logic: Second Edition by David Barker-Plummer (Author), Jon Barwise (Author), John Etchemendy (Author) This textbook/software package covers first-order language in a method appropriate for first and second courses in logic. The unique on-line grading services instantly grades solutions to hundred of computer exercises. It is specially devised to be used by philosophy instructors in a way that is useful to undergraduates of philosophy, computer science, mathematics, and linguistics. The book is a completely rewritten and much improved version of The Language of First-order Logic. Introductory material is presented in a more systematic and accessible fashion. Advanced chapters include proofs of soundness and completeness for propositional and predicate logic, as well as an accessible sketch of Godel's first incompleteness theorem. The book is appropriate for a wide range of courses,...
	The Unfolding of Language: An Evolutionary Tour of Mankind's Greatest Invention by Guy Deutscher (Author) Blending the spirit of Eats, Shoots & Leaves with the science of The Language Instinct, an original inquiry into the development of that most essential-and mysterious-of human creations: Language Language is mankind's greatest invention-except, of course, that it was never invented." So begins linguist Guy Deutscher's enthralling investigation into the genesis and evolution of language. If we started off with rudimentary utterances on the level of "man throw spear," how did we end up with sophisticated grammars, enormous vocabularies, and intricately nuanced degrees of meaning? Drawing on recent groundbreaking discoveries in modern linguistics, Deutscher exposes the elusive forces of creation at work in human communication, giving us fresh insight into how language emerges,...
	Super Fast Guides, Language Learning: How to learn any language by Super Fast Guides Having more than one language is an essential skill in today's global society for study, work and travel. This Super Fast Guide will show you how to master any language from Spanish to Chinese to Arabic, whether you're a beginner, trying to learn a new language for the first time, or someone who wants to further improve their competence in a language that they're already studying. This concise guide will show you how to learn any language quickly and effectively, so that you can get to where you want to be, now. If you want answers to these questions, then this guide is for you: How can I learn new words? How can I read difficult passages in a foreign language? How can I write effectively in another language? What can I do if I'm...
	The Language of Flowers: A Novel by Vanessa Diffenbaugh (Author) NEW YORK TIMES BESTSELLER   The Victorian language of flowers was used to convey romantic expressions: honeysuckle for devotion, asters for patience, and red roses for love. But for Victoria Jones, it’s been more useful in communicating mistrust and solitude. After a childhood spent in the foster-care system, she is unable to get close to anybody, and her only connection to the world is through flowers and their meanings. Now eighteen and emancipated from the system with nowhere to go, Victoria realizes she has a gift for helping others through the flowers she chooses for them. But an unexpected encounter with a mysterious stranger has her questioning what’s been missing in her life. And when she’s forced to confront a painful secret from her past, she must decide whether...
	Language, Truth and Logic by Alfred J. Ayer (Author), Sir Alfred Jules Ayer (Author) Classic introduction to objectives and methods of schools of empiricism and linguistic analysis, especially of the logical positivism derived from the Vienna Circle. Topics: elimination of metaphysics, function of philosophy, nature of philosophical analysis, the a priori, truth and probability, critique of ethics and theology, self and the common world, more.
	Language, Culture, and Teaching: Critical Perspectives (Language, Culture, and Teaching Series) by Sonia Nieto (Author) Distinguished multiculturalist Sonia Nieto speaks directly to current and future teachers in this thoughtful integration of a selection of her key writings with creative pedagogical features. Offering information, insights, and motivation to teach students of diverse cultural, racial, and linguistic backgrounds, this text is intended for upper-undergraduate and graduate-level students and professional development courses. Examples are included throughout to illustrate real-life dilemmas about diversity that teachers face in their own classrooms; ideas about how language, culture, and teaching are linked; and ways to engage with these ideas through reflection and collaborative inquiry. Each chapter includes critical questions; classroom activities; and community activities suggesting...
	Through the Language Glass: Why the World Looks Different in Other Languages by Guy Deutscher (Author) A New York Times Editor’s ChoiceAn Economist Best Book of 2010A Financial Times Best Book of 2010 A Library Journal Best Book of 2010 The debate is ages old: Where does language come from? Is it an artifact of our culture or written in our very DNA? In recent years, the leading linguists have seemingly settled the issue: all languages are fundamentally the same and the particular language we speak does not shape our thinking in any significant way. Guy Deutscher says they’re wrong. From Homer to Darwin, from Yale to the Amazon, and through a strange and dazzling history of the color blue, Deutscher argues that our mother tongues do indeed shape our experiences of the world. Audacious, delightful, and provocative, Through the Language Glass is destined to become a...
	Language: The Cultural Tool by Daniel L. Everett (Author) A bold and provocative study that presents language not as an innate component of the brain—as most linguists do—but as an essential tool unique to each culture worldwide.   For years, the prevailing opinion among academics has been that language is embedded in our genes, existing as an innate and instinctual part of us. But linguist Daniel Everett argues that, like other tools, language was invented by humans and can be reinvented or lost. He shows how the evolution of different language forms—that is, different grammar—reflects how language is influenced by human societies and experiences, and how it expresses their great variety.   For example, the Amazonian Pirahã put words together in ways that violate our long-held under-standing of how language works, and...