Nav: Home

Gestures heard as well as seen

May 18, 2020

Gesturing with the hands while speaking is a common human behavior, but no one knows why we do it. Now, a group of UConn researchers reports in the May 11 issue of PNAS that gesturing adds emphasis to speech--but not in the way researchers had thought.

Gesturing while speaking, or "talking with your hands," is common around the world. Many communications researchers believe that gesturing is either done to emphasize important points, or to elucidate specific ideas (think of this as the "drawing in the air" hypothesis). But there are other possibilities. For example, it could be that gesturing, by altering the size and shape of the chest, lungs and vocal muscles, affects the sound of a person's speech.

A team of UConn researchers led by former postdoc Wim Pouw (currently at Radboud University in the Netherlands) decided to test whether this idea was true, or just so much hand waving. The team had volunteers move their dominant hand as if they were chopping wood, while continuously saying "a" as in "cinema." They were instructed to keep the "a" sound as steady as they could.

Despite that instruction, when the team played audio recordings of this to other people, they found the listener could hear the speaker's gestures. When the listener was asked to move their arms to the rhythm, their movements matched perfectly with those of the original speaker.

Because of the way the human body is constructed, hand movements influence torso and throat muscles. Gestures are tightly tied to amplitude. Rather than just using your chest muscles to produce air flow for speech, moving your arms while you speak can add acoustic emphasis. And you can hear someone's motions, even when they're trying not to let you.

"Some language researchers don't like this idea, because they want language to be all about communicating the contents of your mind, rather than the state of your body. But we think that gestures are allowing the acoustic signal to carry additional information about bodily tension and motion. It's information of another kind," says UConn psychologist and director of the Center for the Ecological Study of Perception and Action James Dixon, one of the authors of the paper.
-end-


University of Connecticut

Related Language Articles:

How effective are language learning apps?
Researchers from Michigan State University recently conducted a study focusing on Babbel, a popular subscription-based language learning app and e-learning platform, to see if it really worked at teaching a new language.
Chinese to rise as a global language
With the continuing rise of China as a global economic and trading power, there is no barrier to prevent Chinese from becoming a global language like English, according to Flinders University academic Dr Jeffrey Gil.
'She' goes missing from presidential language
MIT researchers have found that although a significant percentage of the American public believed the winner of the November 2016 presidential election would be a woman, people rarely used the pronoun 'she' when referring to the next president before the election.
How does language emerge?
How did the almost 6000 languages of the world come into being?
New research quantifies how much speakers' first language affects learning a new language
Linguistic research suggests that accents are strongly shaped by the speaker's first language they learned growing up.
Why the language-ready brain is so complex
In a review article published in Science, Peter Hagoort, professor of Cognitive Neuroscience at Radboud University and director of the Max Planck Institute for Psycholinguistics, argues for a new model of language, involving the interaction of multiple brain networks.
Do as i say: Translating language into movement
Researchers at Carnegie Mellon University have developed a computer model that can translate text describing physical movements directly into simple computer-generated animations, a first step toward someday generating movies directly from scripts.
Learning language
When it comes to learning a language, the left side of the brain has traditionally been considered the hub of language processing.
Learning a second alphabet for a first language
A part of the brain that maps letters to sounds can acquire a second, visually distinct alphabet for the same language, according to a study of English speakers published in eNeuro.
Sign language reveals the hidden logical structure, and limitations, of spoken language
Sign languages can help reveal hidden aspects of the logical structure of spoken language, but they also highlight its limitations because speech lacks the rich iconic resources that sign language uses on top of its sophisticated grammar.
More Language News and Language Current Events

Trending Science News

Current Coronavirus (COVID-19) News

Top Science Podcasts

We have hand picked the top science podcasts of 2020.
Now Playing: TED Radio Hour

Listen Again: The Power Of Spaces
How do spaces shape the human experience? In what ways do our rooms, homes, and buildings give us meaning and purpose? This hour, TED speakers explore the power of the spaces we make and inhabit. Guests include architect Michael Murphy, musician David Byrne, artist Es Devlin, and architect Siamak Hariri.
Now Playing: Science for the People

#576 Science Communication in Creative Places
When you think of science communication, you might think of TED talks or museum talks or video talks, or... people giving lectures. It's a lot of people talking. But there's more to sci comm than that. This week host Bethany Brookshire talks to three people who have looked at science communication in places you might not expect it. We'll speak with Mauna Dasari, a graduate student at Notre Dame, about making mammals into a March Madness match. We'll talk with Sarah Garner, director of the Pathologists Assistant Program at Tulane University School of Medicine, who takes pathology instruction out of...
Now Playing: Radiolab

What If?
There's plenty of speculation about what Donald Trump might do in the wake of the election. Would he dispute the results if he loses? Would he simply refuse to leave office, or even try to use the military to maintain control? Last summer, Rosa Brooks got together a team of experts and political operatives from both sides of the aisle to ask a slightly different question. Rather than arguing about whether he'd do those things, they dug into what exactly would happen if he did. Part war game part choose your own adventure, Rosa's Transition Integrity Project doesn't give us any predictions, and it isn't a referendum on Trump. Instead, it's a deeply illuminating stress test on our laws, our institutions, and on the commitment to democracy written into the constitution. This episode was reported by Bethel Habte, with help from Tracie Hunte, and produced by Bethel Habte. Jeremy Bloom provided original music. Support Radiolab by becoming a member today at Radiolab.org/donate.     You can read The Transition Integrity Project's report here.