 |
|
Caltech neurobiologists discover individuals who 'hear' movement
August 07, 2008PASADENA, Calif.-- Individuals with synesthesia perceive the world in a different way from the rest of us. Because their senses are cross-activated, some synesthetes perceive numbers or letters as having colors or days of the week as possessing personalities, even as they function normally in the world. Now, researchers at the California Institute of Technology have discovered a type of synesthesia in which individuals hear sounds, such as tapping, beeping, or whirring, when they see things move or flash. Surprisingly, the scientists say, auditory synesthesia may not be unusual--and may simply represent an enhanced form of how the brain normally processes visual information.
Psychologists previously reported visual, tactile, and taste synesthesias, but auditory synesthesia had never been identified. Caltech lecturer in computation and neural systems Melissa Saenz discovered the phenomenon quite by accident.
"While I was running an experiment at the Caltech Brain Imaging Center, a group of students happened to pass by on a tour, and I volunteered to explain what I was doing," explains Saenz, who, along with Christof Koch, the Lois and Victor Troendle Professor of Cognitive and Behavioral Biology at Caltech and professor of computation and neural systems, reports the finding in the August 5 issue of the journal Current Biology.
"As part of the experiment, a moving display was running on my computer screen with dots rapidly expanding out, somewhat like the opening scene of Star Wars. Out of the blue, one of the students asked, "Does anyone else hear something when you look at that?" After talking to him further, I realized that his experience had all the characteristics of a synesthesia: an automatic sensory cross-activation that he had experienced all of his life," says Saenz.
A search of the synesthesia literature revealed that auditory synesthesia--of any kind--had never been reported. Intrigued, Saenz began to look for other individuals with the same ability, using the original movie seen by the student as a test. "I queried a few hundred people and three more individuals turned up," she says. Having that specific example made it easy to find more people. That movie just happens to be quite "noisy" to the synesthetes and was a great screening tool. When asked if it made a sound, one of the individuals responded, "how could it not?" I would have been less successful had I just generally asked, "Do you hear sounds when you see things move or flash?" because in the real environment, things that move often really do make a sound," for example, a buzzing bee.
This may be why auditory synesthesia hadn't been detected by neurobiologists. "People with auditory synesthesia may be even less likely than people with other synesthetic associations to fully realize that their experience is unusual. These individuals have an enhanced soundtrack in life, rather than a dramatically different experience, compared to others," says Saenz. However, when asked, all of the synesthetes could name examples of daily visual events that caused sounds that they logically knew to be only in their minds, such as seeing a fluttering butterfly or watching television with the sound turned off.
Saenz and Koch found that the four synesthetes outperformed a group of nonsynesthetes on a simple test involving rhythmic patterns of flashes similar to visual Morse code. Normally, such patterns are easier to identify with sound (beeps) than with vision (flashes), so the researchers predicted that synesthetes would have an advantage with visual patterns because they actually heard a sound every time they saw a flash.
In the test, the subjects saw a series of flashes and had to guess if a second sequence, played afterward, represented the same temporal pattern or not. As a baseline measurement, a similar test was given using sequences of beeps. Both the synesthetes and the control group performed equally well when given beeps. However, with visual flashes synesthetes were much more accurate, responding correctly more than 75 percent of the time, compared to around 50 percent--the level predicted by chance--in the control group. "Synesthetes had an advantage because they not only saw but also heard the visual patterns," Saenz says.
Saenz and Koch suspect that as much as 1 percent of the population may experience auditory synesthesia. In fact, she and Koch think that the brain may normally transfer visual sensory information over to the auditory cortex, to create a prediction of the associated sound. "This translation might result in actual sound perception in synesthetes, perhaps due to stronger than normal connections, says Saenz, who has begun brain imaging experiments to study this connectivity in synesthetes and nonsynesthetes.
"We might find that motion processing centers of the visual cortex are more interconnected with auditory brain regions than previously thought, even in the 'normal' brain," Saenz says. "At this point, very little is known about how the auditory and visual processing systems of the brain work together. Understanding this interaction is important because in normal experience, our senses work together all the time."
California Institute of Technology
"As part of the experiment, a moving display was running on my computer screen with dots rapidly expanding out, somewhat like the opening scene of Star Wars. Out of the blue, one of the students asked, "Does anyone else hear something when you look at that?" After talking to him further, I realized that his experience had all the characteristics of a synesthesia: an automatic sensory cross-activation that he had experienced all of his life," says Saenz.
A search of the synesthesia literature revealed that auditory synesthesia--of any kind--had never been reported. Intrigued, Saenz began to look for other individuals with the same ability, using the original movie seen by the student as a test. "I queried a few hundred people and three more individuals turned up," she says. Having that specific example made it easy to find more people. That movie just happens to be quite "noisy" to the synesthetes and was a great screening tool. When asked if it made a sound, one of the individuals responded, "how could it not?" I would have been less successful had I just generally asked, "Do you hear sounds when you see things move or flash?" because in the real environment, things that move often really do make a sound," for example, a buzzing bee.
This may be why auditory synesthesia hadn't been detected by neurobiologists. "People with auditory synesthesia may be even less likely than people with other synesthetic associations to fully realize that their experience is unusual. These individuals have an enhanced soundtrack in life, rather than a dramatically different experience, compared to others," says Saenz. However, when asked, all of the synesthetes could name examples of daily visual events that caused sounds that they logically knew to be only in their minds, such as seeing a fluttering butterfly or watching television with the sound turned off.
Saenz and Koch found that the four synesthetes outperformed a group of nonsynesthetes on a simple test involving rhythmic patterns of flashes similar to visual Morse code. Normally, such patterns are easier to identify with sound (beeps) than with vision (flashes), so the researchers predicted that synesthetes would have an advantage with visual patterns because they actually heard a sound every time they saw a flash.
In the test, the subjects saw a series of flashes and had to guess if a second sequence, played afterward, represented the same temporal pattern or not. As a baseline measurement, a similar test was given using sequences of beeps. Both the synesthetes and the control group performed equally well when given beeps. However, with visual flashes synesthetes were much more accurate, responding correctly more than 75 percent of the time, compared to around 50 percent--the level predicted by chance--in the control group. "Synesthetes had an advantage because they not only saw but also heard the visual patterns," Saenz says.
Saenz and Koch suspect that as much as 1 percent of the population may experience auditory synesthesia. In fact, she and Koch think that the brain may normally transfer visual sensory information over to the auditory cortex, to create a prediction of the associated sound. "This translation might result in actual sound perception in synesthetes, perhaps due to stronger than normal connections, says Saenz, who has begun brain imaging experiments to study this connectivity in synesthetes and nonsynesthetes.
"We might find that motion processing centers of the visual cortex are more interconnected with auditory brain regions than previously thought, even in the 'normal' brain," Saenz says. "At this point, very little is known about how the auditory and visual processing systems of the brain work together. Understanding this interaction is important because in normal experience, our senses work together all the time."
California Institute of Technology
Research at Rice may help explain aspects of synesthesia
A research team led by Rice University Psychology Professor Tony Ro has published its findings that may help to explain the phenomenon known as synesthesia, in which stimulation of one sensory pathway leads to automatic, involuntary experiences in a second sensory pathway.
Seeing colors -- New study sheds light on sensory system quirk
In the psychological phenomenon known as "synesthesia," individuals' sensory systems are a bit more intertwined than usual. Some people, for example, report seeing colors when musical notes are played.
More Synesthesia Current Events and Synesthesia News Articles
 | The Hidden Sense: Synesthesia in Art and Science (Leonardo Books) by Cretien van Campen What does it mean to hear music in colors, to taste voices, to see each letter of the alphabet as a different color? These uncommon sensory experiences are examples of synesthesia, when two or more senses cooperate in perception. Once dismissed as imagination or delusion, metaphor or drug-induced hallucination, the experience of synesthesia has now been documented by scans of synesthetes' brains... |
 | Synesthesia: Perspectives from Cognitive Neuroscience Owing to its bizarre nature and its implications for understanding how brains work, synesthesia has recently received a lot of attention in the popular press and motivated a great deal of research and discussion among scientists. The questions generated by these two communities are intriguing: Does the synesthetic phenomenon require awareness and attention? How does a feature that is not present... |
 | The Frog who Croaked Blue: Synesthesia and the Mixing of the Senses by Jamie Ward As little Edgar Curtis lay on his porch, he remarked to his mother how the noise of the rifle range was black, the chirp of the cricket was red, and the croak of the frog was bluish. Edgar, like many other people, has synesthesia - a fascinating condition in which music can have color, words can have taste, and time and numbers float through space. Everyone will be closely acquainted with at... |
 | Wednesday Is Indigo Blue: Discovering the Brain of Synesthesia by Richard E. Cytowic, David M. Eagleman A person with synesthesia might feel the flavor of food on her fingertips, sense the letter "J" as shimmering magenta or the number "5" as emerald green, hear and taste her husband's voice as buttery golden brown. Synesthetes rarely talk about their peculiar sensory gift—believing either that everyone else senses the world exactly as they do, or that no one else does. Yet synesthesia occurs in... |
 | Synesthesia: A Union of the Senses - Second Edition by Richard E. Cytowic For decades, scientists who heard about synesthesia hearing colors, tasting words, seeing colored pain just shrugged their shoulders or rolled their eyes. Now, as irrefutable evidence mounts that some healthy brains really do this, we are forced to ask how this squares with some cherished conceptions of neuroscience. These include binding, modularity, functionalism, blindsight, and consciousness.... |
 | Miracle Myx by Dave Diotalevi Two near-death experiences have transformed Myx Amens; he hasn't slept for three years. His first near-death experience, a lightning strike, left him with a photographic memory while his second, drowning, induced synesthesia, so he smells and feels colors, sees sounds, and tastes the thoughts and feelings of others. These skill sets endow Myx to investigate local unsolved homicides and ruffle a... |
 | The Man Who Tasted Shapes (Bradford Books) by Richard E. Cytowic Richard Cytowic's dinner host apologized, "There aren't enough points on the chicken!" He felt flavor also as a physical shape in his hands, and the chicken had come out "too round." This offbeat comment in 1980 launched Cytowic's exploration into the oddity called synesthesia. He is one of the few world authorities on the subject. Sharing a root with anesthesia ("no sensation"), synesthesia... |
 | The Cinematic Language: A Psalm for Synesthesia by Zachariah Elisha Anthony Barely seventeen years old, Zachariah Elisha Anthony was hastily submerging in an apocalyptic-like floodwater sometimes but not often referred to as Hurricane Katrina (without the aid of a swimming education). Within minutes of the home’s immersion, he was seeing any and all hope of his dreams ever being read swiftly disappear. But that hour of Zachariah’s departure hasn’t come just yet.... |
 | Synesthesia: When colors count [An article from: Cognitive Brain Research] by D. Knoch, L.R.R. Gianotti, C. Mohr, P. Brugger This digital document is a journal article from Cognitive Brain Research, published by Elsevier in . The article is delivered in HTML format and is available in your Amazon.com Media Library immediately after purchase. You can view it with any web browser.Description: A tacitly held assumption in synesthesia research is the unidirectionality of digit-color associations. This notion is based on... |
| Shelley and Synesthesia by Glenn O'Malley |
| © 2008 BrightSurf.com |