Nav: Home

Brain imaging results skewed by biased study samples

October 12, 2017

Any scientist who studies groups of people knows that the characteristics of the "sample" -- the group of people selected for the study -- can profoundly impact the study's findings. To produce the most accurate findings, a study group ought to be as similar as possible to the people in the larger population you want to say something about.

A new UC San Francisco-led study shows that failure to follow this basic principle of population science -- a common complaint about research in the cognitive sciences -- can profoundly skew the results of brain imaging studies, leading to errors that may be throwing off neuroscientists' understanding of normal brain development.

"Much of what we know about how the brain develops comes from samples that don't look like the broader U.S. at all," said Kaja LeWinn, ScD, an epidemiologist and assistant professor of psychiatry at UCSF, member of the UCSF Weill Institute for Neurosciences, and lead author of the new study. "We would never try to understand the burden of other health conditions, like cardiovascular disease, in a sample with much higher socioeconomic status than the U.S. population as a whole, for instance."

In recent years, social scientists have drawn attention to the over-representation of so-called W.E.I.R.D (White, Educated, Industrial, Rich, Developed) individuals in cognitive science experiments, but LeWinn says her team's new study -- published online October 12, 2017 in Nature Communications -- is the first to look directly at exactly how these sampling practices impact the research results of neuroimaging studies.

The research team -- which included Margaret A. Sheridan, PhD, of the University of North Carolina at Chapel Hill; Katherine M. Keyes, PhD, and Ava Hamilton of Columbia University; and Katie A. McLaughlin, PhD, of the University of Washington -- found that applying the sampling approaches frequently used in brain imaging studies to a large dataset of pediatric MRI images significantly distorted findings about how different regions of the brain develop with age.

"These findings give us pause because they raise questions about existing knowledge of brain development in children, which is based almost entirely on non-representative samples," LeWinn said. "These foundational studies inform our understanding not only of brain development, but also of mental health disorders like depression and autism. It will be critical for the field to evaluate whether these findings replicate in larger samples that better resemble the US population in all its diversity."

The new findings are also likely to have broad implications for understanding why it is often difficult to reproduce research results in human neuroscience, LeWinn added. "The field has had a hard time replicating findings in neuroimaging, but so far, explanations for that have been focused on the way that brain imaging data are processed and analyzed, not on sample composition. But if we conducted the exact same study on two groups of people with completely different underlying characteristics, there is no reason to expect that we would find the same answer."

The Developing Brain Changes With Age -- and With Study Samples

The authors made use of a large, publicly available dataset of brain scans from 1162 children aged three to 18 years from the Pediatric Imaging, Neurocognition and Genetics Study (PING). As is typical of developmental neuroimaging studies, the demographics of the PING sample were not very similar to the wider U.S. population. For example, household education and income levels were considerably higher in the children in this dataset than in the broader U.S. Typically, investigators would use PING data without considering these demographic differences, LeWinn said.

In the new study LeWinn and her colleagues created a "weighted" version of this dataset that better reflected the distribution of demographic characteristics such as sex, race/ethnicity, parental education and income in the US population, and then asked whether correctly weighting the sample changed what the brain images revealed about how the brain develops during childhood.

The researchers found that weighting the data in this fashion significantly altered what the brain images showed about the timeline of brain development during childhood and adolescence. In most cases, the weighted data showed brain regions reaching their peak size much earlier than the unweighted data would have suggested, suggesting a faster pace of development in the weighted sample. For example, the unweighted data showed overall brain surface area peaking at 12.1 years , while the correctly weighted data revealed that this peak more likely occurs at 9.7 years of age -- a 2.4 year difference.

The authors also found that weighting the PING dataset impacted the apparent order in which different brain regions develop. In the unweighted sample, the frontal, occipital, and temporal lobes of the brain all seem to develop at about the same time, which is contrary to a broader understanding in neuroscience that the brain develops from back to front, starting with sensory and motor regions and only in late adolescence finishing the development of regions in the front of the brain involved in more abstract forms of cognition. The weighted imaging data matched this back-to-front model much better: it showed the parietal and occipital lobes in the back of the head developing earliest, followed by the temporal lobe beneath the ears, and the frontal lobe last.

"The differences we found are pretty dramatic," said LeWinn. "The weighted data showed maturation peaking in some brain regions as much as four years earlier than the unweighted data would have suggested. We've shown that simply by weighting a dataset to better approximate a representative U.S. sample, we can end up with very different ideas about how the brain develops. Not only do we see big differences in age at peak surface area and volume, but we also found that the weighted data gives us a pattern of brain development that is more consistent with what we'd expect, with sensorimotor areas developing first, followed by association cortices."

Enter Population Neuroscience

The new research adds to a growing debate in neuroscience about the use of small "samples of convenience" rather than investing in larger and more sweeping samples that carefully represent well-defined target populations of interest within the U.S.

"Most cognitive neuroscience studies are so small that we can't apply the weighting methods used in our study to approximate a U.S. sample, which we were able to do because of the large size of the PING dataset," LeWinn said. "But at a minimum, researchers doing these studies need to be very transparent about the demographic characteristics of their sample, and consider to whom it's reasonable to generalize their findings. That way when the community sees inconsistent findings across studies of the same research question, we can consider differences in sample composition as one potential explanation."

LeWinn added that it's not reasonable to insist that all neuroimaging studies of healthy populations be perfectly representative of the U.S: "That would be impractical and financially prohibitive, and we certainly don't want to suggest that. But certainly for large, multisite studies, like the new NIH-funded ABCD [Adolescent Brain Cognitive Development] study, which represents a major investment of taxpayer dollars, representative sampling should be a primary goal."
-end-
The research was supported by the National Institute of Mental Health, the National Institute on Drug Abuse, the National Institute on Alcohol Abuse and Alcoholism, the Jacobs Foundation, the AIM for Mental Health program of One Mind Institute, and the Pediatric Imaging, Neurocognition and Genetics Study, which is funded by the National Institutes of Health, the National Institute on Drug Abuse and the Eunice Kennedy Shriver National Institute of Child Health & Human Development.

University of California - San Francisco

Related Brain Articles:

Study describes changes to structural brain networks after radiotherapy for brain tumors
Researchers compared the thickness of brain cortex in patients with brain tumors before and after radiation therapy was applied and found significant dose-dependent changes in the structural properties of cortical neural networks, at both the local and global level.
Blue Brain team discovers a multi-dimensional universe in brain networks
Using a sophisticated type of mathematics in a way that it has never been used before in neuroscience, a team from the Blue Brain Project has uncovered a universe of multi-dimensional geometrical structures and spaces within the networks of the brain.
New brain mapping tool produces higher resolution data during brain surgery
Researchers have developed a new device to map the brain during surgery and distinguish between healthy and diseased tissues.
Newborn baby brain scans will help scientists track brain development
Scientists have today published ground-breaking scans of newborn babies' brains which researchers from all over the world can download and use to study how the human brain develops.
New test may quickly identify mild traumatic brain injury with underlying brain damage
A new test using peripheral vision reaction time could lead to earlier diagnosis and more effective treatment of mild traumatic brain injury, often referred to as a concussion.
This is your brain on God: Spiritual experiences activate brain reward circuits
Religious and spiritual experiences activate the brain reward circuits in much the same way as love, sex, gambling, drugs and music, report researchers at the University of Utah School of Medicine.
Brain scientists at TU Dresden examine brain networks during short-term task learning
'Practice makes perfect' is a common saying. We all have experienced that the initially effortful implementation of novel tasks is becoming rapidly easier and more fluent after only a few repetitions.
Balancing time & space in the brain: New model holds promise for predicting brain dynamics
A team of scientists has extended the balanced network model to provide deep and testable predictions linking brain circuits to brain activity.
New view of brain development: Striking differences between adult and newborn mouse brain
Spikes in neuronal activity in young mice do not spur corresponding boosts in blood flow -- a discovery that stands in stark contrast to the adult mouse brain.
Map of teenage brain provides evidence of link between antisocial behavior and brain development
The brains of teenagers with serious antisocial behavior problems differ significantly in structure to those of their peers, providing the clearest evidence to date that their behavior stems from changes in brain development in early life, according to new research led by the University of Cambridge and the University of Southampton, in collaboration with the University of Rome Tor Vergata in Italy.

Related Brain Reading:

The Brain: The Story of You
by David Eagleman (Author)

Locked in the silence and darkness of your skull, your brain fashions the rich narratives of your reality and your identity. Join renowned neuroscientist David Eagleman for a journey into the questions at the mysterious heart of our existence. What is reality? Who are “you”? How do you make decisions? Why does your brain need other people? How is technology poised to change what it means to be human?  In the course of his investigations, Eagleman guides us through the world of extreme sports, criminal justice, facial expressions, genocide, brain surgery, gut feelings, robotics, and the... View Details


Switch On Your Brain: The Key to Peak Happiness, Thinking, and Health
by Dr. Caroline Leaf (Author)

According to researchers, the vast majority--a whopping 75-98 percent--of the illnesses that plague us today are a direct result of our thought life. What we think about truly affects us both physically and emotionally. In fact, fear alone triggers more than 1,400 known physical and chemical responses in our bodies, activating more than thirty different hormones! Today our culture is undergoing an epidemic of toxic thoughts that, left unchecked, create ideal conditions for illnesses.

Supported by current scientific and medical research, Dr. Caroline Leaf gives readers a prescription... View Details


Rewire Your Anxious Brain: How to Use the Neuroscience of Fear to End Anxiety, Panic, and Worry
by Catherine M Pittman PhD (Author), Elizabeth M Karle MLIS (Author)

Do you ever wonder what is happening inside your brain when you feel anxious, panicked, and worried? In Rewire Your Anxious Brain, psychologist Catherine Pittman and author Elizabeth Karle offer a unique, evidence-based solution to overcoming anxiety based in cutting-edge neuroscience and research. In the book, you will learn how the amygdala and cortex (both important parts of the brain) are essential players in the neuropsychology of anxiety. The amygdala acts as a primal response, and oftentimes, when this part of the brain processes fear, you may not even understand why... View Details


My First Book About the Brain (Dover Children's Science Books)
by Patricia J. Wynne (Author), Donald M. Silver (Author)

Winner of a Bronze 2014 Moonbeam Children's Book Award!
Discover the workings of the body's most complex organ! How does the brain control the rest of the body? How does it enable the senses to function, regulate speech, affect balance, and influence sleep and dreams? These 25 illustrations to color explain every aspect of the brain's important jobs, from communicating with the central nervous system to retaining memories. Suitable for ages 8–12. View Details


Brain Rules (Updated and Expanded): 12 Principles for Surviving and Thriving at Work, Home, and School
by John Medina (Author)

Most of us have no idea what’s really going on inside our heads. Yet brain scientists have uncovered details every business leader, parent, and teacher should know—like the need for physical activity to get your brain working its best.

How do we learn? What exactly do sleep and stress do to our brains? Why is multi-tasking a myth? Why is it so easy to forget—and so important to repeat new knowledge? Is it true that men and women have different brains?

In Brain Rules, Dr. John Medina, a molecular biologist, shares his lifelong interest in how the brain sciences might... View Details


Neuroscience: Exploring the Brain
by Mark F. Bear (Author), Barry W. Connors (Author), Michael A. Paradiso (Author)

Publisher’s Note:   Products purchased from 3rd Party sellers are not guaranteed by the Publisher for quality, authenticity, or access to any online entitlements included with the product.

Acclaimed for its clear, friendly style, excellent illustrations, leading author team, and compelling theme of exploration, Neuroscience: Exploring the Brain, 4e takes a fresh, contemporary approach to the study of neuroscience, emphasizing the biological basis of behavior. The authors’ passion for the dynamic field of neuroscience is evident on every page, engaging students... View Details


The Brain That Changes Itself: Stories of Personal Triumph from the Frontiers of Brain Science
by Norman Doidge (Author)

An astonishing new science called "neuroplasticity" is overthrowing the centuries-old notion that the human brain is immutable. In this revolutionary look at the brain, psychiatrist and psychoanalyst Norman Doidge, M.D., provides an introduction to both the brilliant scientists championing neuroplasticity and the people whose lives they've transformed. From stroke patients learning to speak again to the remarkable case of a woman born with half a brain that rewired itself to work as a whole, The Brain That Changes Itself will permanently alter the way we look at our brains, human... View Details


The Brain's Way of Healing: Remarkable Discoveries and Recoveries from the Frontiers of Neuroplasticity
by Norman Doidge (Author)

NEW YORK TIMES BESTSELLER

 The New York Times–bestselling author of The Brain That Changes Itself presents astounding advances in the treatment of brain injury and illness. Now in an updated and expanded paperback edition.

Winner of the 2015 Gold Nautilus Award in Science & Cosmology 

In his groundbreaking work The Brain That Changes Itself, Norman Doidge introduced readers to neuroplasticity—the brain’s ability to change its own structure and function in response to activity and mental experience. Now his revolutionary... View Details


Brain: The Complete Mind: How It Develops, How It Works, and How to Keep It Sharp
by Michael S. Sweeney (Author), Richard Restak (Foreword)

Did you know that listening to music tunes up your brain? Or that certain foods can help maintain mental fitness? Or that exercise can keep both body and mind in good shape? Delving into the science behind these strategies, Brain goes even deeper to reveal the brain’s inner workings.

Overseen by distinguished neuropsychiatrist Dr. Richard Restak, Brainis both a practical owner’s manual and a complete guide to the brain’s development and function. Its pages explore not only the brain’s physical form—its 100 billion nerve cells and near-infinite network of... View Details


Brain Maker: The Power of Gut Microbes to Heal and Protect Your Brain–for Life
by David Perlmutter (Author), Kristin Loberg (Contributor)

The bestselling author of Grain Brain uncovers the powerful role of gut bacteria in determining your brain's destiny.

Debilitating brain disorders are on the rise-from children diagnosed with autism and ADHD to adults developing dementia at younger ages than ever before. But a medical revolution is underway that can solve this problem: Astonishing new research is revealing that the health of your brain is, to an extraordinary degree, dictated by the state of your microbiome - the vast population of organisms that live in your body and outnumber your own cells... View Details

Best Science Podcasts 2017

We have hand picked the best science podcasts for 2017. Sit back and enjoy new science podcasts updated daily from your favorite science news services and scientists.
Now Playing: TED Radio Hour

Manipulation
We think we're the ones who control what we see, read, think and remember. But is that true? Who decides? And who should decide? This hour, TED speakers reveal just how easily we can be manipulated. Guests include design ethicist Tristan Harris, MSNBC host Ali Velshi, psychologist Elizabeth Loftus, and neuroscientist Steve Ramirez.
Now Playing: Science for the People

#443 Batteries
This week on Science for the People we take a deep dive into modern batteries: how they work now and how they might work in the future. We speak with Gerbrand Ceder from UC Berkeley, about the most commonly used batteries today, how they work, and how they could work better. And we talk with Kathryn Toghill, electrochemist from Lancaster University, about redox flow batteries and how they could help make our power grids more sustainable.