Jumping to scientific conclusions challenges biomedical research

September 04, 2018

Improving experimental design and statistical analyses alone will not solve the reproducibility crisis in science, argues Ray Dingledine in a societal impact article published in eNeuro. Repeating classic behavioral economics experiments with graduate- to senior-level researchers, the author finds scientists of all career stages are subject to the same biases as undergraduates when interpreting data.

In the 1960s and '70s, psychologists Daniel Kahneman and Amos Tversky demonstrated that people tend to engage in "fast thinking" -- relying on preconceived notions and emotions -- when making decisions in the face of new information. While this finding has had clear implications for economic decisions such as weighing the risks and rewards of a financial investment, Dingledine wondered whether it would also apply to scientific decision-making.

A survey of present-day graduate students, postdoctoral and senior research staff, and principal investigators across three basic science departments revealed that these scientists were just as likely as the university students tested by Kahneman and Tversky 45 years ago to jump to conclusions when grappling with unfamiliar data. Conducting a "premortem" before new experiments take place could help to identify these potential pitfalls and encourage scientists to think more like the forward-planning ancient Greek Titan Prometheus rather than his hasty brother Epimetheus.
-end-
Article: Why Is It So Hard To Do Good Science?
DOI: https://doi.org/10.1523/ENEURO.0188-18.2018
Corresponding author: Ray Dingledine (Emory University School of Medicine, Atlanta, GA, USA), rdingle@emory.edu

About eNeuro

eNeuro, the Society for Neuroscience's open-access journal launched in 2014, publishes rigorous neuroscience research with double-blind peer review that masks the identity of both the authors and reviewers, minimizing the potential for implicit biases. eNeuro is distinguished by a broader scope and balanced perspective achieved by publishing negative results, failure to replicate or replication studies. New research, computational neuroscience, theories and methods are also published.

About The Society for Neuroscience

The Society for Neuroscience is the world's largest organization of scientists and physicians devoted to understanding the brain and nervous system. The nonprofit organization, founded in 1969, now has nearly 37,000 members in more than 90 countries and over 130 chapters worldwide.

Society for Neuroscience

Related Biases Articles from Brightsurf:

Tool helps clear biases from computer vision
Researchers at Princeton University have developed a tool that flags potential biases in sets of images used to train artificial intelligence (AI) systems.

Story tips from Johns Hopkins experts on COVID-19
Story Tips from Johns Hopkins Experts on Covid-19

COVID-19 story tip: Racism amid the COVID-19 pandemic -- a path forward
Because SARS-CoV-2, the virus that causes COVID-19, was first discovered in China, Chinese American families in the United States have reported an increase in racist experiences during the ongoing pandemic.

Latest version of climate system model shows significant improvements in simulation performance
The simulating performance of the latest climate system model FGOALS-f3-L is evaluated and significant improvements are apparent compared with the previous version.

Language may undermine women in science and tech
Researchers examined gender stereotypes baked into 25 languages to explore why fewer women enter science, technology, engineering and mathematics fields.

Increased attention to sad faces predicts depression risk in teenagers
Teenagers who tend to pay more attention to sad faces are more likely to develop depression, but specifically within the context of stress, according to new research from Binghamton University, State University of New York.

New study finds biases against physically dirty people take root as early as age 5
People develop biases against individuals who are physically dirty as early as the age of 5 and carry these perceptions into adulthood, according to researchers from Boston College and Franklin & Marshall College.

You create your own false information, study finds
Along with partisan news outlets and political blogs, there's another surprising source of misinformation on controversial topics -- it's you.

New intervention may help ease young children's biases against gender-nonconforming peers
Worldwide, gender nonconformity is on the rise. Children who don't conform to their birth sex are often perceived less positively, which may harm their well-being.

Nonverbal signals can create bias against larger groups
If children are exposed to bias against one person, will they develop a bias against that person's entire group?

Read More: Biases News and Biases Current Events
Brightsurf.com is a participant in the Amazon Services LLC Associates Program, an affiliate advertising program designed to provide a means for sites to earn advertising fees by advertising and linking to Amazon.com.