Scientists believe studies by colleagues are more prone to biases than their own studies

February 03, 2021

The properties of human mind affect the quality of scientific knowledge through the insertion of unconscious cognitive biases. Scientists from the University of Turku, Finland, have found that the current level of awareness about research biases is generally low among ecology scientists. Underestimation of the risks associated with unconscious cognitive biases prevents avoiding these risks in a scientist's own research. Due to unconscious origin of biases, it is impossible to combat them without external intervention.

When scientists use some device in their research, they always account for characteristics of this device, such as accuracy and precision. The human mind is the most important tool in the scientific research. Nevertheless, its properties are rarely taken into account by the ecologists while conducting their research.

The cognitive biases emerge most frequently due to tendency of humans to search for and interpret information in a way that confirms one's pre-existing beliefs or hypotheses.

- For example, an influential theory predicts that pollution increases asymmetry of plant leaves. When two groups of scientists were asked to measure the same set of leaves, the group which was told that leaves originate from a polluted site reported significantly higher asymmetry than the group which was told that leaves originate from a clean site. Thus, the first group of scientists found non-existing effect only because they believed that it should exist, says Adjunct Professor Elena Zvereva from the Department of Biology of the University of Turku.

- This kind of biases may considerably influence the output of the research, generally leading to overestimation of the effects under study. Development of measures for combating cognitive biases in research requires information on the current level of awareness about biases among scientists, Zvereva adds.

Responses of 308 ecology scientists from 40 countries to a web-based questionnaire revealed that knowledge about biases and attitude towards biases depend on the scientist's career stage, gender and affiliation country. Respondents from high GDP countries have better knowledge about biases than respondents from low GDP countries. Early career scientists were more concerned about biases, know more about measures to avoid biases, and twice more often have learned about biases from their university courses when compared with their senior colleagues. This difference indicates current improvement of education about biases and gives hope that their impact on scientific research will decrease in the future.

Ecological scientists estimate that the risk of biases in their own studies is much lower than in science in general and in studies by other scientists working in the same research field. In other words, they "see the speck that is in their brother's eye, but do not notice the log that is in their own eye". The strength of this "bias blind spot" is two times larger in men than in women and two times larger in senior scientists than in early career scientists. These differences suggest that this bias is more typical for persons with high self-confidence and self-esteem.

- Education about biases is necessary, but not yet sufficient, to avoid biases because the unconscious origin of biases necessitates external intervention to combat them. Obligatory reporting of measures taken against biases in all relevant manuscripts will likely increase the quality of scientific publications and enhance the reproducibility of scientific results, concludes Adjunct Professor Mikhail Kozlov from the University of Turku.
The study has been published in the Scientific Reports journal.

University of Turku

Related Scientific Research Articles from Brightsurf:

Who's Tweeting about scientific research? And why?
Although Twitter is best known for its role in political and cultural discourse, it has also become an increasingly vital tool for scientific communication.

Weaving Indigenous knowledge with scientific research: a balanced approach
Insights from bicultural research can enhance practical applications from a palaeotsunami database to land-use decisions, according to a new review in Earth Surface Dynamics

Level of media coverage for scientific research linked to number of citations
An analysis of over 800 academic research papers on physical health and exercise suggests that the level of popular media coverage for a given paper is strongly linked to the attention it receives within the scientific community.

Spotting cutting-edge topics in scientific research using keyword analysis
Researchers from the University of Tsukuba conducted a quantitative keyword analysis of 30 million articles in the life sciences over a nearly fifty-year period (1970-2017) and found that 75% of total emerging keywords, at 1-year prior to becoming identified as emerging, co-appeared with other emerging keywords in the same article.

Calibration method improves scientific research performed with smartphone cameras
Although smartphones and other consumer cameras are increasingly used for scientific applications, it's difficult to compare and combine data from different devices.

AccessLab: New workshops to broaden access to scientific research
A team from the transdisciplinary laboratory FoAM Kernow and the British Science Association detail how to run an innovative approach to understanding evidence called AccessLab in a paper published on May 28 in the open-access journal PLOS Biology.

University of Idaho study finds scientific reproducibility does not equate to scientific truth
Reproducible scientific results are not always true and true scientific results are not always reproducible, according to a mathematical model produced by University of Idaho researchers.

Scientific research will help to understand the origin of life in the universe
Scientists from Samara University and several universities in the USA have proposed and experimentally confirmed new fundamental chemical mechanisms for the synthesis of polycyclic aromatic hydrocarbons (PAHs).

New research helps to inform the design of scientific advisory committees
At a time of 'fake news' and a growing mistrust of scientific experts, researchers at York University's Global Strategy Lab have produced new research to help inform the design of scientific advisory committees and help maximize the application of high-quality scientific research towards future policy and program decisions.

Jumping to scientific conclusions challenges biomedical research
Improving experimental design and statistical analyses alone will not solve the reproducibility crisis in science, argues Ray Dingledine in a societal impact article published in eNeuro.

Read More: Scientific Research News and Scientific Research Current Events is a participant in the Amazon Services LLC Associates Program, an affiliate advertising program designed to provide a means for sites to earn advertising fees by advertising and linking to