Nav: Home

Scientists poised to study reproducibility of Brazilian biomedical research

February 05, 2019

A project to assess the reproducibility of biomedical research in Brazil has been described today in the open-access journal eLife.

The Brazilian Reproducibility Initiative is a systematic, multi-centre effort to repeat experiments from published articles originating from Brazil, with studies due to begin later this year and results expected in 2021. It is the first project of its kind designed to estimate the reproducibility of research in a specific country.

Launched in 2018, the initiative was recently awarded a grant of R$1m (about US$275,000) from the Serrapilheira Institute - Brazil's first private institute dedicated to supporting scientific research - to repeat between 60 and 100 experiments in at least three different laboratories each.

The replication studies will be based on individual experiments, rather than entire research articles, to increase coverage of the published literature and facilitate analysis. The scope of the studies will also be limited to common methodologies that are widely available in Brazil, to ensure they can be replicated within the project's network of more than 70 collaborating laboratories.

If the original result of an experiment is within the variation range predicted by the replication studies, it will be deemed reproducible. The results will then be used to assess if there are features of the original articles that can predict reproducibility.

Olavo Amaral, Professor at the Institute of Medical Biochemistry, Federal University of Rio de Janeiro, Brazil, will lead the project, alongside a coordinating team that includes researchers Kleber Neves, Clarissa Carneiro and Ana Paula Sampaio, from the same university. They will be responsible for selecting the methods and experiments to replicate, as well as overseeing the work of the collaborating labs.

"Most efforts to estimate the reproducibility of published findings have focused on specific areas of research, such as psychology and cancer biology, even though science is usually assessed and funded on a regional or national basis," Amaral says. "Here, we offer a different perspective on the concept, covering various areas of life science research with a focus on a particular country."

Amaral adds that the project is not without its challenges. For example, there may be concerns that replicating other scientists' work indicates mistrust of the original results. Also, as a degree of irreproducibility is expected - based on results from previous reproducibility efforts - this may raise worries about Brazilian science as there will be no estimates from other countries for comparison.

"To help counter these concerns, we are taking steps to ensure the project is viewed as we ourselves conceive it: a first-person initiative of the Brazilian scientific community to evaluate its own practices in an open, unbiased and transparent way," Amaral says.

"Whatever the results may be, this project is bound to put Brazil at the vanguard of the reproducibility debate, if only because we will likely be the first country to undertake such an evaluation. Indeed, we hope other countries might be inspired to openly assess their own rates of reproducibility. This could help to guide national funding agencies in evaluating this central dimension of science, giving them insights on where to direct their investments and fostering the reliability of published research."
-end-
References

The Feature Article 'Science Forum: The Brazilian Reproducibility Initiative' can be freely accessed online at https://doi.org/10.7554/eLife.41602. Contents, including text, figures and data, are free to reuse under a CC BY 4.0 license.

To find out more about the Reproducibility Project: Cancer Biology and the results published in eLife so far, visit https://elifesciences.org/collections/9b1e83d1/reproducibility-project-cancer-biology.

Media contact

Emily Packer, Senior Press Officer
eLife
e.packer@elifesciences.org
01223 855373

About eLife

eLife aims to help scientists accelerate discovery by operating a platform for research communication that encourages and recognises the most responsible behaviours in science. We publish important research in all areas of the life and biomedical sciences, including Biochemistry and Chemical Biology and Cell Biology, which is selected and evaluated by working scientists and made freely available online without delay. eLife also invests in innovation through open-source tool development to accelerate research communication and discovery. Our work is guided by the communities we serve. eLife is supported by the Howard Hughes Medical Institute, the Max Planck Society, the Wellcome Trust and the Knut and Alice Wallenberg Foundation. Learn more at https://elifesciences.org/about.

To read the latest Biochemistry and Chemical Biology research published in eLife, visit https://elifesciences.org/subjects/biochemistry-chemical-biology.

And to read the latest Cell Biology research, see https://elifesciences.org/subjects/cell-biology.

eLife

Related Biomedical Research Articles:

Public funding research key to advancing biomedical innovation
A new paper co-authored by Columbia University Mailman School of Public Health's Bhaven Sampat, PhD, shows that 30 percent of all NIH-funded grants produce research that is cited by a private-sector patent.
Public funding essential for advances in biomedical research
Article shows that publicly-funded research creates knowledge that links to private companies' efforts to develop drugs, medical devices, and other patented biomedical products.
Accounting for sex differences in biomedical research
When it comes to health, a person's sex can play a role.
Five ways to tackle the reproducibility crisis in biomedical research
In an op-ed published Sept. 13 in Cell Metabolism, Drucker, of the Lunenfeld-Tanenbaum Research Institute at Mt.
Maximizing biomedical research through integrated science
In this Policy Forum, Phillip Sharp, Tyler Jacks and Susan Hockfield discuss the need for better integration of engineering, physical, computational, and mathematical sciences with biomedical science, as they publish a report this week outlining key recommendations in this space.
Summit on the sustainability of the US biomedical research enterprise
The summit will bring together experts to identify obstacles to reform and to determine actions the scientific community can take to rebalance the size of the research workforce with available funding while continuing to train the next generation of scientists and produce important discoveries.
Review addresses value and waste in biomedical research
Some studies suggest that as much as 85 per cent of investment in biomedical research is wasted -- a review published in The Lancet with input from Plymouth University addresses the issues.
Data-driven approach could help improve allocation of biomedical research resources
A new computational model developed by scientists from the University of Chicago could help improve the allocation of US biomedical research resources.
16 top scientists and educators announce collaboration to rescue US biomedical research
A diverse team of 16 prominent scientists and educators today announced the launch of a high-profile collaboration that seeks to leverage knowledge from the scientific community to confront the dangers to the US biomedical science enterprise.
How can we improve data sharing of biomedical research across the globe?
With the globalization of biomedical research and growing concerns about possible pandemics of diseases such as HIV, SARS, and Ebola, international data-sharing practices are of growing interest to the biomedical science community.

Related Biomedical Research Reading:

Best Science Podcasts 2019

We have hand picked the best science podcasts for 2019. Sit back and enjoy new science podcasts updated daily from your favorite science news services and scientists.
Now Playing: TED Radio Hour

Anthropomorphic
Do animals grieve? Do they have language or consciousness? For a long time, scientists resisted the urge to look for human qualities in animals. This hour, TED speakers explore how that is changing. Guests include biological anthropologist Barbara King, dolphin researcher Denise Herzing, primatologist Frans de Waal, and ecologist Carl Safina.
Now Playing: Science for the People

#532 A Class Conversation
This week we take a look at the sociology of class. What factors create and impact class? How do we try and study it? How does class play out differently in different countries like the US and the UK? How does it impact the political system? We talk with Daniel Laurison, Assistant Professor of Sociology at Swarthmore College and coauthor of the book "The Class Ceiling: Why it Pays to be Privileged", about class and its impacts on people and our systems.