Cookies help us deliver our services. By using our services, you agree to our use of cookies. More information

Difference between revisions of "Reproducibility crisis"

From Bioblast
Line 3: Line 3:


Asking the researchers for the causes of this inability to reproduce published results, the top three answers are:
Asking the researchers for the causes of this inability to reproduce published results, the top three answers are:
:::* Selective reporting
::::* Selective reporting
:::* Publication pressure
::::* Publication pressure
:::* Low statistical power and poor analysis
::::* Low statistical power and poor analysis


The top three mentioned countermeasures are:
The top three mentioned countermeasures are:
:::* Better understanding of statistics
::::* Better understanding of statistics
:::* Better mentoring and supervision
::::* Better mentoring and supervision
:::* More robust design
::::* More robust design
ย 
ย 




|info=[https://www.nature.com/news/1-500-scientists-lift-the-lid-on-reproducibility-1.19970 Baker M (2016) 1,500 scientists lift the lid on reproducibility. Survey sheds light on the โ€˜crisisโ€™ rocking research. Nature 533:452โ€“4.]
|info=[https://www.nature.com/news/1-500-scientists-lift-the-lid-on-reproducibility-1.19970 Baker M (2016) 1,500 scientists lift the lid on reproducibility. Survey sheds light on the โ€˜crisisโ€™ rocking research. Nature 533:452โ€“4.]
}}
}}


== Further links ==
== Further links ==
Line 31: Line 30:
== Solve the reproducibility crisis ==
== Solve the reproducibility crisis ==


While it is probably impossible to fully prevent human self-deception and inadequate command of statistical methods, what we can do is minimize sources of error connected to the instrumental equipment and its handling:
::::* Select instrumental equipment for which appropriate specifications are available.
::::* Select instrumental equipment for which appropriate specifications are available.
::::* Have yourself trained on your equipment. Make sure you know what you are doing in each step of the experiment (both, you and the device you operate).
::::*
::::* [https://de.slideshare.net/OpenAIRE_eu/20170530open-research-data-in-horizon-2020 Open-research data in Horizon 2020]
::::* [https://de.slideshare.net/OpenAIRE_eu/20170530open-research-data-in-horizon-2020 Open-research data in Horizon 2020]
::::* [https://www.future-science.com/btn/news/jul18/24 How can we increase reproducibility in neuroscience studies?] BioTechniques 2018.
::::* [https://www.future-science.com/btn/news/jul18/24 How can we increase reproducibility in neuroscience studies?] BioTechniques 2018.

Revision as of 14:05, 7 August 2018


high-resolution terminology - matching measurements at high-resolution


Reproducibility crisis

Description

Is there a reproducibility crisis? According to a survey conducted by Nature of 1,576 researchers, "52% agree that there is a significant 'crisis' of reproducibility, less than 31% think that failure to reproduce published results means that the result is probably wrong, and most say that they still trust the published literature" (Baker 2016).

Asking the researchers for the causes of this inability to reproduce published results, the top three answers are:

  • Selective reporting
  • Publication pressure
  • Low statistical power and poor analysis

The top three mentioned countermeasures are:

  • Better understanding of statistics
  • Better mentoring and supervision
  • More robust design


Reference: Baker M (2016) 1,500 scientists lift the lid on reproducibility. Survey sheds light on the โ€˜crisisโ€™ rocking research. Nature 533:452โ€“4.


Further links



Solve the reproducibility crisis

While it is probably impossible to fully prevent human self-deception and inadequate command of statistical methods, what we can do is minimize sources of error connected to the instrumental equipment and its handling:

  • Select instrumental equipment for which appropriate specifications are available.
  • Have yourself trained on your equipment. Make sure you know what you are doing in each step of the experiment (both, you and the device you operate).



MitoPedia concepts: "MitoFit Quality Control System" is not in the list (MiP concept, Respiratory state, Respiratory control ratio, SUIT concept, SUIT protocol, SUIT A, SUIT B, SUIT C, SUIT state, Recommended, ...) of allowed values for the "MitoPedia concept" property. MitoFit Quality Control System"MitoFit Quality Control System" is not in the list (Enzyme, Medium, Inhibitor, Substrate and metabolite, Uncoupler, Sample preparation, Permeabilization agent, EAGLE, MitoGlobal Organizations, MitoGlobal Centres, ...) of allowed values for the "MitoPedia topic" property.