Trying to confirm research findings by repeating experiments in mice may be as ineffective as a coin toss, say scientists who claim to have exposed a problem which potentially affects many studies in experimental biomedicine. Scientists at Berlin Institute of Health (BIH) and Charite -Universitatsmedizin Berlin in Germany conducted a provocative and seemingly absurd experiment.
Instead of repeating an experiment in a mouse model of disease in their laboratory, researchers used a coin toss to confirm whether a drug protects the brain against a stroke, for a study published in the journal PLOS Biology.
The researchers said that small sample sizes, often below 10, and almost universally loose thresholds for accepting statistical significance (5 per cent) lead to a high rate of false positive results and an overestimation of true effects.
Findings
Their study alerts researchers that, contrary to common expectation, replication of a study -- in settings which are common in many laboratories worldwide -- may not add more evidence to what could be gained from tossing a coin.
Many research fields are struggling with what has been termed “the replication crisis.” Quite often results from one laboratory cannot be replicated by researchers in another lab, with successful replication rates often falling below 50 per cent.
This has shaken confidence in the robustness of the scientific enterprise in general and stimulated a search for underlying causes.
Toward this end, many researchers have started to repeat experiments within their laboratories as an integral part of robust science and good scientific practice.
In the new research paper, the team scrutinised the utility of replicating experiments within laboratories and send a surprising message of caution regarding current replication practices.
They provide detailed theoretical and practical background for how to properly conduct and report replication studies to help scientists save resources and prevent futile use of animals, while increasing the robustness and reproducibility of their results.
“Replication is fundamental to the scientific process. We can learn from successful and from failed replication -- but only if we design, perform, and report them properly,” researchers said.
Comments
Comments have to be in English, and in full sentences. They cannot be abusive or personal. Please abide by our community guidelines for posting your comments.
We have migrated to a new commenting platform. If you are already a registered user of TheHindu Businessline and logged in, you may continue to engage with our articles. If you do not have an account please register and login to post comments. Users can access their older comments by logging into their accounts on Vuukle.