Table 1 A manifesto for reproducible science.
Theme | Proposal | Examples of initiatives/potential solutions (extent of current adoption) | Stakeholder(s) |
|---|---|---|---|
Methods | Protecting against cognitive biases | All of the initiatives listed below (* to ****) Blinding (**) | J, F |
Improving methodological training | Rigorous training in statistics and research methods for future researchers (*) Rigorous continuing education in statistics and methods for researchers (*) | I, F | |
Independent methodological support | Involvement of methodologists in research (**) Independent oversight (*) | F | |
Collaboration and team science | Multi-site studies/distributed data collection (*) Team-science consortia (*) | I, F | |
Reporting and dissemination | Promoting study pre-registration | Registered Reports (*) Open Science Framework (*) | J, F |
Improving the quality of reporting | Use of reporting checklists (**) Protocol checklists (*) | J | |
Protecting against conflicts of interest | Disclosure of conflicts of interest (***) Exclusion/containment of financial and non-financial conflicts of interest (*) | J | |
Reproducibility | Encouraging transparency and open science | Open data, materials, software and so on (* to **) Pre-registration (**** for clinical trials, * for other studies) | J, F, R |
Evaluation | Diversifying peer review | Preprints (* in biomedical/behavioural sciences, **** in physical sciences) Pre- and post-publication peer review, for example, Publons, PubMed Commons (*) | J |
Incentives | Rewarding open and reproducible practices | Badges (*) Registered Reports (*) Transparency and Openness Promotion guidelines (*) Funding replication studies (*) Open science practices in hiring and promotion (*) | J, I, F |
