Pragmatic Apparatus – Initial evidence of research quality of registered reports compared with the standard publishing model

Cited by Lee Sonogan

Research Wallpapers - Top Free Research Backgrounds - WallpaperAccess

Abstract by Courtney K. Soderberg,Timothy M. Errington,Sarah R. Schiavone,Julia Bottesini,Felix Singleton Thorn,Simine Vazire,Kevin M. Esterling &Brian A. Nosek 

In registered reports (RRs), initial peer review and in-principle acceptance occur before knowing the research outcomes. This combats publication bias and distinguishes planned from unplanned research. How RRs could improve the credibility of research findings is straightforward, but there is little empirical evidence. Also, there could be unintended costs such as reducing novelty. Here, 353 researchers peer reviewed a pair of papers from 29 published RRs from psychology and neuroscience and 57 non-RR comparison papers. RRs numerically outperformed comparison papers on all 19 criteria (mean difference 0.46, scale range −4 to +4) with effects ranging from RRs being statistically indistinguishable from comparison papers in novelty (0.13, 95% credible interval [−0.24, 0.49]) and creativity (0.22, [−0.14, 0.58]) to sizeable improvements in rigour of methodology (0.99, [0.62, 1.35]) and analysis (0.97, [0.60, 1.34]) and overall paper quality (0.66, [0.30, 1.02]). RRs could improve research quality while reducing publication bias and ultimately improve the credibility of the published literature.

Publication: Nature Human Behaviour (Peer-Reviewed Journal)

Pub Date: 24 June 2021 Doi:

Keywords: Psychology, Publishing (Plenty more sections, figures and references in this paid article)

Leave a Reply

This site uses Akismet to reduce spam. Learn how your comment data is processed.