Preregistration


Preregistration is the practice of registering a scientific study before it is conducted. Preregistration of studies serves to prevent publication bias and reduce data dredging. It has gained prominence as a method to help address the replication crisis in scientific studies.

Process

The registered report format requires authors to submit a description of the study methods and analyses prior to data collection. Once the method and analysis plan is vetted through peer-review, publication of the findings is provisionally guaranteed, based on whether the authors follow the proposed protocol. One goal of registered reports is to circumvent the publication bias toward significant findings that can lead to an implementation of questionable research practices. A second goal is to encourage publication of studies with rigorous methods. Registered reports differ from preregistration: the latter involves creating a time-stamped non-modifiable public record of the study and analysis plan before the data is collected. However, unlike registered reports, the study and analysis plan is not subjected to peer review.

Journal support

The journal Psychological Science has encouraged the preregistration of studies and the reporting of effect sizes and confidence intervals. The editor-in-chief also noted that the editorial staff will be asking for replication of studies with surprising findings from examinations using small sample sizes before allowing the manuscripts to be published.
The journal Nature Human Behaviour has adopted the registered report format, as it “shift the emphasis from the results of research to the questions that guide the research and the methods used to answer them”.
The European Journal of Personality defines this format: “In a registered report, authors create a study proposal that includes theoretical and empirical background, research questions/hypotheses, and pilot data. Upon submission, this proposal will then be reviewed prior to data collection, and if accepted, the paper resulting from this peer-reviewed procedure will be published, regardless of the study outcomes.”
Moreover, only a very small proportion of academic journals in psychology and neurosciences explicitly stated that they welcome submissions of replication studies in their aim and scope or instructions to authors. This phenomenon does not encourage the reporting or even attempt on replication studies.
Overall, however, the number of participating journals seems to be increasing slowly as indicated by the Center for Open Science which maintains a list of journals encouraging the submission of registered reports.