We use cookies to improve your website experience. To learn about our use of cookies and how you can manage your cookie settings, please see our Cookie Policy. By closing this message, you are consenting to our use of cookies.

Registered Reports at Taylor & Francis

Have your study peer reviewed and get an in-principle acceptance before you start collecting your data

Background and benefits 

A Registered Report is a form of empirical article offered by the journal. The methods and proposed analyses are pre-registered and reviewed prior to research being conducted. High-quality protocols are then provisionally accepted for publication before data collection commences.

This format is designed to minimize publication bias and research bias in hypothesis-driven research, whilst allowing the flexibility to conduct exploratory (unregistered) analyses and report unplanned findings.

Registered Reports aim to reduce questionable research practices – some examples are below.

  • P-hacking – (e.g., Simmons et al., 2011), which is the practice of seeking out p-values convenient for researchers (e.g., adding new data to an analysis until the results support the researchers’ claim). 

  • Cherry Picking – Reporting only favorable results for researchers and ignoring or hiding unfavorable results. 

  • HARKing – (Hypothesizing After the Results are Known: Kerr, 1988), in which researchers construct their hypothesis after the results of experiments are known to ensure a good or challenging story. 

Explore journals offering Registered Reports

Publishing tips, direct to your inbox

Expert tips and guidance on getting published and maximizing the impact of your research. Register now for weekly insights direct to your inbox.

How Register Reports work

Registered Reports workflow
Registered Reports by Center for Open Science licensed under CC BY-ND.

The review process for Registered Reports is divided into two stages. At Stage 1, reviewers assess study proposals before data are collected. At Stage 2, reviewers consider the full study, including results and interpretation.  

Stage 1 manuscripts will include only an ‘introduction’, ‘methods’ (including proposed analyses), and ‘pilot data’ (where applicable). In considering papers at stage 1, reviewers will be asked to assess:  

  1. The importance of the research question(s).  

  2. The logic, rationale, and plausibility of the proposed hypotheses.  

  3. The soundness and feasibility of the methodology and analysis pipeline (including statistical power analysis where appropriate). 

  4. Whether the clarity and degree of methodological detail is sufficient to exactly replicate the proposed experimental procedures and analysis pipeline.

  5. Whether the authors have pre-specified sufficient outcome-neutral tests for ensuring that the results obtained are able to test the stated hypotheses, including positive controls and quality checks. 

    Following Stage 1 peer review, manuscripts will be accepted, offered the opportunity to revise, or rejected outright. Manuscripts that pass peer review will be issued an in principle acceptance (IPA), indicating that the article will be published pending successful completion of the study according to the pre-registered methods and analytic procedures, as well as a defensible and evidence-based interpretation of the results.  

    Following completion of the study, authors will complete the manuscript, including results and discussion sections. These stage 2 manuscripts will more closely resemble a regular article format. The manuscript will then be returned to the reviewers, who will be asked to appraise whether:

    1. The data are able to test the authors’ proposed hypotheses by satisfying the approved outcome-neutral conditions (such as quality checks, positive controls).  

    2. The ‘introduction’, rationale and stated hypotheses are the same as the approved stage 1 submission (required).  

    3. The authors adhered precisely to the registered experimental procedures.  

    4. Any unregistered post hoc analyses added by the authors are justified, methodologically sound, and informative.  

    5. The authors’ conclusions are justified given the data. 

    Reviewers at stage 2 may suggest that authors report additional post hoc tests on their data; however, authors are not obliged to do so unless such tests are necessary to satisfy one or more of the stage 2 review criteria.

    Please note that editorial decisions will not be based on the perceived importance, novelty, or conclusiveness of the results. 

    The review process

    In this section we explain the review process for Stage 1 and for Stage 2 in full. We also have some downloadable cover letters that you can make use of.

    Stage 1

    Where journals receive high levels of submissions annually, not all manuscripts will automatically proceed to peer review. Editors may only select reviewers for the most promising manuscripts.

    Stage 1 submissions should include the Stage 1 manuscript (details below) and a brief cover letter. Authors are welcome to submit pre-submission enquiries for advice on the likely suitability of a study as a Registered Report. However, please note that the editors will not agree to send manuscripts for in-depth review until a complete Stage 1 submission has been considered.

    Stage 1 submissions that are judged by the editors to be of sufficient quality and scientific importance will be sent for in-depth peer review. In considering papers at the registration stage, reviewers will be asked to assess:

    1. The importance of the research question(s).  

    2. The logic, rationale, and plausibility of the proposed hypotheses.  

    3. The soundness and feasibility of the methodology and analysis pipeline (including statistical power analysis where appropriate).  

    4. Whether the clarity and degree of methodological detail is sufficient to exactly replicate the proposed experimental procedures and analysis pipeline.  

    5. Whether the authors have pre-specified sufficient outcome-neutral tests for ensuring that the results obtained are able to test the stated hypotheses, including positive controls and quality checks.  

    Vector illustration showing a character pointing to a checklist with a speech bubble above their head.

    Following Stage 1 peer review, manuscripts will be rejected outright, offered the opportunity to revise, or accepted. In principle acceptance (IPA) indicates that the article will be published pending completion of the approved methods and analytic procedures, passing of all pre-specified quality checks, and a defensible interpretation of the results. Stage 1 protocols are not published following IPA. Instead, they are held in reserve by the journal and integrated into a single completed article following approval of the final Stage 2 manuscript.   

    Authors are reminded that any deviation from the stated experimental procedures, regardless of how minor it may seem to the authors, could lead to rejection of the manuscript at Stage 2.

    In cases where the pre-registered protocol is altered after IPA due to unforeseen circumstances (e.g. change of equipment or unanticipated technical error), the authors must consult the editors immediately for advice, and prior to the completion of data collection. Minor changes to the protocol may be permitted according to editorial discretion. In such cases, IPA would be preserved, and the deviation reported in the Stage 2 submission. If authors wish to alter the experimental procedures more substantially following IPA but still wish to publish their article as a Registered Report, the manuscript must be withdrawn and resubmitted as a new Stage 1 submission. Note that all registered analyses must be undertaken and reported in the Stage 2 manuscript, but additional unregistered analyses may also be included in a final manuscript (see Results & Discussion). 

    Stage 1 cover letter 

    • A brief scientific case for consideration. Authors are encouraged to refer to the likely replication value of the research. High-value replication studies are welcome in addition to novel studies.  

    • An anticipated timeline for completing the study if the initial submission is accepted.  

    Stage 1 Manuscript

    Introduction

    The introduction should be a review of the relevant literature that motivates the research question and a full description of the experimental aims and hypotheses. Please note that following IPA, the Introduction section cannot be altered except for correction of typographical errors (see below).  

      Methods

      • The method section is a full description of proposed sample characteristics, including criteria for data inclusion and exclusion (e.g. outlier extraction). Procedures for objectively defining exclusion criteria due to technical errors or for any other reasons must be specified, including details of how and under what conditions data would be replaced. 

      • A description of experimental procedures in sufficient detail to allow another researcher to repeat the methodology exactly, without requiring further information. These procedures must be adhered to exactly in the subsequent experiments or any Stage 2 manuscript can be rejected.  

      • Proposed analysis pipeline, including all pre-processing steps, and a precise description of all planned analyses, including appropriate correction for multiple comparisons. Any covariates or regressors must be stated. Where analysis decisions are contingent on the outcome of prior analyses, these contingencies must be specified and adhered to. Only pre-planned analyses can be reported in the main Results section of Stage 2 submissions. However, unplanned exploratory analyses will be admissible in a separate section of the Results (see below).  

      Vector illustration of two characters facing each other and holding a giant coral speech bubble.
      • Studies involving Neyman-Pearson inference must include a statistical power analysis. Estimated effect sizes should be justified with reference to the existing literature. Since publication bias overinflates published estimates of effect size, power analysis must be based on the lowest available or meaningful estimate of the effect size. For frequentist analysis plans, the a priori power must be 0.9 or higher for all proposed hypothesis tests. In the case of highly uncertain effect sizes, a variable sample size and interim data analysis is permissible but with inspection points stated in advance, appropriate Type I error correction for ‘peeking’ employed, and a final stopping rule for data collection outlined.  

      • Methods involving Bayesian hypothesis testing are encouraged. For studies involving analyses with Bayes factors, the predictions of the theory must be specified so that a Bayes factor can be calculated. Authors should indicate what distribution will be used to represent the predictions of the theory and how its parameters will be specified. For example, will you use a uniform up to some specified maximum, or a normal/half-normal to represent a likely effect size, or a JZS/Cauchy with a specified scaling constant?

      • For inference by Bayes factors, authors must be able to guarantee data collection until the Bayes factor is at least 6 times in favour of the experimental hypothesis over the null hypothesis (or vice versa). Authors with resource limitations are permitted to specify a maximum feasible sample size at which data collection must cease regardless of the Bayes factor; however, to be eligible for advance acceptance this number must be sufficiently large that inconclusive results at this sample size would nevertheless be an important message for the field. For further advice on Bayes factors or Bayesian sampling methods, prospective authors are encouraged to read this key article by Schönbrodt and Wagenmakers.  

      • Full descriptions must be provided of any outcome-neutral criteria that must be met for successful testing of the stated hypotheses. Such quality checks might include the absence of floor or ceiling effects in data distributions, positive controls, or other quality checks that are orthogonal to the experimental hypotheses.  

      • Timeline for completion of the study and proposed resubmission date if Stage 1 review is successful. Extensions to this deadline can be negotiated with the editors. Manuscripts will be generally considered only for studies that are able to commence immediately; however, authors with alternative plans are encouraged to contact the journal office for advice. 

      • Any description of prospective methods or analysis plans should be written in future tense.  

      Pilot Data (optional): 

      Can be included to establish proof of concept, effect size estimations, or feasibility of proposed methods. Any pilot experiments will be published with the final version of the manuscript and will be clearly distinguished from data obtained for the pre-registered experiment(s).  

        Secondary Registrations (optional):  

        The journal welcomes submissions proposing secondary analyses of existing data sets, provided authors can supply sufficient evidence (e.g. letter from independent gatekeeper) to confirm that they have had no prior access to the data in question.  

          Stage 2

          Once the study is complete, authors prepare and resubmit their manuscript for full review. The final manuscript should include the entirety of the Stage 1 submission, the raw data and laboratory logs, and the results and discussion. Apart from minor stylistic revisions, the Stage 1 submission cannot be altered.

          At Stage 2, any description of the rationale or proposed methodology that was written in future tense within the Stage 1 manuscript should be changed to past tense. Any textual changes to the ‘introduction’ or ‘methods’ (e.g. correction of typographic errors) must be clearly marked in the Stage 2 submission. Any relevant literature that appeared following the date of IPA should be covered in the ‘discussion’. 

          Reviewers are informed that editorial decisions will not be based on the perceived importance, novelty or conclusiveness of the results. Thus, while reviewers are free to enter such comments on the record, they will not influence editorial decisions. Reviewers at Stage 2 may suggest that authors report additional post hoc tests on their data; however, authors are not obliged to do so unless such tests are necessary to satisfy one or more of the Stage 2 review criteria. 

          Stage 2 Cover Letter

          Please note the policy of publishing negative results under the registered reports scheme does not imply that the journal publishes negative results for other manuscript types. 

          The resubmission will most likely be considered by the same reviewers as in Stage 1 but could also be assessed by new reviewers. In considering papers at Stage 2, reviewers will be asked to decide:  

          1. If the data are able to test the authors’ proposed hypotheses by satisfying the approved outcome-neutral conditions (such as quality checks, positive controls). 

          2. If the Introduction, rationale and stated hypotheses are the same as the approved Stage 1 submission (required). 

          3. If the authors adhered precisely to the registered experimental procedures. 

          4. If any unregistered post hoc analyses added by the authors are justified, methodologically sound, and informative. 

          5. If the authors’ conclusions are justified given the data. 

          Submission of raw data and laboratory log: Share Your Data 

          • Raw data and any digital experimental materials (e.g. stimuli etc.) must be made freely available in a public repository. Data files should be appropriately time stamped to show that data were collected after IPA and not before. Other than the preregistered data and any pilot data evaluated in the Stage 1 review, no data acquired prior to the date of IPA may be added in the Stage 2 submission.

          • Raw data must be accompanied by guidance notes, where required, to assist other scientists in replicating the analysis pipeline. Authors are also expected to upload any relevant analysis scripts and other experimental materials that would assist in replication (e.g. stimuli & presentation code).  

          • Any supplementary figures, tables, or other text (such as supplementary methods) can either be included as standard supplementary information that accompanies the paper, or they can be archived together with the data. Please note that the raw data itself should be archived (see above) rather than submitted to the journal as supplementary material.  

          • The authors must collectively certify in the resubmission Cover Letter that all non-pilot data was collected after the date of IPA. A basic laboratory log must also be provided outlining the range of dates during which data collection took place. This log should be uploaded to the same public archive as the data, with a link provided to the log in the resubmission Cover Letter.  

          • The manuscript must also contain the URL of the approved Stage 1 protocol on the Open Science Framework or other recognized repository. If the protocol was registered under a private embargo, then the embargo must be released, and the protocol made fully public at the point of Stage 2 submission.  

          Vector illustration of an open laptop with graphs on the screen, and a bar chart to the left of the laptop, two characters are standing around the laptop, one is holding a giant pink magnifying glass.

          Results & Discussion  

          Vector illustration of a large open laptop, with four puzzle pieces that are blue and pink on the screen, and three characters stood around the laptop pointing at the puzzle pieces.

          The outcome of all registered analyses must be reported in the manuscript, except in rare instances where a registered and approved analysis is subsequently shown to be logically flawed or unfounded. In such cases, the authors, reviewers, and editors must agree that a collective error of judgment was made, and that the analysis is inappropriate. In such cases the analysis would still be mentioned in the ‘methods’ but omitted with justification from the ‘results’.  

          It is reasonable that authors may wish to include additional analyses that were not included in the registered submission. For instance, a new analytic approach might become available between IPA and Stage 2 review, or a particularly interesting and unexpected finding may emerge. Such analyses are admissible but must be clearly justified in the text, appropriately caveated, and reported in a separate section of the Results titled “Exploratory analyses”. Authors should be careful not to base their conclusions entirely on the outcome of statistically significant post hoc analyses. Authors reporting null hypothesis significance tests are required to report exact p values and effect sizes for all inferential analyses. 

            Manuscript withdrawal and withdrawn registrations  

            It is possible that authors with IPA may wish to withdraw their manuscript following or during data collection. Possible reasons could include major technical error, an inability to complete the study due to other unforeseen circumstances, or the desire to submit the results to a different journal. In all such cases, manuscripts can of course be withdrawn at the authors’ discretion. However, the journal will publicly record each case in a section called Withdrawn Registrations.

            This section will include the authors, proposed title, the abstract from the approved Stage 1 submission, and brief reason(s) for the failure to complete the study. Partial withdrawals are not possible; i.e. authors cannot publish part of a registered study by selectively withdrawing one of the planned experiments. Such cases must lead to withdrawal of the entire paper. Studies that are not completed by the agreed Stage 2 submission deadline (6 months after receipt of the IPA – this can be extended in negotiation with the editors) will be considered withdrawn and will be subject to a Withdrawn Registration.  

            Vector illustration of a person sitting down typing on a laptop.

            Incremental Registrations  

            Vector illustration of an open laptop, with a rocket setting off and three characters around the laptop, two with laptops, one with a telescope. There is also two pink settings cogs on the left of the laptop, a pink flag on the right and a pink tick in the middle.

            Authors may add experiments to approved submissions. In such cases the approved Stage 2 manuscript will be accepted for publication, and authors can propose additional experiments for Stage 1 consideration. Where these experiments extend the approved submission (as opposed to being part of new submissions), the editors will seek to fast-track the review process. This option may be particularly appropriate where an initial experiment reveals a major serendipitous finding that warrants follow-up within the same paper.

            In cases where an incremented submission is rejected (at either Stage 1 or 2), authors will retain the option of publishing the most recently approved version of the manuscript. For further advice on specific scenarios for incremental registration, authors are invited to contact the editors. 

            Registered Reports on F1000Research

            F1000Research welcomes Registered Reports, but follows a slightly different model where both the Study Protocol and the consequent Research Article are published and peer-reviewed. Most journals typically only publish the Research Article, so the F1000Research approach to Registered Reports rewards authors with an additional citable publication, and goes further in supporting transparent, reproducible research.

            F1000R Registered Process

            Frequently Asked Questions

            Yes, there are repositories for hosting these, including at the Center for Open Science (COS) and Zotero.

            The majority of journals who offer this article type have it set up as an optional article type. However, all submissions to Comprehensive Results in Social Psychology need to be in this format.

            When the final version is published the article will look the same as any other research article in that journal.

            One of the benefits of Registered Reports is that they support negative results (when the results do not meet the hypothesis). So as long as you submitted your 1st stage manuscript and were accepted you can still proceed with the publication of your article.

            The journals will endeavor for the same reviewers to review both parts of the manuscript, but there may be situations where this is not possible.

            In cases where the pre-registered protocol is altered after IPA due to unforeseen circumstances (e.g. change of equipment or unanticipated technical error), the authors must consult the editorial board immediately for advice, and prior to the completion of data collection. Minor changes to the protocol may be permitted according to editorial discretion.

            It is possible that authors with an IPA may wish to withdraw their manuscript following or during data collection. Possible reasons could include major technical error, an inability to complete the study due to other unforeseen circumstances, or the desire to submit the results to a different journal. In all such cases, manuscripts can of course be withdrawn at the authors’ discretion. Some journals will publish a short note saying that the a previously accepted article has been withdrawn.

            Registered Reports and preregistration are not the same thing. While Registered Reports articles follow the workflow outlined above, preregistration of research is more often required for research in medical, health sciences or psychology research for projects involving human participants – such as clinical trials. The aim of preregistration is to increase transparency around which projects are underway and who is funding them. This can also avoid duplication of effort. Each subject area will have specific conventions for how to preregister research projects, established repositories include www.clinicaltrials.gov and PROSPERO.