Skip to main content
Free Accesseditorial

Experimental Psychology

Toward Reproducible Research

Published Online:https://doi.org/10.1027/1618-3169/a000257

As in the past years, Experimental Psychology continues to serve as a fast international outlet for excellent basic research from all areas of experimental psychology. The journal’s well-established reputation is reflected in a mean impact factor of 2.07 over the last five years, and by a h5-index of 23.1 In the last year, the average time from submission to editorial decision was 29 days, and the majority of decisions were made within our six-week deadline. The number of high-quality submissions remained high, necessitating a selective editorial process to identify the top submissions. About 60% of submissions were rejected, with another 25% rejected with the option to resubmit. The remaining submissions were accepted pending major (10%) or minor (5%) revisions. Submissions came from 28 different countries, and this internationality is well reflected in the team of Associate Editors and the Editorial Board (12 countries).

In July 2013, Thorsten Meiser has decided to step down as an Editor in Chief. I would like to express my gratitude to Thorsten and his team of assistants for their dedicated and most competent service to Experimental Psychology. Thorsten has served as an Associate Editor since 2006, before he took over the position of Editor-in-Chief from Edgar Erdfelder in 2011. Jan Rummel and Dennis Boywitt have assisted him during that time, and Dennis has helped smooth the transition to the new team by continuing to serve until the end of 2013. Thorsten’s achievements include assembling a dedicated international team of Associate Editors, streamlining the editorial workflow, strengthening the Theoretical Article format (e.g., Brysbaert et al., 2011; Voss, Nagler, & Lerche, 2013; Yechiam & Rakow, 2012), and increasing the turnaround speed to an excellent average of 4 weeks. The editorial team will continue to benefit from Thorsten’s expertise in the future, as he agreed to continue to serve the journal as a member of the Editorial Board.

Registered Reports

The journal continues to maintain its profile of methodological rigor and theoretical relevance. In past editorials, state-of-the-art statistical procedures and the comprehensive reporting of results (e.g., Erdfelder, 2010) have been established as essential criteria for publication in Experimental Psychology, as well as the important role of a theoretical foundation from which specific predictions can be derived to guide research (e.g., Meiser, 2011). To further strengthen its emphasis on theoretical relevance and methodological rigor, Experimental Psychology introduces a new publication format: The Registered Report (see also Chambers, 2013; Wolfe, 2013). This new format invites submissions of research proposals that aim at testing hypotheses using prespecified experimental methods and analyses. These proposals will be evaluated, and editorial decisions will be made, before the results of a proposed study are known (Greve, Bröder, & Erdfelder, 2013). A central advantage of this procedure is that it eliminates publication bias.

As stated in the guidelines for authors2 the Registered Report format realizes result-blind peer review and editorial decisions by evaluating research proposals (i.e., manuscripts that comprise the Introduction, Methods, and Data Analysis sections) before data collection. These proposals will be reviewed with emphasis on the theoretical value and methodological rigor of the work to be done. In case of an initial acceptance decision, authors proceed with data collection and analysis in accordance with the accepted protocol and complete the Results and Discussion sections. The final manuscript will be evaluated to verify that the work was completed according to the approved protocols and that the conclusions are supported by the results. Importantly, once initially approved, manuscripts are published regardless of the direction or statistical significance of the results.

The Registered Report article is an additional option for authors. It is especially well suited for confirmatory research (Wagenmakers, Wetzels, Borsboom, van der Maas, & Kievit, 2012) that aims at testing hypotheses or predictions derived from theory, as well as for attempts to replicate theoretically relevant findings. Registered Reports also allow for reporting theoretically innovative exploratory research, on which a hypothesis or prediction is based, along with a registered confirmatory study that aims at testing that hypothesis.

Established Article Types

The journal will continue to publish methodologically rigorous experimental research from all areas of psychology that contributes to theoretical development in basic psychological research. The main publication format for multiple-study research is the Research Article. In addition, Short Research Articles are available for research including one or two studies. Research Articles should be as concise as possible. If word limits do not allow for a comprehensive report of methods, analyses, and results, supplemental materials can be provided electronically to help disseminate the research and support replication of the reported studies.

The journal strongly encourages authors to publish raw data. To facilitate dissemination of their research, authors are asked to provide an electronic file containing the data necessary to reproduce the reported results, as well as any required additional information (e.g., codebook, scripts for data analysis).

In addition to the article types for empirical research, Theoretical Articles are published that make a substantial contribution to theoretical research questions, methodological issues, or issues of modeling or statistics, that are particularly relevant for experimental psychologists.

Occasional brief theoretical contributions will continue to be published in the form of Commentaries. The discussions of the Musical Stroop task in the current issue (Akiva-Kabiri & Henik, 2014; Gast, 2014; Grégoire, Perruchet, & Poulin-Charronnat, 2014; Moeller & Frings, 2014; Zakay, 2014) provide an excellent illustration of how commentaries can contribute to theoretical and methodological development.

Continuing on the path established by previous editorial teams, theoretical relevance and methodological rigor will remain to be the journal’s main criteria. The new Registered Report format aims at strengthening and extending this focus. In addition, by increasing the public availability of raw data as well as supplemental materials for all article types, the journal contributes to facilitating the dissemination of published research and to building cumulative science. I am grateful to be supported by an excellent team of Associate Editors who will continue to guarantee fast and competent editorial decisions for the increasing number of submissions from many areas of basic psychological research.

1The h5-index is the h-index for articles published in the last 5 complete years. It is the largest number h such that h articles published in 2008–2012 have at least h citations each. Retrieved from Google Scholar, November 15, 2013.

2www.hogrefe.com/periodicals/experimental-psychology/advice-for-authors/

References

  • Akiva-Kabiri, L. , Henik, A. (2014). Additional insights: Commentary on ‘‘The musical Stroop effect: Opening a new avenue to research on automatisms’’ by L. Grégoire, P. Perruchet, and B. Poulin-Charronnat (Experimental Psychology, 2013, Vol. 60, pp. 269–278). Experimental Psychology, 61, 75–77. doi: 10.1027/1618-3169/a000208 First citation in articleLinkGoogle Scholar

  • Brysbaert, M. , Buchmeier, M. , Conrad, M. , Jacobs, A. M. , Bölte, J. , Böhl, A. (2011). The word frequency effect: A review of recent developments and implications for the choice of frequency estimates in German. Experimental Psychology, 58, 412–424. First citation in articleLinkGoogle Scholar

  • Chambers, C. D. (2013). Registered Reports: A new publishing initiative at Cortex. Cortex, 49, 609–610. doi: 10.1016/j.cortex.2012.12.016 First citation in articleGoogle Scholar

  • Erdfelder, E. (2010). Experimental Psychology: A note on statistical analysis. Experimental Psychology, 57, 1–4. doi: 10.1027/1618-3169/a000001 First citation in articleLinkGoogle Scholar

  • Gast, A. (2014). What is learned, and when? Commentary on ‘‘The musical Stroop effect: Opening a new avenue to research on automatisms’’ by L. Grégoire, P. Perruchet, and B. Poulin-Charronnat (Experimental Psychology, 2013, Vol. 60, pp. 269–278). Experimental Psychology, 61, 71–74. doi: 10.1027/1618-3169/a000206 First citation in articleLinkGoogle Scholar

  • Grégoire, L. , Perruchet, P. , Poulin-Charronnat, B. (2014). Is the musical stroop effect able to keep its promises? A reply to Akiva-Kabiri and Henik (2014), Gast (2014), Moeller and Frings (2014), and Zakay (2014). Experimental Psycholgy, 61, 80–83. doi: 10.1027/1618-3169/a000222 First citation in articleLinkGoogle Scholar

  • Greve, W. , Bröder, A. , Erdfelder, E. (2013). Result-blind peer reviews and editorial decisions: A missing pillar of scientific culture. European Psychologist, 1, 1–9. doi: 10.1027/1016-9040/a000144 First citation in articleGoogle Scholar

  • Meiser, T. (2011). Experimental Psychology: A place for innovative research and methodological developments. Experimental Psychology, 58, 1–3. doi: 10.1027/1618-3169/a000105 First citation in articleLinkGoogle Scholar

  • Moeller, B. , Frings, C. (2014). How automatic is the musical Stroop effect? Commentary on “The musical Stroop effect: Opening a new avenue to research on automatisms’’ by L. Grégoire, P. Perruchet, and B. Poulin-Charronnat (Experimental Psychology, 2013, Vol. 60, pp. 269–278). Experimental Psychology, 61, 68–70. doi: 10.1027/1618-3169/a000204 First citation in articleLinkGoogle Scholar

  • Voss, A. , Nagler, M. , Lerche, V. (2013). Diffusion models in experimental psychology: A practical introduction. Experimental Psychology, 60, 385–402. doi: 10.1027/1618-3169/a000218 First citation in articleLinkGoogle Scholar

  • Wagenmakers, E.-J. , Wetzels, R. , Borsboom, D. , van der Maas, H. L. J. , Kievit, R. A. (2012). An agenda for purely confirmatory research. Perspectives on Psychological Science, 7, 632–638. doi: 10.1177/1745691612463078 First citation in articleCrossrefGoogle Scholar

  • Wolfe, J. M. (2013). Registered reports and replications in Attention, Perception, & Psychophysics. Attention, Perception, & Psychophysics, 75, 781–783. doi: 10.3758/s13414-013-0502-5 First citation in articleCrossrefGoogle Scholar

  • Yechiam, E. , Rakow, T. (2012). The effect of foregone outcomes on choices from experience: An individual modeling analysis. Experimental Psychology, 59, 55–67. First citation in articleLinkGoogle Scholar

  • Zakay, D. (2014). Can the ‘‘musical Stroop’’ task replace the classical Stroop task? Commentary on ‘‘The musical Stroop effect: Opening a new avenue to research on automatisms’’ by L. Grégoire, P. Perruchet, and B. Poulin-Charronnat (Experimental Psychology, 2013, Vol. 60, pp. 269–278). Experimental Psychology, 61, 78–79. doi: 10.1027/1618-3169/a000211 First citation in articleLinkGoogle Scholar