Skip to main content
Open AccessEditorial

Registered Reports

A Method to Increase the Credibility of Published Results

Published Online:https://doi.org/10.1027/1864-9335/a000192
Free first page

References

  • Bastardi, A. , Uhlmann, E. L. , Ross, L. (2011). Wishful thinking, belief, desire, and the motivated evaluation of scientific evidence. Psychological Science, 22, 731–732. First citation in articleCrossrefGoogle Scholar

  • Blanken, I. , Van de Ven, N. , Zeelenberg, M. , Meijers, M. H. C. (2014). Three attempts to replicate the moral licensing effect. Social Psychology, 45, 232–238. doi: 10.1027/1864-9335/a000189 First citation in articleLinkGoogle Scholar

  • Brandt, M. J. , IJzerman, H. , Blanken, I. (2014). Does recalling moral behavior change the perception of brightness? A replication and meta-analysis of Banerjee, Chatterjee, and Sinha (2012). Social Psychology, 45, 246–252. doi: 10.1027/1864-9335/a000191 First citation in articleLinkGoogle Scholar

  • Button, K. S. , Ioannidis, J. P. A. , Mokrysz, C. , Nosek, B. A. , Flint, J. , Robinson, E. S. J. , Munafo, M. R. (2013). Power failure: Why small sample size undermines the reliability of neuroscience. Nature Reviews Neuroscience, 14, 1–12. doi: 10.1038/nrn3475 First citation in articleCrossrefGoogle Scholar

  • Calin-Jageman, R. J. , Caldwell, T. L. (2014). Replication of the superstition, performance study by Damisch, Stoberock, Mussweiler (2010). Social Psychology, 45, 234–245. doi: 10.1027/1864-9335/a000190 First citation in articleLinkGoogle Scholar

  • Chambers, C. D. (2013). Registered reports: A new publishing initiative at Cortex. Cortex, 49, 609–610. First citation in articleCrossrefGoogle Scholar

  • Eich, E. (2013). Business not as usual. Psychological Science, 25, 3–6. doi: 10.1177/0956797613512465 First citation in articleCrossrefGoogle Scholar

  • Fanelli, D. (2010). “Positive” results increase down the hierarchy of the sciences. PLoS One, 5, e10068. First citation in articleCrossrefGoogle Scholar

  • Gibson, C. E. , Losee, J. , Foxwell, C. (2014). A replication of stereotype susceptibility (Shih, Pittinsky, & Ambady, 1999): Identity salience and shifts in quantitative performance. Social Psychology, 45, 194–198. doi: 10.1027/1864-9335/a000184 First citation in articleLinkGoogle Scholar

  • Gibson, C. E. , Losee, J. , Vitiello, C. (2014). A replication attempt of stereotype susceptibility: Identity salience and shifts in quantitative performance. Social Psychology, 45, 1XX–1XX. doi: 10.1027/1864-9335/a000184 First citation in articleLinkGoogle Scholar

  • Giner-Sorolla, R. (2012). Science or art? How aesthetic standards grease the way through the publication bottleneck but undermine science. Perspectives on Psychological Science, 7, 562–571. First citation in articleCrossrefGoogle Scholar

  • Greenwald, A. G. (1975). Consequences of prejudice against the null hypothesis. Psychological Bulletin, 82, 1–20. doi: 10.1037/h0076157 First citation in articleGoogle Scholar

  • Greenwald, A. G. (2009). What (and where) is the ethical code concerning researcher conflict of interest? Perspectives on Psychological Science, 4, 32–35. First citation in articleCrossrefGoogle Scholar

  • IJzerman, H. , Blanken, I. , Brandt, M. J. , Oerlemans, J. M. , Van den Hoogenhof, M. M. W. , Franken, S. J. M. , Oerlemans, M. W. G. (2014). Sex differences in distress from infidelity in early adulthood and in later life: A replication and meta-analysis of Shackelford et al. (2004). Social Psychology, 45, 202–208. doi: 10.1027/1864-9335/a000185 First citation in articleLinkGoogle Scholar

  • Johnson, D. J. , Cheung, F. , Donnellan, M. B. (2014). Does cleanliness influence moral judgments? A direct replication of Schnall, Benton, and Harvey (2008). Social Psychology, 45, 209–215. doi: 10.1027/1864-9335/a000186 First citation in articleLinkGoogle Scholar

  • Kerr, N. L. (1998). HARKing: Hypothesizing after the results are known. Personality and Social Psychology Review, 2, 196–217. First citation in articleCrossrefGoogle Scholar

  • Klein, R. A. , Ratliff, K. , Vianello, M. , Adams, A. B. Jr. , Bahník, S. , Bernstein, N. B. , … Nosek, B. A. (2014). Investigating variation in replicability: A “Many Labs” Replication Project. Social Psychology, 45, 142–152. doi: 10.1027/1864-9335/a000178 First citation in articleLinkGoogle Scholar

  • Koole, S. L. , Lakens, D. (2012). Rewarding replications: A sure and simple way to improve psychological science. Perspectives on Psychological Science, 7, 608–614. doi: 10.1177/1745691612462586 First citation in articleCrossrefGoogle Scholar

  • Lakens, D. , & Evers, E. (in press). Sailing from the seas of chaos into the corridor of stability: Practical recommendations to increase the informational value of studies. Perspectives on Psychological Science. First citation in articleGoogle Scholar

  • LeBel, E. , Borsboom, D. , Giner-Sorolla, R. , Hasselman, F. , Peters, K. , Ratliff, K. , & Smith, C. (2013). Psychdisclosure.Org: Grassroots support for reforming reporting standards in psychology. Perspectives on Psychological Science, 8, 424–432. First citation in articleCrossrefGoogle Scholar

  • LeBel, E. P. , Peters, K. R. (2011). Fearing the future of empirical psychology: Bem’s (2011) evidence of psi as a case study of deficiencies in modal research practice. Review of General Psychology, 15, 371–379. doi: 10.1037/a0025172 First citation in articleCrossrefGoogle Scholar

  • Lynott, D. , Corker, K. S. , Wortman, J. , Connell, L. , Donnellan, M. J. , Lucas, R. E. , O’Brien, K. (2014). Replication of “Experiencing physical warmth promotes interpersonal warmth” by Williams and Bargh (2008). Social Psychology, 45, 216–222. doi: 10.1027/1864-9335/a000187 First citation in articleLinkGoogle Scholar

  • Makel, M. , Plucker, J. , Hegarty, B. (2012). Replications in psychology research: How often do they really occur? Perspectives in Psychological Science, 7, 537–542. doi: 10.1177/1745691612460688 First citation in articleCrossrefGoogle Scholar

  • Miguel, E. , Camerer, C. , Casey, K. , Cohen, J. , Esterling, K. M. , Gerber, A. , … Van der Laan, M. (2014). Promoting transparency in social science research. Science, 343, 30–31. doi: 10.1126/science.1245317 First citation in articleCrossrefGoogle Scholar

  • Moon, A. , & Roeder, S. S. (2014). A secondary replication attempt of stereotype susceptibility (Shih, Pittinsky, & Ambady, 1999). Social Psychology, 45, 199–201. doi: 10.1027/1864-9335/a000193 First citation in articleLinkGoogle Scholar

  • Müller, F. , Rothermund, K. (2014). Replication of stereotype activation (Banaji & Hardin, 1996; Blair & Banaji, 1996). Social Psychology, 45, 187–193. doi: 10.1027/1864-9335/a000183 First citation in articleLinkGoogle Scholar

  • Nauts, S. , Langner, O. , Huijsmans, I. , Vonk, R. , Wigboldus, D. H. J. (2014). Forming impressions of personality: A replication and review of Asch’s (1946) evidence for a primacy-of-warmth effect in impression formation. Social Psychology, 45, 153–163. doi: 10.1027/1864-9335/a000179 First citation in articleLinkGoogle Scholar

  • Neuliep, J. W. , Crandall, R. (1990). Editorial bias against replication research. Journal of Social Behavior and Personality, 5, 85–90. First citation in articleGoogle Scholar

  • Neuliep, J. W. , Crandall, R. (1993). Reviewer bias against replication research. Journal of Social Behavior and Personality, 8, 21–29. First citation in articleGoogle Scholar

  • Nosek, B. A. , Lakens, D. (2013). Call for proposals: Special issue of social psychology on “Replications of important results in social psychology”. Social Psychology, 44, 59–60. doi: 10.1027/1864-9335/a000143 First citation in articleLinkGoogle Scholar

  • Nosek, B. A. , Spies, J. R. , Motyl, M. (2012). Scientific utopia: II Restructuring incentives and practices to promote truth over publishability. Perspectives in Psychological Science, 7, 615–631. First citation in articleCrossrefGoogle Scholar

  • Open Science Collaboration . (2012). An open, large-scale, collaborative effort to estimate the reproducibility of psychological science. Perspectives on Psychological Science, 7, 657–660. doi: 10.1177/1745691612462588 First citation in articleCrossrefGoogle Scholar

  • Open Science Collaboration . (2013). The reproducibility project: A model of large-scale collaboration for empirical research on reproducibility. In V. Stodden, F. Leisch, R. Peng, (Eds.), Implementing reproducible computational research (a volume in the r series). New York, NY: Taylor & Francis. First citation in articleGoogle Scholar

  • Schmidt, S. (2009). Shall we really do it again? The powerful concept of replication is neglected in the social sciences. Review of General Psychology, 13, 90–100. doi: 10.1037/a0015108 First citation in articleCrossrefGoogle Scholar

  • Schönbrodt, F. D. , Perugini, M. (2013). At what sample size do correlations stabilize? Journal of Research in Personality, 47, 609–612. doi: 10.1016/j.jrp.2013.05.009 First citation in articleCrossrefGoogle Scholar

  • Simmons, J. P. , Nelson, L. D. , Simonsohn, U. (2011). False positive psychology: Undisclosed flexibility in data collection and analysis allows presenting anything as significant. Psychological Science, 22, 1359–1366. First citation in articleCrossrefGoogle Scholar

  • Simmons, J. P. , Nelson, L. D. , Simonsohn, U. A 21 word solution 2012. Retrieved from ssrn.com/abstract=2160588 First citation in articleGoogle Scholar

  • Simons, D. , Holcombe, A. Registered replication reports 2013. Retrieved from www.psychologicalscience.org/index.php/replication First citation in articleGoogle Scholar

  • Sinclair, H. C. , Hood, K. , Wright, B. (2014). Revisiting Romeo and Juliet (Driscoll, Davis, & Lipetz, 1972): Reexamining the links between social network opinions and romantic relationship outcomes. Social Psychology, 45, 170–178. doi: 10.1027/1864-9335/a000181 First citation in articleLinkGoogle Scholar

  • Sterling, T. D. (1959). Publication decisions and their possible effects on inferences drawn from tests of significance – Or vice versa. Journal of the American Statistical Association, 54, 30–34. First citation in articleGoogle Scholar

  • Vermeulen, I. , Batenburg, A. , Beukeboom, C. , Smits, T. (2014). Breakthrough or one-hit wonder? Replicating effects of single-exposure musical conditioning on choice behavior (Gorn, 1982). Social Psychology, 45, 179–186. doi: 10.1027/1864-9335/a000182 First citation in articleLinkGoogle Scholar

  • Wagenmakers, E. J. , Wetzels, R. , Borsboom, D. , van der Maas, H. L. , Kievit, R. A. (2012). An agenda for purely confirmatory research. Perspectives on Psychological Science, 7, 632–638. First citation in articleCrossrefGoogle Scholar

  • Wesselmann, E. D. , Williams, K. D. , Pryor, J. B. , Eichler, F. A. , Gill, D. , Hogue, J. D. (2014). Revisiting Schachter’s research on rejection, deviance, and communication (1951). Social Psychology, 45, 164–169. doi: 10.1027/1864-9335/a000180 First citation in articleLinkGoogle Scholar

  • Wolfe, J. M. (2013). Registered reports and replications in attention, perception, & psychophysics. Attention, Perception, & Psychophysics, 75, 781–783. doi: 10.3758/s13414-013-0502-5 First citation in articleCrossrefGoogle Scholar

  • Žeželj, I. L. , Jokić, B. R. (2014). Replication of experiments evaluating impact of psychological distance on moral judgment (Eyal, Liberman & Trope, 2008; Gong & Medin, 2012). Social Psychology, 45, 223–231. doi: 10.1027/1864-9335/a000188 First citation in articleLinkGoogle Scholar