Skip to main content
Search
Search
    Quick Search anywhere
    Quick search in Citations
Advanced Search
Skip main navigationClose Drawer MenuOpen Drawer Menu
Previous article
Next article
Positionspapier

Das Experten-Novizen-Paradigma und die Vertrauenskrise in der Psychologie

Published Online:May 18, 2017https://doi.org/10.1026/1612-5010/a000174

Abstract

Zusammenfassung. Das Ziel des vorliegenden Beitrages ist es anhand eines vielverwendeten Paradigmas in der Sportwissenschaft – dem Experten-Novizen-Vergleich – zu prüfen, ob die momentane Vertrauenskrise in der Psychologie ebenfalls die Sportpsychologie betreffen könnte. Anhand einer exemplarischen Studie zeigen wir, dass es innerhalb dieses Paradigmas zu kontroversen Befunden kommt, welche durch die vermuteten Ursachen der Vertrauenskrise (Researcher Degrees of Freedom, kleine Stichprobengrößen) erklärt sein könnten. Zusätzlich argumentieren wir, dass weitere Faktoren (Konfundierung, Stichprobengrößen, Rosenthal Effekt, Expertise-Definition) innerhalb dieses Paradigmas die Reproduzierbarkeit von Erkenntnissen in Frage stellen. Wir diskutieren mögliche Maßnahmen, wie die dargestellten Probleme des Experten-Novizen-Paradigmas in zukünftigen Forschungsarbeiten gelöst werden können.


The Expert-Novice Paradigm and the Crisis of Confidence in Psychology

Abstract. The goal of the present paper is to evaluate whether the crisis of confidence in psychology might also affect the field of sport psychology by focusing on the widely used expert-novice paradigm. Based on a showcase study we argue that this paradigm has led to controversial findings that might be explained by some of the assumed causes of the crisis of confidence within psychology (researcher degrees of freedom and small sample sizes). Subsequently we argue that the expert-novice paradigm poses additional challenges in terms of producing reproducible findings (confounding variables, sample sizes, Rosenthal effect, and expertise definition). Potential remedies are discussed on how to improve future studies using this paradigm.

Literatur

  • Abernethy, B., Thomas, K. T. & Thomas, J. T. (1993). Strategies for improving understanding of motor expertise (or mistakes we have made and things we have learned!!). In J. L. Starkes & F. Allard (Eds.), Cognitive issues in motor expertise (pp. 317–356). Amsterdam: North-Holland. First citation in articleCrossref, Google Scholar

  • Baker, J. & Young, B. (2013). 20 years later: Deliberate practice and the development of expertise in sport. International Review of Sport and Exercise Psychology, 7, 135–157. First citation in articleCrossref, Google Scholar

  • Bakker, M., van Dijk, A. & Wicherts, J. M. (2012). The rules of the game called psychological science. Perspectives on Psychological Science, 7, 543–554. First citation in articleCrossref, Google Scholar

  • Berri, D. J. & Simmons, R. (2011). Catching a draft: On the process of selecting quarterbacks in the National Football League amateur draft. Journal of Productivity Analysis, 35, 37–49. First citation in articleCrossref, Google Scholar

  • Cañal-Bruland, R., Hagemann, N. & Straub, B. (2006). Perzeptuelle Expertise im Sport. Sportwissenschaft, 36, 321–334. First citation in articleGoogle Scholar

  • Chaddock, L., Neider, M. B., Voss, M. W., Gaspar, J. G. & Kramer, A. F. (2011). Do athletes excel at everyday tasks?Medicine & Science in Sports & Exercise, 43, 1920–1926. First citation in articleCrossref, Google Scholar

  • Delis, D. C., Kaplan, E. & Kramer, J. (2001). Delis Kaplan executive function system. San Antonio, TX: Psychological Corporation. First citation in articleGoogle Scholar

  • Deakin, J. M. & Cobley, S. (2003). A search for deliberate practice: An examination of the practice environments in figure skating and volleyball. In J. L. Starkes & K. A. Ericsson (Eds.), Expert performance in sports (pp. 115–135). Champaign, IL: Human Kinetics. First citation in articleGoogle Scholar

  • Duval, S. (2005). The trim and fill method. In H. R. Rothstein, A. J. Sutton & M. Borenstein (Eds.), Publication bias in meta-analysis: Prevention, assessment and adjustments (pp. 127–144). Chichester, UK: John Wiley & Sons. First citation in articleGoogle Scholar

  • Elk, M. van, Matzke, D., Gronau, Q. F., Guan, M., Vandekerckhove, J. & Wagenmakers, E.-J. (2015). Meta-analyses are no substitute for registered replications: A skeptical perspective on religious priming. Frontiers in Psychology, 6, 1365. doi:10.3389/fpsyg.2015.01365 First citation in articleGoogle Scholar

  • Ericsson, K. A. (1996). The acquisition of expert performance: An introduction to some of the issues. In K. A. Ericsson (Ed.), The Road to Excellence: The Acquisition of Expert Performance in the Arts and Sciences, Sports and Games (pp. 1–50): Mahwah, NJ: Erlbaum. First citation in articleGoogle Scholar

  • Ericsson, K. A., Charness, N., Feltovich, P. & Hoffman, R. R. (2006)Cambridge handbook of expertise and expert performance. Cambridge, UK: Cambridge University Press. First citation in articleCrossref, Google Scholar

  • Ericsson, K. A. & Kintsch, W. (1995). Long-term working memory. Psychological Review, 102, 211–245. First citation in articleCrossref, Google Scholar

  • Ericsson, K. A., Krampe, R. T. & Tesch-Römer, C. (1993). The role of deliberate practice in the acquisition of expert performance. Psychological Review, 100, 363–406. First citation in articleCrossref, Google Scholar

  • Fiedler, K., Kutzner, F. & Krüger, J. I. (2012). The long way from α-error control to validity proper: Problems with a short-sighted false-positive debate. Perspectives on Psychological Science, 7, 661–669. First citation in articleCrossref, Google Scholar

  • Fraley, R. C. & Vazire, S. (2014). The N-Pact factor: Evaluating the quality of empirical journals with respect to sample size and statistical power. PLoS One, 9(10), e109019. doi: 10.1371/journal.pone.0109019 First citation in articleCrossref, Google Scholar

  • Furley, P. (2012). Working memory and the control of attention in sport: From general mechanisms to individual differences. Doctoral dissertation thesis. Deutsche Sporthochschule Köln. First citation in articleGoogle Scholar

  • Furley, P. & Memmert, D. (2010). Differences in spatial working memory as a function of team sports expertise: The Corsi Block-tapping Task in sport psychological assessment. Perceptual & Motor Skills, 110, 801–808. First citation in articleCrossref, Google Scholar

  • Furley, P. & Memmert, D. (2011). Studying cognitive adaptations in the field of sport: Broad or narrow transfer? A comment on Allen, Fioratou, and McGeorge (2011). Perceptual & Motor Skills, 113, 2, 481–488. First citation in articleCrossref, Google Scholar

  • Furley, P. & Memmert, D. (2012). Working memory capacity as controlled attention in tactical decision making. Journal of Sport & Exercise Psychology, 34, 322–344. First citation in articleCrossref, Google Scholar

  • Furley, P. & Memmert, D. (2015). Creativity and working memory capacity in sports: Working memory capacity is not a limiting factor in creative decision making amongst skilled performers. Frontiers in Psychology, 6 . 115. doi:10.3389/fpsyg.2015.00115 First citation in articleCrossref, Google Scholar

  • Furley, P. & Wood, G. (2016). Working memory, attentional control, and expertise in sports: A review of current literature and directions for future research. Journal of Applied Research in Memory and Cognition, 5, 415–425. First citation in articleCrossref, Google Scholar

  • Geukes, K., Schönbrodt, F. D., Utesch, T., Geukes, S. & Back, M. D. (2016). Wege aus der Vertrauenskrise. Individuelle Schritte hin zu verlässlicher und offener Forschung. Zeitschrift für Sportpsychologie, 23, 99–109. First citation in articleLink, Google Scholar

  • Hagemann, N., Tietjens, M. & Strauß, B. (Hrsg.). (2007). Psychologie der sportlichen Höchstleistung. Grundlagen und Anwendungen der Expertiseforschung im Sport. Göttingen: Hogrefe. First citation in articleGoogle Scholar

  • Heppe, H., Kohler, A., Fleddermann, M. T. & Zentgraf, K. (2016). The relationship between expertise in sports, visuospatial and basic cognitive skills. Frontiers in Psychology, 7, 904. doi: 10.3389/fpsyg.2016.00904 First citation in articleCrossref, Google Scholar

  • Hertzog, C., Kramer, A. F., Wilson, R. S. & Lindenberger, U. (2008). Enrichment effects on adult cognitive development. Psychological Science in the Public Interest, 9, 1–65. First citation in articleCrossref, Google Scholar

  • Hillman, C. H., Erickson, K. I. & Kramer, A. F. (2008). Be smart, exercise your heart: Exercise effects on brain and cognition. Nature Reviews Neuroscience, 9, 58–65. First citation in articleCrossref, Google Scholar

  • Horn, T. S., Lox, C. & Labrador, F. (1998). The self-fulfilling prophecy theory: When coaches’ expectations become reality. In J. M. Williams (Ed.), Applied sport psychology: Personal growth to peak performance, 74–91. Mountain View, CA: Mayfield Publishing Co. First citation in articleGoogle Scholar

  • Huber, O. (1987). Das psychologische Experiment: Eine Einführung. Bern: Huber. First citation in articleGoogle Scholar

  • Jansen, P., Lehmann, J. & van Doren, J. (2012). Mental rotation performance in male soccer players. PLoS ONE 7:e48620. doi: 10.1371/journal.pone.0048620 First citation in articleCrossref, Google Scholar

  • Jussim, L. (2015). Précis of social perception and social reality: Why accuracy dominates bias and self-fulfilling prophecy. Behavioral and Brain Sciences. Advance online publication. doi:10.1017/S0140525X1500062X First citation in articleGoogle Scholar

  • Kane, M. J., Hambrick, D. Z., Tuholski, S. W., Wilhelm, O., Payne, T. W. & Engle, R. W. (2004). The generality of working memory capacity: A latent variable approach to verbal and visuospatial memory span and reasoning. Journal of Experimental Psychology: General, 133, 189–217. First citation in articleCrossref, Google Scholar

  • Kramer, A. F., Hahn, S., Cohen, N. J., Banich, M. T., McAuley, E., Harrison, C. R.et al. (1999). Ageing, fitness and neurocognitive function. Nature, 400, 418–419. First citation in articleCrossref, Google Scholar

  • Lyons, B., Hoffman, B. & Michel, J. (2009). Not much more than g? An examination of the impact of intelligence on NFL performance. Human Performance, 22, 225–245. First citation in articleCrossref, Google Scholar

  • Mann, D. T. Y., Williams, A. M., Ward, P. & Janelle, C. M. (2007). Perceptual-cognitive expertise in sport: A meta-analysis. Journal of Sport & Exercise Psychology, 29, 457–478. First citation in articleCrossref, Google Scholar

  • Macnamara, B., Hambrick, D. Z. & Oswald, F. L. (2014). Deliberate practice and performance in music, games, sports, education, and professions: A meta-analysis. Psychological Science, 25, 1608–1618. First citation in articleCrossref, Google Scholar

  • Macnamara, B. N., Moreau, D. & Hambrick, D. Z. (2016). The relationship between deliberate practice and performance in sports: A meta-analysis. Perspectives on Psychological Science, 11, 333–350. First citation in articleCrossref, Google Scholar

  • Memmert, D., Simons, D. & Grimme, T. (2009). The relationship between attention and expertise in sports. Psychology of Sport & Exercise, 10, 146–151. First citation in articleCrossref, Google Scholar

  • Moreau, D. (2012). The role of motor processes in three-dimensional mental rotation: Shaping cognitive processing via sensorimotor experience. Learning & Individual Differences, 22, 354–359. doi: 10.1016/j.lindif.2012.02.003 First citation in articleCrossref, Google Scholar

  • Neuroskeptic (2012). The nine circles of scientific hell. Perspectives on Psychological Science, 7, 643–644. First citation in articleCrossref, Google Scholar

  • Nosek, B. A. & Lakens, D. (Eds.) (2014). Replications of important results in social psychology [Special issue]. Social Psychology, 45. doi:10.1027/1864-9335/a000192 First citation in articleGoogle Scholar

  • Open Science Collaboration. (2012). An open, large-scale, collaborative effort to estimate the reproducibility of psychological science. Perspectives on Psychological Science, 7, 657–660. doi: 10.1177/1745691612462588 First citation in articleCrossref, Google Scholar

  • Open Science Collaboration. (2015). Estimating the reproducibility of psychological science. Science, 349, aac4716. doi: 10.1126/science.aac4716 First citation in articleCrossref, Google Scholar

  • Open Science Collaboration. (2017). Maximizing the reproducibility of your research. In S. O. Lilienfeld & I. D. Waldman (Eds.), Psychological Science Under Scrutiny: Recent Challenges and Proposed Solutions (pp. 3–21). New York, NY: Wiley. First citation in articleGoogle Scholar

  • Pashler, H. & Wagenmakers, E.-J. (Eds.). (2012). Special section on replicability in psychological science: A crisis of confidence? [Special section]. Perspectives on Psychological Science, 7, 528–654. doi: 10.1177/1745691612465253 First citation in articleCrossref, Google Scholar

  • Plessner, H., Canal-Bruland, R., Ehrlenspiel, F., Jansen, P., Schüler, J. & Zentgraf, K. (2016). Editorial: Die „Vertrauenskrise“ der empirischen Sozialwissenschaften und deren Bedeutung für die Sportpsychologie. Zeitschrift für Sportpsychologie, 23, 75–76. First citation in articleLink, Google Scholar

  • Popper, K. R. (1959). The Logic of scientific discovery. London: Hutchinson. First citation in articleGoogle Scholar

  • Posner, M. I. (1988). Introduction: What is it to be an expert? In M. T. H. Chi, R. Glaser & M. J. Farr (Eds.), The nature of expertise (pp. xxix–xxxvi). Cambridge: Cambridge University Press. First citation in articleGoogle Scholar

  • Raab, M. & Harwood, C. (2015). The development of expertise and excellence in sport psychology. [Themenheft] Psychology of Sport and Exercise, 16. First citation in articleCrossref, Google Scholar

  • Richard, F. D., Bond, C. F., Jr. & Stokes-Zoota, J. J. (2003). One hundred years of social psychology quantitatively described. Review of General Psychology, 7, 331–363. First citation in articleCrossref, Google Scholar

  • Riniolo, T. C. (1997). Publication bias: A computer-assisted demonstration of excluding nonsignificant results from research interpretation. Teaching of Psychology, 24, 279–282. First citation in articleCrossref, Google Scholar

  • Rosenthal, R. (1979). The “File Drawer Problem” and tolerance for null results. Psychological Bulletin, 86, 638–641. First citation in articleCrossref, Google Scholar

  • Rosenthal, R. & Fode, K. (1963). The effect of experimenter bias on the performance of the albino rat. Behavioral Science, 8, 183–189. First citation in articleCrossref, Google Scholar

  • Rosenthal, R. & Jacobson, L. (1966). Teachers’ expectancies: Determinants of pupils’ IQ gains. Psychological Reports, 19, 115–118. First citation in articleCrossref, Google Scholar

  • Rosenthal, R. (1994). Critiquing Pygmalion: A 25-year perspective. Current Directions in Psychological Science, 4, 171–172. First citation in articleCrossref, Google Scholar

  • Rosenthal, R. (2002). Covert communication in classrooms, clinics, courtrooms, and cubicles. American Psychologist, 57, 839–849. First citation in articleCrossref, Google Scholar

  • Schul, K. E. (2015). Unterschiedliche Dimensionen allgemeiner und spezieller kognitiver Fähigkeiten im Basketball. Doctoral dissertation thesis. Deutsche Sporthochschule Köln. First citation in articleGoogle Scholar

  • Schweizer, G. & Furley, P. (2016a). Reproducible research in sport and exercise psychology: The role of sample sizes. Psychology of Sport and Exercise, 23, 114–122. First citation in articleCrossref, Google Scholar

  • Schweizer, G. & Furley, P. (2016b). Die Vertrauenskrise empirischer Forschung in der Psychologie. Ausgewählte Ursachen und exemplarische Lösungsvorschläge für die sportpsychologische Forschung. Zeitschrift für Sportpsychologie, 23, 77–83. First citation in articleLink, Google Scholar

  • Simmons, J. P., Nelson, L. D. & Simonsohn, U. (2011). False-Positive Psychology: Undisclosed flexibility in data collection and analysis allows presenting anything as significant. Psychological Science, 22, 1359–1366. First citation in articleCrossref, Google Scholar

  • Spellman, B. A. (Ed.). (2012). Special section on research practices [Special section]. Perspectives on Psychological Science, 7, 655–689. First citation in articleCrossref, Google Scholar

  • Starkes, J. & Ericsson, K. A. (Eds.). (2003)Expert performance in sport: Recent advances in research on sport expertise. Champaign, IL: Human Kinetics. First citation in articleCrossref, Google Scholar

  • Steggemann, Y., Engbert, K. & Weigelt, M. (2011). Selective effects of motor expertise in mental body rotation tasks: Comparing object-based and perspective transformations. Brain & Cognition, 76, 97–105. First citation in articleCrossref, Google Scholar

  • Stroebe, W. & Strack, F. (2014). The alleged crisis and the illusion of exact replication. Perspectives on Psychological Science, 9, 59–71. First citation in articleCrossref, Google Scholar

  • Swann, C., Moran, A. & Piggott, D. (2015). Defining elite athletes: Issues in the study of expert performance in sport psychology. Psychology of Sport & Exercise, 16, 3–14. First citation in articleCrossref, Google Scholar

  • Unsworth, N., Heitz, R. P., Schock, J. C. & Engle, R. W. (2005). An automated version of the Operation Span task. Behavior Research Methods, 37, 498–505. First citation in articleCrossref, Google Scholar

  • Verburgh, L., Scherder, E. J., van Lange, P. A. & Oosterlaan, J. (2014). Executive functioning in highly talented soccer players. PloS one, 9(3), e91254. doi: 10.1371/journal.pone.0091254 First citation in articleCrossref, Google Scholar

  • Vestberg, T., Gustafson, R., Maurex, L., Ingvar, M. & Petrovic, P. (2012). Executive functions predict the success of top-soccer players. PLoS ONE, 7(4). doi: 10.1371/journal.pone.0034731 First citation in articleCrossref, Google Scholar

  • Voss, M. W., Kramer, A. F., Basak, C., Prakash, R. S. & Roberts, B. (2010). Are expert athletes ‘expert’ in the cognitive laboratory? A meta-analytic review of cognition and sport expertise. Applied Cognitive Psychology, 24, 812–826. First citation in articleCrossref, Google Scholar

  • Wagenmakers, E.-J., Wetzels, R., Borsboom, D. & van der Maas, H. L. J. (2011). Why psychologists must change the way they analyze their data: The case of psi: Comment on Bem (2011). Journal of Personality and Social Psychology, 100, 426–432. First citation in articleCrossref, Google Scholar

  • Ward, P., Hodges, N. J., Williams, A. M. & Starkes, J. (2004). Deliberate practice and expert performance. In A. M. Williams & N. J. Hodges (Eds.), Skill acquisition in sport (pp. 231–258). London: Routledge. First citation in articleGoogle Scholar

  • Williams, A. M. & Ericsson, K. A. (2005). Some considerations when applying the expert performance approach in sport. Human Movement Science, 24, 283–307. First citation in articleCrossref, Google Scholar

  • Williams, A. M. & Ford, P. R. (2008). Expertise and expert performance in sport. International Review of Sport and Exercise Psychology, 1, 4–18. First citation in articleCrossref, Google Scholar

  • Williams, A. M. & Hodges, N. J. (Eds.) (2004)Skill acquisition in sport: research, theory and practice. London, UK: Routledge. First citation in articleCrossref, Google Scholar