Skip to main content
Originalarbeit

Der Testungseffekt beim Lernen mit Texten

Ein Beispiel für das schwierige Verhältnis zwischen Grundlagenforschung und Anwendung

Published Online:https://doi.org/10.1026/0033-3042/a000518

Zusammenfassung. Da der Testungseffekt in der evidenzbasierten Lehr- / Lernforschung als einer der am besten gesicherten Befunde gilt (z. B. Dunlosky, Rawson, Marsh, Nathan & Willingham, 2013), ist er in besonderer Weise dazu geeignet, grundlegende Probleme bei der Nutzbarmachung von in der experimentellen Forschung gut gesicherten Befunden zu verdeutlichen. Im Zentrum dieses Beitrags stehen das Verhältnis zwischen Lernresultaten und metakognitiven Erwartungen, die Komplexität von Lernmaterialien als Moderator für den Testungseffekt sowie Unterschiede zwischen Feld- und Laborexperimenten.


Test-Enhanced Learning in Text-Based Learning. An Example of the Difficult Relationship Between Basic Research and Its Application in the Real World

Abstract. In studies that rank learning principles according to their effectivity, test-enhanced learning is one of the few principles for which strong evidence is reported (e. g., Dunlosky, Rawson, Marsh, Nathan & Willingham, 2013). The testing effect is thus suitable for exemplary discussions of fundamental problems that emerge when basic research is applied to the real world. The present paper focuses on the relationship between learning outcomes and metacognitive beliefs, on how the complexity of learning materials moderates the testing effect, and on differences between laboratory studies and field experiments.

Literatur

  • Abott, E. E. (1909). On the analysis of the factor of recall in the learning process. The Psychological Review: Monograph Supplements, 11 (1), 159 – 177. First citation in articleCrossrefGoogle Scholar

  • Adesope, O. O., Trevisan, D. A. & Sundararajan, N. (2017). Rethinking the use of tests: A meta-analysis of practice testing. Review of Educational Research, 87, 659 – 701. First citation in articleCrossrefGoogle Scholar

  • Agarwal, P. K., Karpicke, J. D., Kang, S. H., Roediger III, H. L. & McDermott, K. B. (2008). Examining the testing effect with open‐and closed‐book tests. Applied Cognitive Psychology, 22, 861 – 876. First citation in articleCrossrefGoogle Scholar

  • Baddeley, A. (2000). The episodic buffer: a new component of working memory? Trends in Cognitive Science, 4, 417 – 423. First citation in articleCrossrefGoogle Scholar

  • Bangert-Drowns, R. L., Kulik, C. L. C., Kulik, J. A. & Morgan, M. (1991). The instructional effect of feedback in test-like events. Review of Educational Research, 61, 213 – 238. First citation in articleCrossrefGoogle Scholar

  • Bertsch, S., Pesta, B. J., Wiscott, R. & McDaniel, M. A. (2007). The generation effect: A meta-analytic review. Memory & Cognition, 35, 201 – 210. First citation in articleCrossrefGoogle Scholar

  • Bjork, E. L. & Bjork, R. A. (2011). Making things hard on yourself, but in a good way: Creating desirable difficulties to enhance learning. In M. A. GernsbacherR. W. PewL. M. HoughJ. R. Pomerantz (Eds.), Psychology and the real world: Essays illustrating fundamental contributions to society (pp. 56 – 64). New York: Worth Publishers. First citation in articleGoogle Scholar

  • Blunt, J. R. & Karpicke, J. D. (2014). Learning with retrieval-based concept mapping. Journal of Educational Psychology, 106, 849 – 858. First citation in articleCrossrefGoogle Scholar

  • Borman, G. D. (2005). National effort to bring reform to scale in high-poverty schools: Outcomes and implications. In L Parker (Ed.), Review of research in education, 29 (pp. 1 – 28). Washington D.C: American Educational Research As. First citation in articleGoogle Scholar

  • Bungard, W. (1980). Die „gute“ Versuchsperson denkt nicht. München: Urban & Schwarzenberg. First citation in articleGoogle Scholar

  • Chen, O., Castro-Alonso, C., Paas, F. & Sweller, J. (2018). Undesirable difficulty effects in the learning of high-element interactivity materials. Frontiers in Psychology, 9, 1483. First citation in articleGoogle Scholar

  • Clark, R. C. & Mayer, R. E. (2016). E-Learning and the science of instruction: Proven guidelines for consumers and designers of multimedia learnin (4th ed.). . San Francisco, CA: Wiley. First citation in articleCrossrefGoogle Scholar

  • Cronbach, L. J., Ambron, S. R., Dornbusch, S. M., Hess, R. O., Hornik, R. C., Phillips, D. C., Walker, D. F. & Weiner, S. S. (1980). Toward reform of program evaluation: Aims, methods, and institutional arrangements. San Francisco: Jossey-Bass. First citation in articleGoogle Scholar

  • De Jonge, M., Tabbers, H. K. & Rikers, R. M. (2015). The effect of testing on the retention of coherent and incoherent text material. Educational Psychology Review, 27, 305 – 315. First citation in articleCrossrefGoogle Scholar

  • Diemand-Yauman, C., Oppenheimer, D. M. & Vaughan, E. B. (2011). Fortune favors the (): Effects of disfluency on educational outcomes. Cognition, 118 (1), 111 – 115. First citation in articleCrossrefGoogle Scholar

  • Dunlosky, J., Rawson, K. A., Marsh, E. J., Nathan, M. J. & Willingham, D. T. (2013). Improving students’ learning with effective learning techniques: Promising directions from cognitive and educational psychology. Psychological Science in the Public Interest, 14 (1), 4 – 58. First citation in articleCrossrefGoogle Scholar

  • Duyx, B., Urlings, M. J., Swaen, G. M., Bouter, L. M. & Zeegers, M. P. (2017). Scientific citations favor positive results: A systematic review and meta-analysis. Journal of Clinical Epidemiology, 88, 92 – 101. First citation in articleCrossrefGoogle Scholar

  • Ebersbach, M., Feierabend, M. & Barzagar Nazari, K. (2020). Comparing the effects of self-generating questions, testing, and restudying on students’ long-term recall in university learning. Applied Cognitive Psychology. https://doi.org/10.1002/acp.3639 First citation in articleCrossrefGoogle Scholar

  • Endres, T. & Renkl, A. (2015). Mechanisms behind the testing effect: an empirical investigation of retrieval practice in meaningful learning. Frontiers in Psychology, 6, 1054. First citation in articleGoogle Scholar

  • Endres, T., Carpenter, S., Martin, A. & Renkl, A. (2017). Enhancing learning by retrieval: Enriching free recall with elaborative prompting. Learning and Instruction, 49, 13 – 20. First citation in articleCrossrefGoogle Scholar

  • Gates, A. I. (1917). Recitation as a factor in memorizing. Archives of Psychology, 6, 1 – 104. First citation in articleGoogle Scholar

  • Glöckner, A., Fiedler, S. & Renkewitz, F. (2018). Belastbare und effiziente Wissenschaft. Psychologische Rundschau, 69, 22 – 36. First citation in articleLinkGoogle Scholar

  • Greving, S. & Richter, T. (2018). Examining the Testing Effect in University Teaching: Retrievability and Question Format Matter. Frontiers in Psychology, 9, 2412. First citation in articleGoogle Scholar

  • Hanel, P. & Haase, J. (2017). Predictors of citation rate in psychology: Inconclusive influence of effect and sample size. Frontiers in Psychology, 8, 1160. First citation in articleGoogle Scholar

  • Hartwig, M. K. & Dunlosky, J. (2012). Study strategies of college students: Are self-testing and scheduling related to achievement? Psychonomic Bulletin & Review, 9, 1, 126 – 134. First citation in articleCrossrefGoogle Scholar

  • Heitmann, S., Grund, A., Berthold, K., Fries, S. & Roelle, J. (2018). Testing is more desirable when it is adaptive and still desirable when compared to note-taking. Frontiers in Psychology, 9, 2596. First citation in articleGoogle Scholar

  • Karpicke, J. D. & Aue, W. R. (2015). The testing effect is alive and well with complex materials. Educational Psychology Review, 27, 317 – 326. First citation in articleCrossrefGoogle Scholar

  • Karpicke, J. D. & Blunt, J. R. (2011). Retrieval practice produces more learning than elaborative studying with concept mapping. Science, 331, 772 – 775. First citation in articleCrossrefGoogle Scholar

  • Karpicke, J. D., Butler, A. C. & Roediger III, H. L. (2009). Metacognitive strategies in student learning: do students practise retrieval when they study on their own? Memory, 17, 471 – 479. First citation in articleCrossrefGoogle Scholar

  • Khanna, M. M. & Cortese, M. J. (2016). The benefits of quizzing in content-focused versus skills-focused courses. Scholarship of Teaching and Learning in Psychology, 2, 1, 87. First citation in articleCrossrefGoogle Scholar

  • Kornell, N., Bjork, R. A. & Garcia, M. A. (2011). Why tests appear to prevent forgetting: A distribution-based bifurcation model. Journal of Memory and Language, 65 (2), 85 – 97. First citation in articleCrossrefGoogle Scholar

  • Kornell, N., Rabelo, V. C. & Klein, P. J. (2012). Tests enhance learning—Compared to what? Journal of Applied Research in Memory and Cognition, 1, 257 – 259. First citation in articleCrossrefGoogle Scholar

  • Kornell, N. & Son, L. K. (2009). Learners’ choices and beliefs about self-testing. Memory, 17, 493 – 501. First citation in articleCrossrefGoogle Scholar

  • Kuhbandner, C., Aslan, A., Emmerdinger, K. & Murayama, K. (2016). Providing extrinsic reward for test performance undermines long-term memory acquisition. Frontiers in psychology, 7, 79. First citation in articleGoogle Scholar

  • Kuhbandner, C. & Emmerdinger, K. J. (2019). Do students really prefer repeated rereading over testing when studying textbooks? A reexamination. Memory, 27, 952 – 961. First citation in articleGoogle Scholar

  • Kühn, A. (1914). Über Einprägung durch Lesen und durch Rezitieren. Zeitschrift für Psychologie, 68, 396 – 481. First citation in articleGoogle Scholar

  • Lehmann, J., Goussios, C. & Seufert, T. (2016). Working memory capacity and disfluency effect: an aptitude-treatment-interaction study. Metacognition and Learning, 11 (1), 89 – 105. First citation in articleCrossrefGoogle Scholar

  • Lindow, S., Fuchs, H., Fürstenberg, A., Kleber, J., Schweppe, J. & Rummer, R. (2011). On the robustness of the modality effect: Attempting to replicate a basic finding. Zeitschrift für Pädagogische Psychologie, 25, 231 – 243. First citation in articleLinkGoogle Scholar

  • Lipowsky, F., Richter, T., Borromeo-Ferri, R., Ebersbach, M. & Hänze, M. (2015). Wünschenswerte Erschwernisse beim Lernen. Schulpädagogik heute, 6 (11), 1 – 10. First citation in articleGoogle Scholar

  • Mayer, R. E. (2009). Multimedia Learning. Cambridge: Cambridge University Press. First citation in articleCrossrefGoogle Scholar

  • McCabe, J. (2011). Metacognitive awareness of learning strategies in undergraduates. Memory & Cognition, 39, 462 – 476. First citation in articleCrossrefGoogle Scholar

  • McDaniel, M. A. & Butler, A. C. (2011). A contextual framework for understanding when difficulties are desirable. In A. S. Benjamin (Ed.), Successful remembering and successful forgetting: A festschrift in honor of Robert A. Bjork (pp. 175 – 198). Hove, UK: Psychology Press. First citation in articleGoogle Scholar

  • McDaniel, M. A., Howard, D. C. & Einstein, G. O. (2009). The read-recite-review study strategy: Effective and portable. Psychological Science, 20, 516 – 522. First citation in articleCrossrefGoogle Scholar

  • Mintzes, J. J., Canas, A., Coffey, J., Gorman, J., Gurley, L., Hoffman, R. & Wandersee, J. H. (2011). Comment on “retrieval practice produces more learning than elaborative studying with concept mapping”. Science, 334, 453 – 453. First citation in articleCrossrefGoogle Scholar

  • Miyatsu, T., Nguyen, K. & McDaniel, M. A. (2018). Five popular study strategies: Their pitfalls and optimal implementations. Perspectives on Psychological Science, 13, 390 – 407. First citation in articleCrossrefGoogle Scholar

  • Mok, W. S. Y. & Chan, W. W. L. (2016). How do tests and summary writing tasks enhance long-term retention of students with different levels of test anxiety? Instructional Science, 44, 567 – 581. First citation in articleCrossrefGoogle Scholar

  • Moreira, B. F. T., Pinto, T. S. S., Starling, D. S. V. & Jaeger, A. (2019). Retrieval practice in classroom settings: a review of applied research. Frontiers in Education, 4, 5. First citation in articleGoogle Scholar

  • Morehead, K., Dunlosky, J., Rawson, K.-A., Blasiman, R. & Hollis, R. B. (2019). Note-taking habits of 21st Century college students: Implications for student learning, memory, and achievement, Memory, 27, 807 – 819. First citation in articleCrossrefGoogle Scholar

  • Mueller, P. A. & Oppenheimer, D. M. (2014). The pen is mightier than the keyboard: Advantages of longhand over laptop note taking. Psychological Science, 23, 1159 – 1168. First citation in articleCrossrefGoogle Scholar

  • Mundt, D., Abel, R. & Hänze, M. (2020). Exploring the effect of testing on forgetting in vocabulary learning: an examination of the bifurcation model. Journal of Cognitive Psychology, 32, 214 – 228. First citation in articleCrossrefGoogle Scholar

  • Open Science Collaboration. (2015). Estimating the reproducibility of psychological science. Science, 349 aac4716 First citation in articleCrossrefGoogle Scholar

  • Paas, F., Renkl, A. & Sweller, J. (2003). Cognitive load theory and instructional design: Recent developments. Educational Psychologist, 38 (1), 1 – 4. First citation in articleCrossrefGoogle Scholar

  • Palmatier, R. A. & Bennett, J. M. (1974). Notetaking habits of college students. Journal of Reading, 18, 215 – 218. First citation in articleGoogle Scholar

  • Pashler, H., Bain, P., Bottge, B., Graesser, A., Koedinger, K., McDaniel, M. & and Metcalfe, J. (2007). Organizing Instruction and Study to Improve Student Learning (NCER 2007 – 2004). Washington, DC: National Center for Education Research, Institute of Education Sciences, U.S. Department of Education. Retrieved from http://ncer.ed.gov First citation in articleGoogle Scholar

  • Pyc, M. A. & Rawson, K. A. (2009). Testing the retrieval effort hypothesis: Does greater difficulty correctly recalling information lead to higher levels of memory? Journal of Memory and Language. 60, 437 – 447. First citation in articleCrossrefGoogle Scholar

  • Pan, S. C. & Rickard, T. C. (2017). Does retrieval practice enhance learning and transfer relative to restudy for term-definition facts? Journal of Experimental Psychology: Applied, 23, 278 – 292. First citation in articleCrossrefGoogle Scholar

  • Roediger, H. L. III & Karpicke, J. D. (2006). Test-enhanced learning: Taking memory tests improves long-term retention. Psychological Science, 17, 249 – 255. First citation in articleCrossrefGoogle Scholar

  • Roelle, J. & Berthold, K. (2017). Effects of incorporating retrieval into learning tasks: The complexity of the tasks matters. Learning and Instruction, 49, 142 – 156. First citation in articleCrossrefGoogle Scholar

  • Roelle, J. & Nückles, M. (2019). Generative learning versus retrieval practice in learning from text: The cohesion and elaboration of the text matters. Journal of Educational Psychology, 111, 1341 – 1361. First citation in articleCrossrefGoogle Scholar

  • Roelle, J., Rahimkhani-Sagvand, N. & Berthold, K. (2017). Detrimental effects of immediate explanation feedback. European Journal of Psychology of Education, 32, 367 – 384. First citation in articleCrossrefGoogle Scholar

  • Rowland, C. A. (2014). The effect of testing versus restudy on retention: A meta-analytic review of the testing effect. Psychological Bulletin, 140, 1432 – 1463. First citation in articleCrossrefGoogle Scholar

  • Rummer, R., Schweppe, J., Gerst, K. & Wagner, S. (2017). Is testing a more effective learning strategy than note-taking? Journal of Experimental Psychology: Applied, 23, 293 – 300. First citation in articleCrossrefGoogle Scholar

  • Rummer, R., Schweppe, J., Scheiter, K. & Gerjets, P. (2008). Lernen mit Multimedia: Die kognitiven Grundlagen des Modalitätseffekts. Psychologische Rundschau, 59, 98 – 108. First citation in articleLinkGoogle Scholar

  • Rummer, R., Schweppe, J. & Schwede, A. (2016). Fortune is fickle: Null-effects of disfluency on learning outcomes. Metacognition and Learning, 11, 57 – 70. First citation in articleCrossrefGoogle Scholar

  • Rummer, R., Schweppe, J. & Schwede, A. (2019). Open-book vs. closed-book tests in university classes: a field experiment. Frontiers in Psychology, 10, 463. First citation in articleGoogle Scholar

  • Schindler, J., Schindler, S. & Reinhard, M.-A. (2019). Effectiveness of Self-Generation During Learning is Dependent on Individual Differences in Need for Cognition. Frontline Learning Research, 7 (2), 23 – 39. First citation in articleCrossrefGoogle Scholar

  • Schroeder, N. L., Nesbit, J. C., Anguiano, C. J. & Adesope, O. O. (2018). Studying and Constructing Concept Maps: a Meta-Analysis. Educational Psychology Review, 30, 431 – 455. First citation in articleCrossrefGoogle Scholar

  • Schwieren, J., Barenberg, J. & Dutke, S. (2017). The testing effect in the psychology classroom: A meta-analytic perspective. Psychology Learning & Teaching, 16, 179 – 196. First citation in articleCrossrefGoogle Scholar

  • Schworm, S. & Renkl, A. (2006). Computer-supported example-based learning: When instructional explanations reduce self-explanations. Computers & Education, 46, 426 – 445. First citation in articleCrossrefGoogle Scholar

  • Sonntag, K., Frieling, E. & Stegmaier, R. (2012). Lehrbuch Arbeitspsychologie. Bern: Huber. First citation in articleGoogle Scholar

  • Sweller, J. (1988). Cognitive load during problem solving: Effects on learning. Cognitive Science, 12, 257 – 285. First citation in articleCrossrefGoogle Scholar

  • Sweller, J. (1999). Instruction design in technical areas. Camberwell, Australia: ACER Press. First citation in articleGoogle Scholar

  • Tse, C. S., Chan, M. H. M., Tse, W. S. & Wong, S. W. H. (2019). Can the Testing Effect for General Knowledge Facts Be Influenced by Distraction due to Divided Attention or Experimentally Induced Anxious Mood? Frontiers in Psychology, 10. First citation in articleCrossrefGoogle Scholar

  • Tse, C. S. & Pu, X. (2012). The effectiveness of test-enhanced learning depends on trait test anxiety and working-memory capacity. Journal of Experimental Psychology: Applied, 18, 253 – 264. First citation in articleCrossrefGoogle Scholar

  • Ulich, E. (2011). Arbeitspsychologie. Zürich: vdf Hochschulverlag. First citation in articleGoogle Scholar

  • Van Gog, T. & Sweller, J. (2015). Not new, but nearly forgotten: the testing effect decreases or even disappears as the complexity of learning materials increases. Educational Psychology Review, 27, 247 – 264. First citation in articleCrossrefGoogle Scholar

  • Weissgerber, S. C., Reinhard, M. A. & Schindler, S. (2018). Learning the hard way: Need for Cognition influences attitudes toward and self-reported use of desirable difficulties. Educational Psychology, 38, 176 – 202. First citation in articleCrossrefGoogle Scholar

  • Weissgerber, S. C. & Reinhard, M.-A. (2017). Is disfluency desirable for learning? Learning and Instruction, 49, 199 – 217. First citation in articleCrossrefGoogle Scholar

  • Weissgerber, S. C. & Reinhard, M.-A. (2018). Pilot study on the relationship of test anxiety to utilizing self-testing in self-regulated learning. International Journal of Psychological Studies, 10 (4), 95 – 109. First citation in articleCrossrefGoogle Scholar

  • Wenzel, K. & Reinhard, M.-A. (2019). Relatively unintelligent individuals do not benefit from intentionally hindered learning: The role of desirable difficulties. Intelligence, 77 Article 101405 https://doi.org/10.1016/j.intell.2019.101405 First citation in articleCrossrefGoogle Scholar

  • Wissman, K. T., Rawson, K. A. & Pyc, M. A. (2012). How and when do students use flashcards? Memory, 20, 568 – 579. First citation in articleCrossrefGoogle Scholar

  • Witasek, S. (1907). Über Lesen und Rezitieren in ihren Beziehungen zum Gedächtnis. Zeitschrift für Psychologie, 44, 161 – 185. First citation in articleGoogle Scholar