Kompetenztestung bei Grundschulkindern
Differenzielle Effekte unterschiedlicher Testbedingungen
Abstract
Zusammenfassung. Die vorliegende Studie ging der Frage nach, ob die Validität eines sprachlich vorgegebenen Wissenstests für Grundschülerinnen und Grundschüler durch bestimmte Administrationsbedingungen gesteigert werden kann. In der Studie bearbeiteten 319 Drittklässlerinnen und Drittklässler im Klassenkontext einen inhaltlichen Test zum metakognitiven Wissen über Lernstrategien, der in zwei Varianten (Zuhören vs. Zuhören und Mitlesen) vorgegeben wurde. Darüber hinaus wurde ein Wortschatztest eingesetzt und der familiäre Sprachhintergrund der Kinder erhoben. Als wichtigsten Befund ergab eine Mehrebenenanalyse eine signifikante Interaktion von Testbedingung und den sprachlichen Kompetenzen: Kinder mit vergleichsweise geringem Wortschatz erzielten in der Zuhören-und-Mitlesen-Bedingung höhere Werte in einem Test zum metakognitiven Wissen als in der Zuhören-Bedingung, wohingegen sich bei Kindern mit größerem Wortschatz kein Unterschied zwischen den Testbedingungen ergab. Ein entsprechendes Befundmuster zeigte sich, wenn anstatt des Wortschatzes der Sprachhintergrund berücksichtigt wurde. Somit sprechen die Ergebnisse dafür, dass Kinder mit geringeren Sprachkompetenzen von der Möglichkeit profitieren, die Aufgabentexte mitzulesen. Folglich erhöht die Zuhören-und-Mitlesen-Bedingung die Validität der Testung, was mit Blick auf die theoretischen und diagnostischen Implikationen diskutiert wird.
Abstract. The present study investigated whether the validity of a verbally presented knowledge test for primary school children can be increased by the mode of test administration. In this study, 319 third-graders were given a test concerning metacognitive knowledge about learning strategies, which was presented in a classroom context in two different versions (listening and reading-while-listening). In addition, a vocabulary test was administered and children’s family language background was assessed. As a main result, a multilevel analysis revealed a significant interaction between administration mode and language competencies: Children with comparatively reduced vocabulary attained higher scores in the metacognitive knowledge test in the reading-while-listening condition compared with the listening condition. By contrast, there was no effect of test administration mode for children with more advanced vocabulary. Corresponding results were found when children’s language background instead of vocabulary was taken into account. Thus, the results suggest that children with lower language competencies benefit from the possibility to read the task-related texts while listening. Hence, the reading-while-listening condition increases the validity of testing. The findings are discussed in terms of their theoretical and diagnostic implications.
Literatur
2001). Metacognitive knowledge in primary grades: A longitudinal study. European Journal of Psychology of Education, 16, 257 – 282.
(2009). Diagnose von Strategiewissen beim Textverstehen. Zeitschrift für Entwicklungspsychologie und Pädagogische Psychologie, 41, 96 – 103.
(2011).
(Leseförderung durch Vorlesen: Ergebnisse und Möglichkeiten eines Konzepts zur basalen Leseförderung . In Eriksson, B.Behrens, U. (Hrsg.). Sprachliches Lernen zwischen Mündlichkeit und Schriftlichkeit (S. 144 – 171). Bern: hep Verlag.2011). Education as a lifelong process: The German National Educational Panel Study (NEPS) [Special Issue]. Zeitschrift für Erziehungswissenschaft, 14 (Suppl. 2).
(2008). Incidental vocabulary acquisition from reading, reading-while-listening, and listening to stories. Reading in a Foreign Language, 20, 136 – 163.
(2010). Reading development and difficulties. Oxford: Wiley-Blackwell.
(1991). Cognitive load theory and the format of instruction. Cognition and Instruction, 8, 293 – 332.
(2009). Gains to L2 listeners from reading while listening vs. listening only in comprehending short stories. System, 37, 652 – 663.
(1988). Statistical power analysis for the behavioral sciences (2nd ed.). Hillsdale, NJ: Lawrence Earlbaum Associates.
(1994). A comparison of three interventions for increasing oral reading performance: Application of the instructional hierarchy. Journal of Applied Behavior Analysis, 27, 459 – 469.
(2007). The effect of written text on comprehension of spoken English as a foreign language. American Journal of Psychology, 120, 237 – 261.
(1983). Teaching them to read. Boston, MA: Allyn & Bacon.
(2013).
(Predicting reading literacy in primary school: The contribution of various language indicators in preschool . In Pfos, M.Artelt, C.Weinert, S. (Eds.). The development of reading literacy from early childhood to adolescence (pp. 93 – 149). Bamberg: University of Bamberg Press.2002). Improving oral reading fluency: An examination of the efficacy of combining skill-based and performance-based interventions. Journal of Applied Behavior Analysis, 35, 271 – 281.
(1977).
(Metamemory . In Kail, R. V.Hagen, J. W. (Eds.). Perspectives on the development of memory and cognition (pp. 3 – 33). Hillsdale, NJ: Erlbaum.2010). “How do I remember when I got my dog?“ The structure and development of children’s metamemory. Metacognition and Learning, 5, 207 – 228.
(2005). An investigation of listening and listening-while-reading accommodations on reading comprehension levels and rates in students with emotional disorders. Psychology in the Schools, 42, 39 – 51.
(2013). Assessing metacognitive knowledge: Development and evaluation of a test instrument. Journal of Educational Research Online, 5, 162 – 188.
(2015).
(Kompetenztestung bei Schülern und Schülerinnen mit Förderschwerpunkt Lernen – Effekte unterschiedlicher Testbedingungen am Beispiel eines Tests zum metakognitiven Wissen . In Kuh, P.Stana, P.Lütje-Klos, B.Gresc, C.Pant, H. A.Prenzel, M. (Hrsg.). Inklusion von Schülerinnen und Schülern mit sonderpädagogischem Förderbedarf in Schulleistungserhebungen (S. 221 – 242). Wiesbaden: Springer VS.1990). The simple view of reading. Reading and Writing: An Interdisciplinary Journal, 2, 127 – 160.
(2014).
(The redundancy principle in multimedia learning . In Mayer, R. E. (Eds.). The Cambridge Handbook of Multimedia Learning (2nd ed., pp. 247 – 262). New York, NY: Cambridge University Press.2004). When redundant on-screen text in multimedia technical instruction can interfere with learning. Human Factors, 46, 567 – 581.
(2010). PISA 2009. Bilanz nach einem Jahrzehnt. Münster: Waxmann.
(2014).
(Testfairness . In Wirtz, M. A. (Hrsg.). Dorsch – Lexikon der Psychologie (18. Aufl.). Bern: Hogrefe.2017). Identifying processes underlying the multimedia effect in testing: An eye-movement analysis. Learning and Instruction, 47, 91 – 102.
(2016).
(Metacognitive knowledge in young children: Development of a new test procedure for first graders . In Blossfel, H.-P.von Mauric, J.Bayer, M.Skopek, J. (Eds.). Methodological issues of longitudinal surveys: The example of the National Educational Panel Study (pp. 465 – 484). Wiesbaden: Springer VS.1983). Development of reading-while-listening skills in the primary grades. Reading Research Quarterly, 19, 38 – 52.
(2012). Improving listening skills in English as a foreign language by reading rather than listening: A cognitive load perspective. Applied Cognitive Psychology, 26, 391 – 402.
(2012). Mplus User’s Guide (7th ed.). Los Angeles, CA: Muthén & Muthén.
(1985). Reading ability. New York, NY: Oxford University Press.
(1989). The effects of repeated reading and repeated listening while reading on reading fluency. Washington, D.C.: ERIC Clearinghouse.
(2005). Peabody Picture Vocabulary Test (Unveröffentlichte Deutsche Forschungsversion des Tests von L. M. Dunn & L. M. Dunn von 1997). Bamberg, Berlin: Otto-Friedrich-Universität Bamberg & Freie Universität Berlin.
(1995). Assisted reading practice: Effects on performance for poor readers in Grades 3 and 4. Reading Research Quarterly, 30, 382 – 395.
(2016).
(Including students with special educational needs in the competence assessment of the NEPS—results on the comparability of test scores in reading . In Blossfel, H.-P.von Mauric, J.Bayer, M.Skopek, J. (Eds.). Methodological issues of longitudinal surveys. The example of the National Educational Panel Study (pp. 485 – 501). Wiesbaden: Springer VS.2015). Competence assessment of students with special educational needs—Identification of appropriate testing accommodations. Frontline Learning Research, 3, 2, 1 – 25.
(1998). Cognitive architecture and instructional design. Educational Psychology Review, 10, 251 – 296.
(2004).
(Effect sizes in multilevel models . In I. Schagen, und K. Elliot (Eds.). But what does it mean? The use of effect sizes in educational research (pp. 55 – 66). London: National Foundation for Educational Research.2006).
(Sprachentwicklung . In Schneider, W.Sodian, B. (Hrsg.). Kognitive Entwicklung (S. 609 – 719). Göttingen: Hogrefe.2011). Development of competencies across the life span. Zeitschrift für Erziehungswissenschaft, 14 (Suppl. 2), 67 – 86.
(1977). Tip of the tongue and feeling of knowing experiences: A developmental study of memory monitoring. Child Development, 48, 13 – 21.
(1986).
(Problems and issues in the definition of learning disabilities . In Torgesen, J. K.Wong, B. Y. L. (Eds.). Psychological and educational perspectives on learning disabilities (pp. 3 – 26). New York: Academic Press.