Metacognitive Judgment Skills and the Metacognitive Component of Self-Regulated Learning
A Person-Oriented, Multimethod Approach
Abstract
Abstract: Metacognitive judgments as part of metacognitive monitoring can be measured using different methods and show individual differences. Moreover, metacognitive judgments are highly related to the metacognitive component of self-regulated learning (SRL-MC). Nevertheless, it is unclear how metacognitive judgments are related to different ways of measuring SRL-MC. Adopting a person-oriented, multimethod approach, we measured three metacognitive judgment forms in a sample of 99 college students. Latent profile analyses resulted in four groups with differing profiles of these metacognitive judgment measures. Linking the profiles to performance, we could contextualize them within the unskilled- and unaware-effect and extend previous research on this effect. Regarding their relationship to SRL-MC, we found no differences for questionnaire values, microanalysis results, and strategy knowledge scores. These results are discussed with regard to the conceptual overlap of metacognitive judgments and SRL-MC.
Zusammenfassung: Metakognitive Urteilsfähigkeit als eine Komponente metakognitiven Monitorings kann über verschiedene Erfassungsmethoden gemessen werden und zeigt individuelle Unterschiede. Darüberhinaus steht die metakogntive Urteilsfähigkeit in engem Zusammenhang zur metakognitiven Komponente selbstregulierten Lernens (SRL-MC). Es ist jedoch unklar, wie die metakognitive Urteilsfähigkeit mit verschiedenen Methoden zur Erfassung von SRL-MC zusammenhängt. Im Rahmen eines personenorientierten multimethodalen Ansatzes wurden drei Formen der metakognitiven Urteilsfähigkeit bei N = 99 Studierenden erhoben. Latente Profilanalysen ergaben vier Gruppen, die sich im Hinblick auf die Formen der metakognitiven Urteilsfähigkeit sowie Leistung unterscheiden. Diese Profile können in Bezug auf den „unskilled and unaware“-Effekt kontextualisiert werden und erweiteren den bisherigen Forschungsstand zu diesem Effekt. Im Hinblick auf SRL-MC zeigten sich keine Unterschiede zwischen den Profilen in Fragebogenwerten, mikroanalytischen Erfassungen oder Scores des Strategiewissens. Die Ergebnisse werden im Hinblick auf die konzeptuelle Überschneidung von metakognitiver Urteilsfähigkeit und SRL-MC diskutiert.
Literatur
2000). Wie prädiktiv sind retrospektive Selbstberichte über den Gebrauch von Lernstrategien für strategisches Lernen? [How predictive are retrospective self-reports on the use of learning strategies for strategic learning?]. Zeitschrift für Pädagogische Psychologie, 14(2/3), 72 – 84. https://doi.org/10.1024//1010-0652.14.23.72
(2009). Theoretical, conceptual, methodological, and instructional issues in research on metacognition and self-regulated learning: A discussion. Metacognition and Learning, 4 (1), 87 – 95. https://doi.org/10.1007/s11409-009-9035-7
(1999). Self-regulated learning: Where we are today. International Journal of Educational Research, 31 (6), 445 – 457. https://doi.org/10.1016/S0883-0355(99)00014-2
(2012). Calibration research: Where do we go from here? Frontiers in Psychology, 3, 229. https://doi.org/10.3389/fpsyg.2012.00229
(2009). Neural correlates of metamemory: A comparison of feeling-of-knowing and retrospective confidence judgments. Journal of Cognitive Neuroscience, 21 (9), 1751 – 1765. https://doi.org/10.1162/jocn.2009.21123
(2018).
(Assessing self-regulated learning using microanalytic methods . In D. H. SchunkJ. A. Greene (Eds.), Handbook of self-regulation of learning and performance (pp. 338 – 351). Routledge.2012). Assessing self-regulation as a cyclical, context-specific phenomenon: Overview and analysis of SRL microanalytic protocols. Education Research International, 2012, 1 – 19. https://doi.org/10.1155/2012/428639
(1988). Statistical power analysis for the behavioral sciences (2nd ed.). Lawrence Erlbaum Associates.
(2008). Focusing the conceptual lens on metacognition, self-regulation, and self-regulated learning. Educational Psychology Review, 20 (4), 391 – 409. https://doi.org/10.1007/s10648-008-9083-6
(2016). More is more? Evaluation of interventions to foster self-regulated learning in college. International Journal of Educational Research, 78, 50 – 65. https://doi.org/10.1016/j.ijer.2016.05.010
(2023). Knowing how to learn: Development and validation of a strategy knowledge test on self-regulated learning for college students. Manuscript submitted for publication.
(2021). Multimethod assessment of self-regulated learning in college students: Different methods for different components? Instructional Science, 49 (1), 137 – 163. https://doi.org/10.1007/s11251-020-09533-2
(2008). Metacognition. Sage.
(2012). Overconfidence produces underachievement: Inaccurate self evaluations undermine students’ learning and retention. Learning and Instruction, 22 (4), 271 – 280. https://doi.org/10.1016/j.learninstruc.2011.08.003
(2015). Metacognition and confidence: Comparing math to other academic subjects. Frontiers in Psychology, 6, 742. https://doi.org/10.3389/fpsyg.2015.00742
(2013).
(Supporting effective self-regulated learning: The critical role of monitoring . In R. AzevedoV. Aleven. (Eds.), International handbook of metacognition and learning technologies (pp. 19 – 34). Springer.2013). Calibration in goal setting: Examining the nature of judgments of confidence. Learning and Instruction, 24, 37 – 47. https://doi.org/10.1016/j.learninstruc.2012.10.001
(2013). Assessing metacognitive knowledge: Development and evaluation of a test instrument. Journal for Educational Research Online, 5 (2), 162 – 188.
(2018). Confidence in performance judgment accuracy: The unskilled and unaware effect revisited. Metacognition and Learning, 13 (3), 265 – 285. https://doi.org/10.1007/s11409-018-9185-6
(2022). Structure, relationship, and determinants of monitoring strategies and judgment accuracy. An integrated model and evidence from two studies. Learning and Individual Differences, 100, 102229. https://doi.org/10.1016/j.lindif.2022.102229
(2020). Individual differences in local and global metacognitive judgments. Metacognition and Learning, 15 (1), 51 – 75. https://doi.org/10.1007/s11409-020-09220-0
(2016). A guideline of selecting and reporting intraclass correlation coefficients for reliability research. Journal of Chiropractic Medicine, 15 (2), 155 – 63. https://doi.org/10.1016/j.jcm.2016.02.012
(1997). Monitoring one’s own knowledge during study: A cue-utilization approach to judgments of learning. Journal of Experimental Psychology: General, 126 (4), 349 – 370. https://doi.org/10.1037/0096-3445.126.4.349
(2000). The feeling of knowing: Some meta-theoretical implications for consciousness and control. Consciousness and Cognition, 9 (2), 149 – 171. https://doi.org/10.1006/ccog.2000.0433
(2002). Comparing objective and subjective learning curves: Judgments of learning exhibit increased underconfidence with practice. Journal of Experimental Psychology: General, 131 (2), 147 – 162. https://doi.org/10.1037/0096-3445.131.2.147
(1999). Unskilled and unaware of it: How difficulties in recognizing one’s own incompetence lead to inflated self-assessments. Journal of Personality and Social Psychology, 77 (6), 1121 – 1134. https://doi.org/10.1037/0022-3514.77.6.1121
(2014 – 2022). Berechnung des Lesbarkeitsindex LIX nach Björnson [Calculation of the readability index LIX according to Björnson]. Psychometrica. https://doi.org/10.13140/RG.2.1.1512.3447
(2014). College students’ motivation and learning strategies profiles and academic achievement: A self-determination theory approach. Educational Psychology, 34 (3), 338 – 353. https://doi.org/10.1080/01443410.2013.785067
(2013). Reliability and validity analyses of a newly developed test to assess learning strategy knowledge. Journal of Cognitive Education and Psychology, 12 (3), 391 – 408. https://doi.org/10.1891/1945-8959.12.3.391
(2009). Classical latent profile analysis of academic self-concept dimensions. Synergy of person- and variable-centered approaches to theoretical models of self-concept. Structural Equation Modeling, 16 (2), 191 – 225. https://doi.org/10.1080/10705510902751010
(2011). Unskilled but aware: Reinterpreting overconfidence in low-performing students. Journal of Experimental Psychology: Learning, Memory, and Cognition, 37 (2), 502 – 506. https://doi.org/10.1037/a0021802
(1998 – 2012). Mplus user’s guide: Statistical analysis with latent variables (7th ed.). Muthén & Muthén.
(1990). Metamemory: A theoretical framework and new findings. The Psychology of Learning and Motivation, 26, 125 – 141. https://doi.org/10.1016/S0079-7421(08)60053-5.
(2005). Metacognitive monitoring accuracy and student performance in the postsecondary classroom. Journal of Experimental Education, 74 (1), 7 – 28.
(2020).
(Selbstregulation und selbstreguliertes Lernen. [Self-regulation and self-regulated learning ]. In E. WildJ. Möller. (Eds.), Pädagogische Psychologie. (pp. 45 – 66). Springer. https://doi.org/10.1007/978-3-642-41291-2_32000).
(Assessing metacognition and self-regulated learning . In G. SchrawJ. C. Impara (Eds.), Issues in the measurement of metacognition (pp. 43 – 97). Buros Institute of Mental Measurement. https://digitalcommons.unl.edu/burosmetacognition/32019). Granularity matters: Comparing different ways of measuring self-regulated learning. Metacognition and Learning, 14 (1), 1 – 19. https://doi.org/10.1007/s1140 9-019-09188 -6.
(2012). On-line and off-line assessment of metacognition. International Electronic Journal of Elementary Education, 4 (2), 301 – 315.
(2009). A conceptual analysis of five measures of metacognitive monitoring. Metacognition and Learning, 4 (1), 33 – 45. https://doi.org/10.1007/s11409-008-9031-3
(2018). Handbook of self-regulation of learning and performance (2nd ed.). Routledge.
(2016). But I was so sure! Metacognitive judgments are less accurate given prospectively than retrospectively. Frontiers in Psychology, 7, 218. https://doi.org/10.3389/fpsyg.2016.00218
(2004). Metacognition and self- regulated learning constructs. Educational Research and Evaluation, 10 (2), 117 – 139.
(2011). The taxonomy of metacognition. Psychology Press.
(2015). An investigation of the role of contingent metacognitive behavior in self-regulated learning. Metacognition and Learning, 10 (1), 77 – 98. https://doi.org/10.1007/s11409-014-9126-y
(2021). Unskilled but aware of it? Cluster analysis of creative metacognition from preschool age to early adulthood. Journal of Creative Behaviour, 55 (4), 937 – 945.
(2005).
(The assessment of metacognitive skills: What can be learned from multimethod designs? In C. ArteltB. Moschner. (Eds.), Lernstrategien und Metakognition: Implikationen für Forschung und Praxis (pp. 75 – 97). Waxmann.2002). Latent class cluster analysis. Applied Latent Class Analysis, 11, 89 – 106. https://doi.org/10.1017/cbo9780511499531.004
(2015). Exploring general versus task-specific assessments of metacognition in university chemistry students: A multitrait–multimethod analysis. Research in Science Education, 45 (4), 555 – 579. https://doi.org/10.1007/s11165-014-9436-8
(2008). Self-regulated learning as a competence: Implications of theoretical models for assessment methods. Zeitschrift für Psychologie, 216 (2), 102 – 110. https://doi.org/10.1027/0044-3409.216.2.102
(2000).
(Attaining self-regulation: A social cognitive perspective . In M. BoekaertsP. R. PintrichM. Zeidner. (Eds.), Handbook of self-regulation (pp. 13 – 39). Academic press. https://doi.org/10.1016/B978-012109890-2/50031-72011).
(Motivational sources and outcomes of self-regulated learning and performance . In B. J. ZimmermanD. H. Schunk. (Eds.), Handbook of self-regulation of learning and performance (pp. 49 – 64). Routledge. https://doi.org/10.4324/9780203839010.CH4