Skip to main content
Search
Search
    Quick Search anywhere
    Quick search in Citations
Advanced Search
Skip main navigationClose Drawer MenuOpen Drawer Menu
Previous article
Next article
Original Article

Validating the Resource-Management Inventory (ReMI)

Testing Measurement Invariance and Predicting Academic Achievement in a Sample of First-Year University Students

Published Online:November 25, 2019https://doi.org/10.1027/1015-5759/a000557

Abstract

Abstract. There is substantial evidence that students in higher education who have sophisticated resource-management skills are more successful in their studies. Nevertheless, research shows that students are often not adequately prepared to use resource-management strategies effectively. It is thus crucial to screen and identify students who are at risk of poor resource management (and consequently, reduced academic achievement) to provide them with appropriate support. For this purpose, we extend the validation of a situational-judgment-based instrument called Resource-Management Inventory (ReMI), which assesses resource-management competency (including knowledge of resource-management strategies and the self-reported ability to use this knowledge in learning situations). We evaluated the ReMI regarding factor structure, measurement invariance, and its impact on academic achievement in different study domains in a sample of German first-year students (N = 380). The results confirm the five-factor structure that has been found in a previous study and indicate strong measurement invariance. Furthermore, taking cognitive covariates into account, the results confirm that the ReMI can predict students’ grades incrementally. Finally, a multi-group analysis shows that the findings can be generalized across different study domains. Overall, we provide evidence for a valid and efficient instrument for the assessment of resource-management competency in higher education.

References

  • Adams, R., & Blair, E. (2019). Impact of time management behaviors on undergraduate engineering students’ performance. SAGE Open, 9, 1–11. https://doi.org/10.1177/2158244018824506 First citation in articleCrossref, Google Scholar

  • Bannert, M. (2006). Effects of reflection prompts when learning with hypermedia. Journal of Educational Computing Research, 35, 359–375. https://doi.org/10.2190/94V6-R58H-3367-G388 First citation in articleCrossref, Google Scholar

  • Bidjerano, T. (2005, October). Gender differences in self-regulated learning. Paper Presented at the Annual Meeting of the Northeastern Educational Research Association, New York, NY. First citation in articleGoogle Scholar

  • Broadbent, J., & Poon, W. L. (2015). Self-regulated learning strategies and academic achievement in online higher education learning environments: A systematic review. The Internet and Higher Education, 27, 1–13. https://doi.org/10.1016/j.iheduc.2015.04.007 First citation in articleCrossref, Google Scholar

  • Byrne, B. M., & Watkins, D. (2003). The issue of measurement invariance revisited. Journal of Cross-Cultural Psychology, 34, 155–175. https://doi.org/10.1177/0022022102250225 First citation in articleCrossref, Google Scholar

  • Chen, F. F. (2007). Sensitivity of goodness of fit indexes to lack of measurement invariance. Structural Equation Modeling, 14, 464–504. https://doi.org/10.1080/10705510701301834 First citation in articleCrossref, Google Scholar

  • Chen, F. F., Sousa, K. H., & West, S. G. (2005). Testing measurement invariance of second-order factor models. Structural Equation Modeling, 12, 471–492. https://doi.org/10.1207/s15328007sem1203_7 First citation in articleCrossref, Google Scholar

  • Donche, V., De Maeyer, S., Coertjens, L., Van Daal, T., & Van Petegem, P. (2013). Differential use of learning strategies in first-year higher education: The impact of personality, academic motivation, and teaching strategies. The British Journal of Educational Psychology, 83, 238–251. https://doi.org/10.1111/bjep.12016 First citation in articleCrossref, Google Scholar

  • Dresel, M., Schmitz, B., Schober, B., Spiel, C., Ziegler, A., Engelschalk, T., … Steuer, G. (2015). Competencies for successful self-regulated learning in higher education: Structural model and indications drawn from expert interviews. Studies in Higher Education, 40, 454–470. https://doi.org/10.1080/03075079.2015.1004236 First citation in articleCrossref, Google Scholar

  • Enders, C. K. (2010). Applied missing data analysis. New York, NY: Guilford Press. First citation in articleGoogle Scholar

  • Engelschalk, T., Steuer, G., & Dresel, M. (2017). Quantity and quality of motivational regulation among university students. Educational Psychology, 37, 1154–1170. https://doi.org/10.1080/01443410.2017.1322177 First citation in articleCrossref, Google Scholar

  • Foerst, N. M., Klug, J., Jöstl, G., Spiel, C., & Schober, B. (2017). Knowledge vs. action: Discrepancies in university students’ knowledge about and self-reported use of self-regulated learning strategies. Frontiers in Psychology, 8, 1288. https://doi.org/10.3389/fpsyg.2017.01288 First citation in articleCrossref, Google Scholar

  • Grunschel, C., Schwinger, M., Steinmayr, R., & Fries, S. (2016). Effects of using motivational regulation strategies on students’ academic procrastination, academic performance, and well-being. Learning and Individual Differences, 49, 162–170. https://doi.org/10.1016/j.lindif.2016.06.008 First citation in articleCrossref, Google Scholar

  • Heller, K. A., & Perleth, C. (2000). Kognitiver Fähigkeitstest für 4. bis 12. Klassen, Revision (KFT 4–12 + R) [Test on cognitive abilities for grades 4–12, Revised]. Göttingen, Germany: Hogrefe. First citation in articleGoogle Scholar

  • Heublein, U. (2014). Student drop-out from German higher education institutions. European Journal of Education, 49, 497–513. https://doi.org/10.1111/ejed.12097 First citation in articleCrossref, Google Scholar

  • Inaltun, H., Irmak, M., Yanis, H., & Ercan, J. (2013). Investigating differences in preservice science teachers’ resource management strategies in preparing laboratory report. Procedia – Social and Behavioral Sciences, 116, 4140–4144. https://doi.org/10.1016/j.sbspro.2014.01.905 First citation in articleCrossref, Google Scholar

  • McDonald, R. P. (1999). Test theory: A unified treatment. Mahwah, NJ: Erlbaum. First citation in articleGoogle Scholar

  • Marsh, H. W. (2007). Application of confirmatory factor analysis and structural equation modeling in sport and exercise psychology. In G. TenenbaumR. C. EklundEds., Handbook of sport psychology (3rd ed., pp. 774–798). Hoboken, NJ: Wiley. https://doi.org/10.1002/9781118270011.ch35 First citation in articleGoogle Scholar

  • Mayer, R. E. (1992). Cognition and instruction: Their historic meeting within educational psychology. Journal of Educational Psychology, 84, 405–412. https://doi.org/10.1037/0022-0663.84.4.405 First citation in articleCrossref, Google Scholar

  • Meredith, W. (1993). Measurement invariance, factor analysis and factorial invariance. Psychometrika, 58, 525–543. First citation in articleCrossref, Google Scholar

  • Miller, P. H. (1990). The development of strategies of selective attention. In D. F. BjorklundEd., Children’s strategies: Contemporary views of cognitive development (pp. 157–184). Hillsdale, NJ: Erlbaum. First citation in articleGoogle Scholar

  • Panadero, E., Klug, J., & Järvelä, S. (2016). Third wave of measurement in the self-regulated learning field: When measurement and intervention come hand in hand. Scandinavian Journal of Educational Research, 60, 723–735. https://doi.org/10.1080/00313831.2015.1066436 First citation in articleCrossref, Google Scholar

  • Panadero, E. (2017). A review of self-regulated learning: Six models and four directions for research. Frontiers in Psychology, 8, 422. https://doi.org/10.3389/fpsyg.2017.00422 First citation in articleCrossref, Google Scholar

  • Perry, R. P., Hladkyj, S., Pekrun, R. H., & Pelletier, S. T. (2001). Academic control and action control in the achievement of college students: A longitudinal field. Journal of Educational Psychology, 93, 776–788. https://doi.org/10.1037//0022-0663.93.4.776 First citation in articleCrossref, Google Scholar

  • Pintrich, P. R., & De Groot, E. V. (1990). Motivational and self-regulated learning components of classroom academic performance. Journal of Educational Psychology, 82, 33–40. https://doi.org/10.1037/0022-0663.82.1.33 First citation in articleCrossref, Google Scholar

  • Pintrich, P. R., Smith, D. A. F., Garcia, T., & McKeachie, W. J. (1993). Reliability and predictive validity of the Motivated Strategies for Learning Questionnaire (MSLQ). Educational and Psychological Measurement, 53, 801–813. https://doi.org/10.1177/0013164493053003024 First citation in articleCrossref, Google Scholar

  • Prevatt, F., Petscher, Y., Proctor, B. E., Hurst, A., & Adams, K. (2006). The revised learning and study strategies inventory: An evaluation of competing models. Educational and Psychological Measurement, 66, 448–458. https://doi.org/10.1177/0013164405282454 First citation in articleCrossref, Google Scholar

  • Richardson, J. T. E. (2004). Methodological issues in questionnaire-based research on student learning in higher education. Educational Psychology Review, 16, 347–358. First citation in articleCrossref, Google Scholar

  • Richardson, M., Abraham, C., & Bond, R. (2012). Psychological correlates of university students’ academic performance: A systematic review and meta-analysis. Psychological Bulletin, 138, 353–387. https://doi.org/10.1037/a0026838 First citation in articleCrossref, Google Scholar

  • Rosseel, Y. (2012). lavaan: An R package for structural equation modeling. Journal of Statistical Software, 48, 1–3. https://doi.org/10.18637/jss.v048.i02 First citation in articleCrossref, Google Scholar

  • Roth, A., Ogrin, S., & Schmitz, B. (2016). Assessing self-regulated learning in higher education: A systematic literature review of self-report instruments. Educational Assessment, Evaluation and Accountability, 28, 225–250. https://doi.org/10.1007/s11092-015-9229-2 First citation in articleCrossref, Google Scholar

  • Thibodeaux, J., Deutsch, A., Kitsantas, A., & Winsler, A. (2017). First-year college students’ time use: Relations with self-regulation and GPA. Journal of Advanced Academics, 28, 5–27. https://doi.org/10.1177/1932202X16676860 First citation in articleCrossref, Google Scholar

  • Veenman, M. V. J., Van Hout-Wolters, B. H. A. M., & Afflerbach, P. (2006). Metacognition and learning: Conceptual and methodological considerations. Metacognition and Learning, 1, 3–14. https://doi.org/10.1007/s11409-006-6893-0 First citation in articleCrossref, Google Scholar

  • Waldeyer, J., Fleischer, J., Wirth, J., & Leutner, D. (2019). Entwicklung und erste Validierung eines Situational-Judgement-Instruments zur Erfassung von Kompetenzen im Bereich des Ressourcenmanagements (ReMI) [Development and validation of a new instrument for students’ resource-management assessment]. Diagnostica, 65, 108–118. https://doi.org/10.1026/0012-1924/a000217 First citation in articleLink, Google Scholar

  • Weinert, F. E. (2001). Vergleichende Leistungsmessung in Schulen – eine umstrittene Selbstverständlichkeit [Comparative assessment in schools – A controversial naturalness]. In F. E. WeinertEd., Leistungsmessungen in Schulen (pp. 17–31). Basel, Switzerland: Beltz. First citation in articleGoogle Scholar

  • Weinstein, C. E., Palmer, D. R., & Schulte, A. C. (1987). LASSI: Learning and Study Strategies Inventory. Clearwater, FL: H&H Publishing. First citation in articleGoogle Scholar

  • Wild, K.-P., & Schiefele, U. (1994). Lernstrategien im Studium. Ergebnisse zur Faktorenstruktur und Reliabilität eines neuen Fragebogens [Learning strategies in higher education: Results of the factor structure and reliability of a new questionnaire]. Zeitschrift für Differentielle und Diagnostische Psychologie, 15, 185–200. First citation in articleGoogle Scholar

  • Wirth, J., & Leutner, L. (2008). Self-regulated learning as a competence: Implications of theoretical models for assessment methods. Journal of Psychology, 216, 102–110. https://doi.org/10.1027/0044-3409.216.2.102 First citation in articleAbstract, Google Scholar