Skip to main content
Search
Search
    Quick Search anywhere
    Quick search in Citations
Advanced Search
Skip main navigationClose Drawer MenuOpen Drawer Menu
Previous article
Next article
Brief Report

Teaching Quality in Higher Education

Agreement Between Teacher Self-Reports and Student Evaluations

Published Online:March 14, 2022https://doi.org/10.1027/1015-5759/a000700

Abstract

Abstract: Teaching quality is a crucial factor within higher education. Research on this topic often requires assessing teaching quality as a global construct through self-reports. However, such instruments are criticized due to the lack of alignment between teacher and student reports of instructional practices. We argue that while teachers might over- or under-estimate specific dimensions of teaching quality, the aggregation of these dimensions in the form of overarching teaching quality well reflects differences in teaching quality between teachers. Accordingly, we test a ten-item measure that allows faculty to self-report their teaching quality based on the aspects distinguished in the SEEQ (Marsh, 1982, 2007). Using 15,503 student assessments of teaching quality in 889 sessions taught by 97 faculty members, we conducted Doubly Latent Multi Level Modelling while considering bias and unfairness variables to model overarching teaching quality assessed by students, and simultaneously corrected for measurement error and potential distortions through the assessment situation. This global factor of teaching quality was strongly associated with teacher self-reported teaching quality (ρ = .74), which we interpret as evidence that global teacher reports of teaching quality can serve as sensible indicators of overarching teaching quality for nomothetic research in higher education.

References

  • Apodaca, P., & Grad, H. (2005). The dimensionality of student ratings of teaching. Studies in Higher Education, 30(6), 723–748. https://doi.org/10.1080/03075070500340101 First citation in articleCrossref, Google Scholar

  • Burdsal, C. A., & Harrison, P. D. (2008). Further evidence supporting the validity of both a multidimensional profile and an overall evaluation of teaching effectiveness. Assessment & Evaluation in Higher Education, 33(5), 567–576. https://doi.org/10.1080/02602930701699049 First citation in articleCrossref, Google Scholar

  • Clausen, M. (2002). Unterrichtsqualität [Reaching quality]. Waxmann. First citation in articleGoogle Scholar

  • Daumiller, M., Dickhäuser, O., & Dresel, M. (2019). University instructors’ achievement goals for teaching. Journal of Educational Psychology, 111(1), 131–148. https://doi.org/10.1037/edu0000271 First citation in articleCrossref, Google Scholar

  • Daumiller, M., Dresel, M., Rinas, R., & Janke, S. (2021). Data and materials for “Teaching quality in higher education: Agreement between teacher self-reports and student evaluations”. https://osf.io/2pnkx/ First citation in articleGoogle Scholar

  • Daumiller, M., Grassinger, R., Engelschalk, T., & Dresel, M. (2021). SEEQ-DE. Diagnostica, 67(4), 176–188. https://doi.org/10.1026/0012-1924/a000274 First citation in articleLink, Google Scholar

  • Daumiller, M., Siegel, S., & Dresel, M. (2019). Construction and validation of a Short Multidisciplinary Research Performance Questionnaire (SMRPQ). Research Evaluation, 28(3), 241–252. https://doi.org/10.1093/reseval/rvz009 First citation in articleCrossref, Google Scholar

  • Desimone, L. M., Smith, T. M., & Frisvold, D. E. (2010). Survey measures of classroom instruction. Educational Policy, 24(2), 267–329. https://doi.org/10/bdb76q First citation in articleCrossref, Google Scholar

  • Fauth, B., Göllner, R., Lenske, G., Praetorius, A. K., & Wagner, W. (2020). Who sees what? Zeitschrift für Pädagogik, 66(1), 138–155. https://doi.org/10.3262/ZPB2001138 First citation in articleGoogle Scholar

  • Kunter, M., & Baumert, J. (2006). Who is the expert. Learning Environments Research, 9(3), 231–251. https://doi.org/10.1007/s10984-006-9015-7 First citation in articleCrossref, Google Scholar

  • Lazarides, R., & Schiefele, U. (2021). The relative strength of relations between different facets of teacher motivation and core dimensions of teaching quality in mathematics. Learning and Instruction, 76, Article 101489. https://doi.org/10.1016/j.learninstruc.2021.101489 First citation in articleCrossref, Google Scholar

  • Marsh, H. W. (1982). SEEQ: A reliable, valid, and useful instrument for collecting students’ evaluations of university teaching. British Journal of Educational Psychology, 52(1), 77–95. https://doi.org/10.1111/j.2044-8279.1982.tb02505.x First citation in articleCrossref, Google Scholar

  • Marsh, H. (2007). Students’ evaluations of university teaching. In R. PerryJ. SmartEds., The scholarship of teaching and learning in higher education (pp. 319–383). Springer. First citation in articleGoogle Scholar

  • Porter, A. C. (2002). Measuring the content of instruction. Educational Researcher, 31(7), 3–14. https://doi.org/10.3102/0013189X031007003 First citation in articleCrossref, Google Scholar

  • Roche, L. A., & Marsh, H. (2002). Teaching self-concept in higher education. In N. HativaJ. GoodyearEds., Teacher thinking, beliefs and knowledge in higher education (pp. 179–218). Springer. First citation in articleCrossref, Google Scholar

  • Rollett, W.Bijlsma, H.Röhl, S. (Eds.). (2021). Student feedback on teaching in schools. Springer. https://doi.org/10.1007/978-3-030-75150-0 First citation in articleCrossref, Google Scholar

  • Wagner, W., Göllner, R., Werth, S., Voss, T., Schmitz, B., & Trautwein, U. (2016). Student and teacher ratings of instructional quality. Journal of Educational Psychology, 108(5), 705–721. https://doi.org/10.1037/edu0000075 First citation in articleCrossref, Google Scholar