Psychometric Properties of the German Short Version of the Maslach Burnout Inventory – Student Survey
Abstract
Abstract.Background: Higher education is a challenging context in which students – particularly those endowed with a small array of resources – are susceptible to suffer from burnout. To screen, identify, and support students that are at risk of burnout, psychometrically robust instruments are essential. To this end, we extended the validation of the German short version of the Maslach Burnout Inventory – Student Survey (MBI-SS-KV) that allows measuring burnout among German-speaking university students. Method: We conducted a longitudinal study and analyzed the factorial validity, reliability, measurement invariance, and convergent as well as discriminant validity of the MBI-SS-KV in a sample of German university students (N = 1,435). Results: Our results replicated the original three-factor structure of the MBI-SS-KV. Yet, a bi-factor structure of the MBI-SS-KV – composed of a general factor (i.e., student burnout) and three domain-specific factors (i.e., emotional exhaustion, cynicism, and reduced professional efficacy) – revealed a comparable fit and was used for further analyses due to theoretical and methodological advantages. Based on the bi-factor structure of the MBI-SS-KV, nested models with increasing invariance constraints provided support for measurement invariance of this instrument across female and male university students and across time. Besides, the average variance extracted estimates and the comparisons of these estimates with shared variances demonstrated convergent and discriminant validity of the factors emotional exhaustion and cynicism, but not for the factor reduced professional efficacy. Conclusion: To sum up, we found that the MBI-SS-KV is a reliable and for the most part valid instrument for the assessment of student burnout in German higher education.
References
2011). Student burnout and engagement: A test of the conservation of resources theory. The Journal of Psychology, 145(3), 211–227. https://doi.org/10.1080/00223980.2011.555432
(2013). The relationship between academic procrastination and students’ burnout. Hacettepe Üniversitesi Eğitim Fakültesi Dergisi
([Hacettepe University Journal of Education] . 28(1), 53–63.1985). A conceptual model of nontraditional undergraduate student attrition. Review of Educational Research, 55(4), 485–540. https://doi.org/10.3102/00346543055004485
(1990). Comparative fit indexes in structural equation models. Psychological Bulletin, 107(2), 238–246. https://doi.org/10.1037/0033-2909.107.2.238
(1995). EQS structural equations program manual (Vol. 6). Multivariate software.
(2015). Confirmatory factor analysis for applied research (2nd ed.). Guilford Press.
(1998). Single sample cross-validation indices for covariance structures. Multivariate Behavioral Research, 24(4), 445–455. https://doi.org/10.1207/s15327906mbr2404_4
(2003). The issue of measurement invariance revisited. Journal of Cross-Cultural Psychology, 34(2), 155–175. https://doi.org/10.1177/0022022102250225
(2007). Sensitivity of goodness of fit indexes to lack of measurement invariance. Structural Equation Modeling, 14(3), 464–504. https://doi.org/10.1080/10705510701301834
(2006). A comparison of bifactor and second-order models of quality of life. Multivariate Behavioral Research, 41(2), 189–225. https://doi.org/10.1207/s15327906mbr4102_5
(2002). Evaluating goodness-of-fit indexes for testing measurement invariance. Structural Equation Modeling, 9(2), 233–255. https://doi.org/10.1207/S15328007SEM0902_5
(1988). Statistical power analysis for the social sciences (2nd ed.). Erlbaum.
(2003). A longitudinal cohort study of burnout and attrition in nursing students. Journal of Advanced Nursing, 43(1), 71–81. https://doi.org/10.1046/j.1365-2648.2003.02674.x
(2001). The job demands-resources model of burnout. Journal of Applied Psychology, 86(3), 499–512. https://doi.org/10.1037/0021-9010.86.3.499
(2010). Relationship between burnout and professional conduct and attitudes among US medical students. Journal of the American Medical Association, 304(11), 1173–1180. https://doi.org/10.1001/jama.2010.1318
(2008). Burnout and suicidal ideation among US medical students. Annals of Internal Medicine, 149(5), 334–341. https://doi.org/10.7326/0003-4819-149-5-200809020-00008
(2010). Applied missing data analysis, Guilford Press.
(2010). Insufficient discriminant validity: A comment on Bove, Pervan, Beatty, and Shiu (2009). Journal of Business Research, 63(3), 324–327. https://doi.org/10.1016/j.jbusres.2009.05.003
(2017). French validation of the Maslach Burnout Inventory – Student Survey (MBI-SS). Journal of Evaluation in Clinical Practice, 23(6), 1247–1251. https://doi.org/10.1111/jep.12771
(1981). Structural Equation models with unobservable variables and measurement error: Algebra and statistics. Journal of Marketing Research, 18(3), 382–388. https://doi.org/10.1177/002224378101800313
(2011). Burnout risk in medical students in Spain using the Maslach Burnout Inventory – Student Survey. International Archives of Occupational and Environmental Health, 84(4), 453–459. https://doi.org/10.1007/s00420-011-0623-x
(2013). Faktorstruktur und Gütekriterien der deutschen Übersetzung des Maslach-Burnout-Inventars für Studierende von Schaufeli et al. (MBI-SS).
([Factorial structure and psychometric criteria of the German translation of the Maslach Burnout Inventory-Student Version by Schaufeli et al. (MBI-SS)] . Psychotherapie Psychosomatik Medizinische Psychologie, 63(02), 77–84. https://doi.org/10.1055/s-0032-13236952014). Partial least squares structural equation modeling (PLS-SEM): An emerging tool in business research. European Business Review, 26(2), 106–121. https://doi.org/10.1108/EBR-10-2013-0128
(2012). An assessment of the use of partial least squares structural equation modeling in marketing research. Journal of the Academy of Marketing Science, 40(3), 414–433. https://doi.org/10.1007/s11747-011-0261-6
(2015). A new criterion for assessing discriminant validity in variance-based structural equation modeling. Journal of the Academy of Marketing Science, 43(1), 115–135. https://doi.org/10.1007/s11747-014-0403-8
(1989). Conservation of resources: A new attempt at conceptualizing stress. American Psychologist, 44(3), 513–524. https://doi.org/10.1037/0003-066X.44.3.513
(2002). Social and psychological resources and adaptation. Review of General Psychology, 6(4), 307–324. https://doi.org/10.1037/1089-2680.6.4.307
(1995).
(The structural equation modeling approach: Basic concepts and fundamental issues . In R. H. HoyleEd., Structural equation modeling: Concepts, issues, and applications (pp. 1–15). Sage.2009). The factorial validity of the Maslach Burnout Inventory – Student Survey in China. Psychological Reports, 105(2), 394–408. https://doi.org/10.2466/PR0.105.2.394-408
(2016). Burnout and alcohol abuse/dependence among US medical students. Academic Medicine, 91(9), 1251–1256. https://doi.org/10.1097/ACM.0000000000001138
(1969). A general approach to confirmatory maximum likelihood factor analysis. Psychometrika, 34(2), 183–202. https://doi.org/10.1007/BF02289343
(1971). Statistical analysis of sets of congeneric tests. Psychometrika, 36(2), 109–133. https://doi.org/10.1007/BF02291393
(2014). Life stress and academic burnout. Active Learning in Higher Education, 15(1), 77–90. https://doi.org/10.1177/1469787413514651
(2011). Longitudinal factorial invariance of the Maslach Burnout Inventory-General Survey among employees with job-related psychological health problems. Stress and Health, 27(4), 347–352. https://doi.org/10.1002/smi.1381
(1994). Longitudinal stability of latent means and individual differences: A unified approach. Structural Equation Modeling: A Multidisciplinary Journal, 1(4), 317–359. https://doi.org/10.1080/10705519409539984
(2012). The prevalence and correlations of medical student burnout in the pre-clinical years: A cross-sectional study. Psychology, Health & Medicine, 17(2), 188–195. https://doi.org/10.1080/13548506.2011.597770
(1999). Test theory: A unified treatment, Erlbaum.
(1993). Measurement invariance, factor analysis and factorial invariance. Psychometrika, 58(4), 525–543. https://doi.org/10.1007/BF02294825
(2014). A structural model of student well-being. South African Journal of Psychology, 44(4), 514–527. https://doi.org/10.1177/0081246314541589
(2011). Need for achievement, burnout, and intention to leave: Testing an occupational model in educational settings. Personality and Individual Differences, 50(2), 274–278. https://doi.org/10.1016/j.paid.2010.10.002
(1987). On structural equation modeling with data that are not missing completely at random. Psychometrika, 52(3), 431–462. https://doi.org/10.1007/BF02294365
(1998–2017). Mplus user’s guide.
(1994). Psychometric theory (3rd ed.). McGraw-Hill.
(2018). Measuring burnout among university students: Factorial validity, invariance, and latent profiles of the Italian version of the Maslach Burnout Inventory Student Survey (MBI-SS). Frontiers in Psychology, 9, Article 2105. https://doi.org/10.3389/fpsyg.2018.02105
(2015). Measuring job and academic burnout with the Oldenburg Burnout Inventory (OLBI): Factorial invariance across samples and countries. Burnout Research, 2(1), 8–18. https://doi.org/10.1016/j.burn.2014.11.001
(2013). Scoring and modeling psychological measures in the presence of multidimensionality. Journal of Personality Assessment, 95(2), 129–140. https://doi.org/10.1080/00223891.2012.725437
(2010). Bifactor models and rotations: Exploring the extent to which multidimensional data yield univocal scale scores. Journal of Personality Assessment, 92(6), 544–559. https://doi.org/10.1080/00223891.2010.496477
(2007). The role of the bifactor model in resolving dimensionality issues in health outcomes measures. Quality of Life Research, 16(1), 19–31. https://doi.org/10.1007/s11136-007-9183-7
(2019). The effectiveness, feasibility, and acceptability of a dialectical behaviour therapy skills training group in reducing burnout and psychological distress in psychology trainees: A pilot study. Australian Psychologist, 54(4), 292–301. https://doi.org/10.1111/ap.12389
(2016). Evaluating bifactor models: Calculating and interpreting statistical indices. Psychological Methods, 21(2), 137–150. https://doi.org/10.1037/met0000045
(2002). Burnout and engagement in university students: A cross-national study. Journal of Cross-Cultural Psychology, 33(5), 464–481. https://doi.org/10.1177/0022022102033005003
(1996).
(Maslach Burnout Inventory – General Survey . In C. MaslachS. E. JacksonM. P. LeiterEds., The Maslach Burnout Inventory – Test Manual (3rd ed., pp. 19–26). Consulting Psychologists Press.2005). The conceptualization and measurement of burnout: Common ground and worlds apart. Work & Stress, 19(3), 256–262. https://doi.org/10.1080/02678370500385913
(2003). Evaluating the fit of structural equation models: Tests of significance and descriptive goodness-of-fit measures. Methods of Psychological Research Online, 8(2), 23–74.
(2020). Is it still worth it? Applying expectancy-value theory to investigate the intraindividual motivational process of forming intentions to drop out from university. Motivation and Emotion, 44, 1–17. https://doi.org/10.1007/s11031-020-09822-w
(1975). Detection of correlated errors in longitudinal data. British Journal of Mathematical and Statistical Psychology, 28(2), 138–151. https://doi.org/10.1111/j.2044-8317.1975.tb00558.x
(2010). Psychological distress in university students: A comparison with general population data. Australian Psychologist, 45(4), 249–257. https://doi.org/10.1080/00050067.2010.482109
(1990). Structural model evaluation and modification: An interval estimation approach. Multivariate Behavioral Research, 25(2), 173–180. https://doi.org/10.1207/s15327906mbr2502_4
(1973). A reliability coefficient for maximum likelihood factor analysis. Psychometrika, 38(1), 1–10. https://doi.org/10.1007/BF02291170
(2012). A checklist for testing measurement invariance. European Journal of Developmental Psychology, 9(4), 486–492. https://doi.org/10.1080/17405629.2012.686740
(2017). The reliability of multidimensional neuropsychological measures: From alpha to omega. The Clinical Neuropsychologist, 31(6–7), 1113–1126. https://doi.org/10.1080/13854046.2017.1317364
(2010). Factorial invariance within longitudinal structural equation models: Measuring the same construct across time. Child Development Perspectives, 4(1), 10–18. https://doi.org/10.1111/j.1750-8606.2009.00110.x
(1997).
(Exploring the measurement invariance of psychological instruments: Applications in the substance use domain . In K. J. BryantM. WindleS. G. WestEds., The science of prevention: Methodological advances from alcohol and substance abuse research (pp. 281–324). American Psychological Association. https://doi.org/10.1037/10222-0092015). Validation of the German Short Version of the Maslach-Burnout – Inventory for Students (MBI-SS KV). Zeitschrift für Gesundheitspsychologie, 23(4), 193–198. https://doi.org/10.1026/0943-8149/a000146
(