Skip to main content
Search
Search
    Quick Search anywhere
    Quick search in Citations
Advanced Search
Skip main navigationClose Drawer MenuOpen Drawer Menu
Previous article
Next article
Original Article

Further Evidence for Criterion Validity and Measurement Invariance of the Luxembourg Workplace Mobbing Scale

Published Online:September 18, 2018https://doi.org/10.1027/1015-5759/a000483

Abstract

Abstract. Workplace mobbing has various negative consequences for targeted individuals and are costly to organizations. At present it is debated whether gender, age, or occupation are potential risk factors. However, empirical data remain inconclusive as measures of workplace mobbing so far lack of measurement invariance (MI) testing – a prerequisite for meaningful manifest between-group comparisons. To close this research gap, the present study sought to further elucidate MI of the recently developed brief Luxembourg Workplace Mobbing Scale (LWMS; Steffgen, Sischka, Schmidt, Kohl, & Happ, 2016) across gender, age, and occupational groups and to test whether these factors represent important risk factors of workplace mobbing. Furthermore, we sought to expand data on criterion validity of the LWMS with different self-report criterion measures such as psychological health (e.g., work-related burnout, suicidal thoughts), physiological health problems, organizational behavior (i.e., subjective work performance, turnover intention, and absenteeism), and with a self-labeling mobbing index. Data were collected via computer-assisted telephone interviews (CATI) in a representative sample of 1,480 employees working in Luxembourg (aged from 16 to 66; 45.7% female). Confirmatory factor analyses revealed scalar MI across gender and occupation as well as partial scalar invariance across age groups. None of these factors impacted on the level of workplace mobbing. Correlation and receiver operating characteristic (ROC) analyses strongly support the criterion validity of the LWMS. Due to its briefness while at the same time being robust against language, age, gender, and occupational group factors and exhibiting meaningful criterion validity, the LWMS is particularly attractive for large-scale surveys as well as for single-case assessment and, thus, general percentile norms are reported in the Electronic Supplementary Materials.

References

  • Agervold, M. (2007). Bullying at Work: A discussion of definitions and prevalence, based on an empirical study. Scandinavian Journal of Psychology, 48, 161–172. https://doi.org/10.1111/j.1467-9450.2007.00585.x First citation in articleCrossref, Google Scholar

  • Aquino, K. & Thau, S. (2009). Workplace victimization: Aggression from the target’s perspective. Annual Review of Psychology, 60, 717–741. https://doi.org/10.1146/annurev.psych.60.110707.163703 First citation in articleCrossref, Google Scholar

  • Babchishin, K. M. & Helmus, L.-M. (2016). The influence of base rates on correlations: An evaluation of proposed alternative effect sizes with real-world data. Behavior Research Methods, 48, 1021–1031. https://doi.org/10.3758/s13428-015-0627-7 First citation in articleCrossref, Google Scholar

  • Bowling, N. A. & Beehr, T. A. (2006). Workplace harassment from the victim’s perspective: A theoretical model and meta-analysis. Journal of Applied Psychology, 91, 998–1012. https://doi.org/10.1037/0021-9010.91.5.998 First citation in articleCrossref, Google Scholar

  • Breslau, N., Peterson, E. L., Schultz, L. R., Chilcoat, H. D. & Andreski, P. (1998). Major depression and stages of smoking. A longitudinal investigation. Archives of General Psychiatry, 55, 161–166. https://doi.org/10.1001/archpsyc.55.2.161 First citation in articleCrossref, Google Scholar

  • Byrne, B. M., Shavelson, R. J. & Muthén, B. (1989). Testing for the equivalence of factor covariance and mean structures: The issue of partial measurement invariance. Psychological Bulletin, 105, 456–466. https://doi.org/10.1037/0033-2909.105.3.456 First citation in articleCrossref, Google Scholar

  • Chen, F. F. (2007). Sensitivity of goodness of fit indexes to lack of measurement invariance. Structural Equation Modeling, 14, 464–504. https://doi.org/10.1080/10705510701301834 First citation in articleCrossref, Google Scholar

  • Cooper, M. L., Frone, M. R., Russell, M. & Mudar, P. (1995). Drinking to regulate positive and negative emotions: A motivational model of alcohol use. Journal of Personality and Social Psychology, 69, 990–1005. https://doi.org/10.1037/0022-3514.69.5.990 First citation in articleCrossref, Google Scholar

  • Cortina, L. M. & Magley, V. J. (2009). Patterns and profiles of response to incivility in the workplace. Journal of Occupational Health Psychology, 14, 272–288. https://doi.org/10.1037/a0014934 First citation in articleCrossref, Google Scholar

  • Cronbach, L. J. & Meehl, P. E. (1955). Construct validity in psychological tests. Psychological Bulletin, 52, 281–302. https://doi.org/10.1037/h0040957 First citation in articleCrossref, Google Scholar

  • Deci, E. L. & Ryan, R. M. (2008). Facilitating optimal motivation and psychological well-being across life’s domains. Canadian Psychology, 49, 14–23. https://doi.org/10.1037/0708-5591.49.1.14 First citation in articleCrossref, Google Scholar

  • Einarsen, S., Hoel, H. & Notelaers, G. (2009). Measuring exposure to bullying and harassment at work: Validity, factor structure and psychometric properties of the Negative Acts Questionnaire-Revised. Work & Stress, 23, 24–44. https://doi.org/10.1080/02678370902815673 First citation in articleCrossref, Google Scholar

  • Einarsen, S. & Raknes, B. J. (1997). Harassment in the workplace and the victimization of men. Violence and Victims, 12, 247–263. First citation in articleCrossref, Google Scholar

  • Einarsen, S. & Skogstad, A. (1996). Bullying at work: Epidemiological findings in public and private organizations. European Journal of Work and Organizational Psychology, 5, 185–201. https://doi.org/10.1080/13594329608414854 First citation in articleCrossref, Google Scholar

  • Fernet, C., Austin, S., Trépanier, S.-G. & Dussault, M. (2013). How do job characteristics contribute to burnout? Exploring the distinct mediating roles of perceived autonomy, competence, and relatedness. European Journal of Work and Organizational Psychology, 22, 123–137. https://doi.org/10.1080/1359432X.2011.632161 First citation in articleCrossref, Google Scholar

  • Finney, S. J. & DiStefano, C. (2013). Nonnormal and categorical data in structural equation modeling. In G. R. HancockR. O. MuellerEds., Structural equation modeling – a second course (2nd ed., pp. 439–492). Charlotte, NC: Information Age Publishing. First citation in articleGoogle Scholar

  • Hansen, A. M., Hogh, A., Garde, A. H. & Persson, R. (2014). Workplace bullying and sleep difficulties: A 2-year follow-up study. International Archives of Occupational and Environmental Health, 87, 285–294. https://doi.org/10.1007/s00420-013-0860-2 First citation in articleCrossref, Google Scholar

  • Hansen, A. M., Hogh, A., Persson, R., Karlson, B., Garde, A. H. & Ørbæk, P. (2006). Bullying at Work, Health Outcomes, and Physiological Stress Response. Journal of Psychosomatic Research, 60, 63–72. https://doi.org/10.1016/j.jpsychores.2005.06.078 First citation in articleCrossref, Google Scholar

  • Hauge, J. H., Skogstad, A. & Einarsen, S. (2009). Individual and situational predictors of workplace bullying: Why do perpetrators engage in the bullying of others? Work & Stress, 23, 349–358. https://doi.org/10.1080/02678370903395568 First citation in articleCrossref, Google Scholar

  • Hauge, J. H., Skogstad, A. & Einarsen, S. (2010). The relative impact of workplace bullying as a social stressor at work. Scandinavian Journal of Psychology, 51, 426–433. https://doi.org/10.1111/j.1467-9450.2010.00813.x First citation in articleGoogle Scholar

  • Hu, L. & Bentler, P. M. (1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling, 6, 1–55. https://doi.org/10.1080/10705519909540118 First citation in articleCrossref, Google Scholar

  • International Labour Organization. (Eds.). (2012). International standard classification of occupations: ISCO-08. Vol. 1. Structure, group definitions and correspondence tables. Geneva, Switzerland: International Labour Office. First citation in articleGoogle Scholar

  • Kivimäki, M., Head, J., Ferrie, J. E., Shipley, M. J., Brunner, E., Vahtera, J. & Marmot, M. G. (2006). Work stress, weight gain and weight loss: Evidence for bidirectional effects of job strain on body mass index in the Whitehall II study. International Journal of Obesity, 30, 982–987. https://doi.org/10.1038/sj.ijo.0803229 First citation in articleCrossref, Google Scholar

  • Kristensen, T. S., Borritz, M., Villadsen, E. & Christensen, K. B. (2005). The Copenhagen Burnout Inventory: A new tool for the assessment of burnout. Work & Stress, 19, 192–207. https://doi.org/10.1080/02678370500297720 First citation in articleCrossref, Google Scholar

  • Lazarus, R. S. & Folkman, S. (1984). Stress, appraisal and coping. New York, NY: Springer. First citation in articleGoogle Scholar

  • Leymann, H. (1996). Handanleitung für den LIPT-Fragebogen [Leymann Inventory of Psychological Terror]. Tübingen, Germany: Deutsche Gellschaft für Verhaltenstherapie Verlag. First citation in articleGoogle Scholar

  • Little, T. D. (2013). Longitudinal structural equation modeling. New York, NY: Guilford Press. First citation in articleGoogle Scholar

  • Little, T. D., Slegers, D. W. & Card, N. A. (2006). A non-arbitrary method of identifying and scaling latent variables in SEM and MACS models. Structural Equation Modeling, 13, 59–72. https://doi.org/10.1207/s15328007sem1301_3 First citation in articleCrossref, Google Scholar

  • Macht, M. (2008). How emotions affect eating: A five-way model. Appetite, 50, 1–11. https://doi.org/10.1016/j.appet.2007.07.002 First citation in articleCrossref, Google Scholar

  • Meade, A. W. & Bauer, D. J. (2007). Power and precision in confirmatory factor analytic tests of measurement invariance. Structural Equation Modeling, 14, 611–635. https://doi.org/10.1080/10705510701575461 First citation in articleCrossref, Google Scholar

  • Mikkelsen, E. G. & Einarsen, S. (2001). Bullying in Danish work-life: Prevalence and health correlates. European Journal of Work and Organizational Psychology, 10, 393–413. https://doi.org/10.1080/13594320143000816 First citation in articleCrossref, Google Scholar

  • Niedhammer, I., David, S. & Degioanni, S. (2007). Economic activities and occupations at high risk for workplace bullying: Results from a large-scale cross-sectional survey in the general working population in France. International Archives of Occupational and Environmental Health, 80, 346–353. https://doi.org/10.1007/s00420-006-0139-y First citation in articleCrossref, Google Scholar

  • Nielsen, M. B. & Einarsen, S. (2012). Outcomes of exposure to workplace bullying: A meta-analytic review. Work & Stress, 26, 309–332. https://doi.org/10.1080/02678373.2012.734709 First citation in articleCrossref, Google Scholar

  • Nielsen, M. B., Einarsen, S., Notelaers, G. & Nielsen, G. H. (2016). Does exposure to bullying behaviors at the workplace contribute to later suicidal ideation? A three-wave longitudinal study. Scandinavian Journal of Work, Environment & Health, 42, 246–250. https://doi.org/10.5271/sjweh.3554 First citation in articleGoogle Scholar

  • Nielsen, M. B., Matthiesen, S. B. & Einarsen, S. (2010). The impact of methodological moderators on prevalence rates of workplace bullying. A meta-analysis. Journal of Occupational and Organizational Psychology, 83, 955–979. https://doi.org/10.1348/096317909X481256 First citation in articleCrossref, Google Scholar

  • Ortega, A., Christensen, K. B., Hogh, A., Rugulies, R. & Borg, V. (2011). One-year prospective study on the effect of workplace bullying on long-term sickness absence. Journal of Nursing Management, 19, 752–759. https://doi.org/10.1111/j.1365-2834.2010.01179.x First citation in articleCrossref, Google Scholar

  • Ortega, A., Høgh, A., Pejtersen, J. H. & Olsen, O. (2009). Prevalence of workplace bullying and risk groups: A representative population study. International Archives of Occupational and Environmental Health, 82, 417–426. https://doi.org/10.1007/s00420-008-0339-8 First citation in articleCrossref, Google Scholar

  • Ortiz, Y. & Samaniego, C. (1995). A test of Steers and Rhodes’ Model of employees’ absence. In A. GonzálezA. de la Torrey. J. de ElenaEds., Work and organizational psychology. Human resources management and new technologies (pp. 237–246). Salamanca, Spain: Eudema. First citation in articleGoogle Scholar

  • Parzefall, M.-R. & Salin, D. M. (2010). Perceptions of and reactions to workplace bullying: A social exchange perspective. Human Relations, 63, 761–780. https://doi.org/10.1177/0018726709345043 First citation in articleCrossref, Google Scholar

  • Quine, L. (1999). Workplace bullying in NHS community trust: Staff questionnaire survey. British Medical Journal, 318, 228–232. https://doi.org/10.1136/bmj.318.7178.228 First citation in articleCrossref, Google Scholar

  • Rice, M. E. & Harris, G. T. (2005). Comparing effect sizes in follow-up studies: ROC area, Cohen’s d, and r. Law and Human Behavior, 29, 615–620. https://doi.org/10.1007/s10979-005-6832-7 First citation in articleCrossref, Google Scholar

  • Richer, S. F., Blanchard, C. & Vallerand, R. J. (2002). A motivational model of work turnover. Journal of Applied Social Psychology, 32, 2089–2113. https://doi.org/10.1111/j.1559-1816.2002.tb02065.x First citation in articleCrossref, Google Scholar

  • Richman, J. A., Rospenda, K. M., Flaherty, J. A. & Freels, S. (2001). Workplace harassment, active coping, and alcohol-related outcomes. Journal of Substance Abuse, 13, 347–366. https://doi.org/10.1016/s0899-3289(01)00079-7 First citation in articleCrossref, Google Scholar

  • R Core Team. (2017). R: A language and environment for statistical computing. Vienna, Austria: R Foundation for Statistical Computing. First citation in articleGoogle Scholar

  • Salin, D. (2003). The significance of gender in the prevalence, forms and perceptions of bullying. Nordiske Organisasjonsstudier, 5, 30–50. Retrieved from http://hdl.handle.net/10227/290 First citation in articleGoogle Scholar

  • Salin, D. & Hoel, H. (2011). Organisational causes of workplace bullying. In S. EinarsenH. HoelD. ZapfC. L. CooperEds., Bullying and harassment in the workplace. Developments in theory, research, and practice (2nd ed., pp. 227–243). Boca Raton, FL: CRC Press. First citation in articleGoogle Scholar

  • Salin, D. & Hoel, H. (2013). Workplace bullying as a gendered phenomenon. Journal of Managerial Psychology, 28, 235–251. https://doi.org/10.1108/02683941311321187 First citation in articleCrossref, Google Scholar

  • Satorra, A. & Bentler, P. M. (2001). A scaled difference chi-square test statistic for moment structure analysis. Psychometrika, 66, 507–514. https://doi.org/10.1007/BF02296192 First citation in articleCrossref, Google Scholar

  • Schaufeli, W. B., Bakker, A. B. & Salanova, M. (2006). The measurement of work engagement with a short questionnaire a cross-national study. Educational and Psychological Measurement, 66, 701–716. https://doi.org/10.1177/0013164405282471 First citation in articleCrossref, Google Scholar

  • Simons, S. R., Stark, R. B. & DeMarco, R. F. (2011). A new, four-item instrument to measure workplace bullying. Research in Nursing & Health, 34, 132–140. https://doi.org/10.1002/nur.20422 First citation in articleGoogle Scholar

  • Sischka, P. & Steffgen, G. (2016). Quality of Work-Index. 2. Forschungsbericht zur Weiterentwicklung des Arbeitsqualitätsindexes in Luxembourg [2nd Research report for the enhancement of the quality of work index in Luxembourg] (Working Paper). Luxembourg: Universität Luxemburg. First citation in articleGoogle Scholar

  • Steenkamp, J.-B. E. M. & Baumgartner, H. (1998). Assessing measurement invariance in cross-national consumer research. Journal of Consumer Research, 25, 78–90. https://doi.org/10.1086/209528 First citation in articleCrossref, Google Scholar

  • Steers, R. M. & Rhodes, S. R. (1984). Knowledge and speculation about absenteeism. In P. S. GoodmanR. S. AtkinEds., Absenteeism: New approaches to understanding, measuring and managing absence (pp. 229–275). San Francisco, CA: Jossey-Bass. First citation in articleGoogle Scholar

  • Steinmetz, H. (2013). Analyzing observed composite differences across groups. Is partial measurement invariance enough? Methodology, 9, 1–12. https://doi.org/10.1027/1614-2241/a000049 First citation in articleLink, Google Scholar

  • Steffgen, G., Sischka, P., Schmidt, A. F., Kohl, D. & Happ, C. (2016). The Luxembourg Workplace Mobbing Scale. Psychometric properties of a short instrument in three different languages. European Journal of Psychological Assessment. Advance online publication. https://doi.org/10.1027/1015-5759/a000381 First citation in articleLink, Google Scholar

  • Swets, J. A. (1986). Indices of discrimination or diagnostic accuracy: Their ROCs and implied models. Psychological Bulletin, 99, 100–117. https://doi.org/10.1037/0033-2909.99.1.100 First citation in articleCrossref, Google Scholar

  • Topp, C. W., Østergaard, S. D., Søndergaard, S. & Bech, P. (2015). The WHO-5 Well-Being Index: A systematic review of the literature. Psychotherapy and Psychosomatics, 84, 167–176. https://doi.org/10.1159/000376585 First citation in articleCrossref, Google Scholar

  • Trépanier, S.-G., Fernet, C. & Austin, S. (2015). A longitudinal investigation of workplace bullying, basic need satisfaction, and employee functioning. Journal of Occupational Health Psychology, 20, 105–116. https://doi.org/10.1037/a0037726 First citation in articleCrossref, Google Scholar

  • Vandenberg, R. J. & Lance, C. E. (2000). A review and synthesis of the measurement invariance literature: Suggestions, practices, and recommendations for organizational research. Organizational Research Methods, 3, 4–70. https://doi.org/10.1177/109442810031002 First citation in articleCrossref, Google Scholar

  • Van den Broeck, A., Vansteenkiste, M., De Witte, H. & Lens, W. (2008). Explaining the relationships between job characteristics, burnout, and engagement: The role of basic psychological need satisfaction. Work & Stress, 22, 277–294. https://doi.org/10.1080/02678370802393672 First citation in articleCrossref, Google Scholar

  • Van den Broeck, A., Vansteenkiste, M., De Witte, H., Soenens, B. & Lens, W. (2010). Capturing autonomy, competence, and relatedness at work: Construction and initial validation of the Work-related Basic Need Satisfaction scale. Journal of Occupational and Organizational Psychology, 83, 981–1002. https://doi.org/10.1348/096317909X481382 First citation in articleCrossref, Google Scholar

  • van de Schoot, R., Lugtig, P. & Hox, J. (2012). A checklist for testing measurement invariance. European Journal of Developmental Psychology, 9, 486–492. https://doi.org/10.1080/17405629.2012.686740 First citation in articleCrossref, Google Scholar

  • Van Orden, K. A., Wite, T. K., Cukrowciz, K. C., Braithwaite, S. R., Selby, E. A. & Joiner, T. E. (2010). The interpersonal theory of suicide. Psychological Review, 117, 575–600. https://doi.org/10.1037/a0018697 First citation in articleCrossref, Google Scholar

  • Widaman, K. F. & Reise, S. P. (1997). Exploring the measurement invariance of psychological instruments: Applications in the substance use domain. In K. J. BryantM. WindleS. G. WestEds., The science of prevention: Methodological advances from alcohol and substance abuse research (pp. 281–324). Washington, DC: American Psychological Association. First citation in articleGoogle Scholar

  • World Health Organization. Regional Office for Europe. (1998). Well-Being measures in primary health care: The DiabCare Project. Consensus meeting, Stockholm, Sweden. First citation in articleGoogle Scholar

  • Zapf, D., Escartín, J., Einarsen, S., Hoel, H. & Vartia, M. (2011). Empirical findings on prevalence and risk groups of bullying in the workplace. In S. EinarsenH. HoelD. ZapfC. L. CooperEds., Bullying and harassment in the workplace. Developments in theory, research, and practice (2nd ed., pp. 75–105). Boca Raton, FL: CRC Press. First citation in articleGoogle Scholar

  • Zhao, H., Wayne, S. J., Glibkowski, B. C. & Bravo, J. (2007). The impact of psychological contract breach on work-related outcomes: A meta-analysis. Personnel Psychology, 60, 647–680. https://doi.org/10.3724/sp.j.1042.2012.01296 First citation in articleCrossref, Google Scholar