Skip to main content
Brief Report

Measurement Invariance of Three Brief Emotion Regulation Questionnaires in People With and Without a History of Non-Suicidal Self-Injury

Published Online:https://doi.org/10.1027/1015-5759/a000464

Abstract. In this study, we investigated the factor structure and measurement invariance of three brief emotion regulation questionnaires in samples of young adults (17–30 years) with and without a history of non-suicidal self-injury (NSSI; n = 705–836). Results revealed configural, full metric, and full scalar invariance for the Difficulties in Emotion Regulation Scale – Short Form (DERS-SF) and the Cognitive Emotion Regulation Questionnaire – Short (CERQ-S). In addition, the CERQ-S also showed full residual error invariance. In contrast, the proposed factor structure of the Emotion Regulation Questionnaire (ERQ) was not confirmed in either sample. Further, we observed that some items function differently for people who self-injure and people who do not, which could result in artificial differences being reported in use of cognitive reappraisal. While the current findings offer confidence that observed differences using the DERS-SF and CERQ-S reflect reliable discrepancies in emotion regulation processes between people who self-injure and do not, the validity of statistical inferences using the ERQ could not be ensured and need further psychometric evaluation.

References

  • American Psychiatric Association. (2013). Diagnostic and statistical manual of mental disorders (5th ed.). Washington, DC: Author. First citation in articleCrossrefGoogle Scholar

  • Bentley, K. H., Nock, M. K., & Barlow, D. H. (2014). The four-function model of nonsuicidal self-injury: Key directions for future research. Clinical Psychological Science, 2, 638–656. https://doi.org/10.1177/2167702613514563 First citation in articleCrossrefGoogle Scholar

  • Brown, T. A. (2015). Confirmatory factor analysis for applied research (2nd ed.). New York, NY: Guilford Press. First citation in articleGoogle Scholar

  • Galesic, M., & Bosnjak, M. (2009). Effects of questionnaire length on participation and indicators of response quality in a web survey. Public Opinion Quarterly, 73, 349–360. https://doi.org/10.1093/poq/nfp031 First citation in articleCrossrefGoogle Scholar

  • Garnefski, N., & Kraaj, V. (2006). The Cognitive Emotion Regulation Questionnaire: Psychometric features and prospective relationships with depression and anxiety in adults. European Journal of Psychological Assessment, 23, 141–149. First citation in articleLinkGoogle Scholar

  • Garnefski, N., Kraaij, V., & Spinhoven, P. (2001). Negative life events, cognitive emotion regulation and emotional problems. Personality and Individual Differences, 30, 1311–1327. First citation in articleCrossrefGoogle Scholar

  • Gratz, K. L., & Roemer, L. (2004). Multidimensional assessment of emotion regulation and dysregulation: Development, factor structure, and initial validation of the Difficulties in Emotional Regulation Scale. Journal of Psychopathology and Behavioural Assessment, 26, 41–54. First citation in articleCrossrefGoogle Scholar

  • Gross, J. J., & John, O. P. (2003). Individual differences in two emotion regulation processes: Implications for affect, relationships, and well-being. Journal of Personality and Social Psychology, 85, 348–362. https://doi.org/10.1037/0022-3514.85.2.348 First citation in articleCrossrefGoogle Scholar

  • Hamza, C. A., & Willoughby, T. (2016). Nonsuicidal self-injury and suicidal risk among emerging adults. Journal of Adolescent Health, 59, 411–415. First citation in articleCrossrefGoogle Scholar

  • Hasking, P., Whitlock, J., Voon, D., & Rose, A. (2017). A cognitive-emotional model of NSSI: Using emotion regulation and cognitive processes to explain why people self-injure. Cognition & Emotion, 31, 1543–1556. https://doi.org/10.1080/02699931.2016.1241219 First citation in articleCrossrefGoogle Scholar

  • Ireland, M. J., Clough, B. A., & Day, J. J. (2017). The cognitive emotion regulation questionnaire: Factorial, convergent, and criterion validity analyses of the full and short versions. Personality and Individual Differences, 110, 90–95. https://doi.org/10.1016/j.paid.2017.01.035 First citation in articleCrossrefGoogle Scholar

  • Kaufman, E. A., Xia, M., Fosco, G., Yaptangco, M., Skidmore, C. R., & Crowell, S. E. (2015). The Difficulties in Emotion Regulation Scale Short Form (DERS-SF): Validation and replication in adolescent and adult samples. Journal of Psychopathology and Behavioral Assessment, 38, 443–455. https://doi.org/10.1007/s10862-015-9529-3 First citation in articleCrossrefGoogle Scholar

  • Kelada, L., Hasking, P., & Melvin, G. (2016). Adolescent NSSI and Recovery: The Role of Family Functioning and Emotion Regulation. Youth & Society. https://doi.org/10.1177/0044118X16653153 First citation in articleCrossrefGoogle Scholar

  • Kiekens, G., Claes, L., Demyttenaere, K., Auerbach, R. P., Green, J. G., Kessler, R. C., … Bruffaerts, R. (2016). Lifetime and 12‐month nonsuicidal self‐injury and academic performance in college freshmen. Suicide and Life-Threatening Behavior, 46, 563–576. https://doi.org/10.1111/sltb.12237 First citation in articleCrossrefGoogle Scholar

  • Klonsky, E. D., & Glenn, C. R. (2009). Assessing the functions of non-suicidal self-injury: Psychometric properties of the Inventory of Statements About Self-injury (ISAS). Journal of Psychopathology and Behavioral Assessment, 31, 215–219. https://doi.org/10.1007%2Fs10862-008-9107-z First citation in articleCrossrefGoogle Scholar

  • Klonsky, E. D., & Olino, T. M. (2008). Identifying clinically distinct subgroups of self-injurers among young adults: A latent class analysis. Journal of Consulting and Clinical Psychology, 76, 22–27. https://doi.org/10.1037/0022-006X.76.1.22 First citation in articleCrossrefGoogle Scholar

  • Meade, A. W., Johnson, E. C., & Braddy, P. W. (2008). Power and sensitivity of alternative fit indices in tests of measurement invariance. Journal of Applied Psychology, 93, 568–592. First citation in articleCrossrefGoogle Scholar

  • Melka, S. E., Lancaster, S. L., Bryant, A. R., & Rodriguez, B. F. (2011). Confirmatory factor and measurement invariance analyses of the emotion regulation questionnaire. Journal of Clinical Psychology, 67, 1283–1293. First citation in articleCrossrefGoogle Scholar

  • Muthén, L. K., & Muthén, B. O. (2012). Mplus version 7 user’s guide. Los Angeles, CA: Muthén & Muthén. First citation in articleGoogle Scholar

  • Nock, M. K., & Favazza, A. (2009). Nonsuicidal self-injury: Definition and classification. In M. K. NockEd., Understanding non-suicidal self-injury: Origins, assessment and treatment (pp. 9–18). Washington, DC: American Psychological Association. First citation in articleGoogle Scholar

  • Sass, D. (2011). Testing measurement invariance and comparing latent factor means within a confirmatory factor analysis framework. Journal of Psychoeducational Assessment, 29, 347–363. First citation in articleCrossrefGoogle Scholar

  • Spaapen, D. L., Waters, F., Brummer, L., Stopa, L., & Bucks, R. S. (2014). The Emotion Regulation Questionnaire: Validation of the ERQ-9 in two community samples. Psychological Assessment, 26, 46 First citation in articleCrossrefGoogle Scholar

  • Swannell, S., Martin, G., Page, A., Hasking, P., & St John, N. (2014). Prevalence of non-suicidal self-injury (NSSI) in non-clinical samples; Systematic review, meta-analysis and meta-regression. Suicide and Life-Threatening Behavior, 44, 273–303. First citation in articleCrossrefGoogle Scholar

  • Wiltink, J., Glaesmer, H., Canterino, M., Wölfling, K., Knebel, A., Kessler, H., … Beutel, M. E. (2011). Regulation of emotions in the community: Suppression and reappraisal strategies and its psychometric properties. Psycho-Social-Medicine, 8, 1–12. First citation in articleGoogle Scholar

  • Zelkowitz, R. L., Cole, D. A., Han, G. T., & Tomarken, A. J. (2016). The incremental utility of emotion regulation but not emotion reactivity in nonsuicidal self‐injury. Suicide and Life-Threatening Behavior, 46, 545–562. First citation in articleCrossrefGoogle Scholar