Skip to main content
Search
Search
    Quick Search anywhere
    Quick search in Citations
Advanced Search
Skip main navigationClose Drawer MenuOpen Drawer Menu
Previous article
Next article
Original Article

Do They Rate in the Same Way?

Testing of Measurement Invariance Across Parent and Teacher SDQ Ratings

Published Online:November 29, 2017https://doi.org/10.1027/1015-5759/a000445

Abstract

Abstract. The internal structure of the Strengths and Difficulties Questionnaire (SDQ) has been widely discussed in the literature. The first purpose of this study was, therefore, to analyze the internal structure of the SDQ as completed by German parents and teachers. Parents and teachers of 1,135 children between the ages of 3 and 6 years in German daycare facilities were asked to complete the SDQ. Using confirmatory factor analysis (CFA), we found that the original five-factor model with added correlations between items with similar content and allowing cross-loads of reverse-worded items to the prosocial behavior factor is the model that fits the data the best. Additionally, we found significant mean differences between parents and teachers in four of the five SDQ subscales. Nevertheless, to compare the scores across both groups, it is necessary that the SDQ measures social-emotional and behavioral difficulties for both parents and teachers in the same way. Hence, the second purpose of this study was to test for measurement invariance of the SDQ across both groups. Using multigroup confirmatory factor analysis (MGCFA), we found that strict measurement invariance is tenable. Therefore, the observed means of the SDQ scores from parents and teachers are readily comparable and interpretable.

References

  • Achenbach, T. (1991). Manual for the child behavior checklist 4–18 and 1991 profile. Burlington, VT: University of Vermont. Department of Psychology. First citation in articleGoogle Scholar

  • Achenbach, T., McConaughy, S. & Howell, C. (1987). Child/adolescent behavioral and emotional problems: Implications of cross-informant correlations for situational specificity. Psychological Bulletin, 101, 213–232. https://doi.org/10.1037/0033-2909.101.2.213 First citation in articleCrossref, Google Scholar

  • Acock, A. (2013). Discovering structural equation modeling using Stata. College Station, TX: Stata Press. First citation in articleGoogle Scholar

  • Becker, A., Woerner, W., Hasselhorn, M., Banaschewski, T. & Rothenberger, A. (2004). Validation of the parent and teacher SDQ in a clinical sample. European Journal of Child and Adolescent, 13, 11–16. First citation in articleCrossref, Google Scholar

  • Bekker, J., Bruck, D. & Seiberras, E. (2013). Congruent validity of the Strength and Difficulties Questionnaire to screen for comorbidities in children with ADHD. Journal of Attention Disorders, 23, 879–888. https://doi.org/10.1177/1087054713496462 First citation in articleGoogle Scholar

  • Brown, T. (2006). Confirmatory factor analysis for applied research. New York, NY: The Guilford Press. First citation in articleGoogle Scholar

  • Burstein, M. & Schmitz, A. (2012). The Strengths and Difficulties Questionnaire (SDQ): The factor structure and scale validation in US adolescents. Journal of Abnormal Child Psychology, 41, 583–595. First citation in articleGoogle Scholar

  • Byrne, B. & Stewart, S. (2006). The MACS approach to testing for multigroup invariance of a second-order structure: A walk through the process. Structural Equitation Modeling, 13, 287–321. First citation in articleCrossref, Google Scholar

  • Cefai, C., Camilleri, L., Cooper, P. & Said, L. (2011). The structure and use of the teacher and parent maltase Strengths and Difficulties Questionnaire. The International Journal of Emotional Education, 3, 4–19. First citation in articleGoogle Scholar

  • Chen, F. (2007). Sensitivity of goodness of fit indexes to lack of measurement invariance. Structural Equitation Modeling, 14, 464–504. First citation in articleCrossref, Google Scholar

  • Chen, F. (2008). What happens if we compare chopsticks with forks? The impact of making inappropriate comparisons in cross-cultural research. Journal of Personality and Social Psychology, 95, 1005–1018. First citation in articleCrossref, Google Scholar

  • Chiorri, C., Hall, J., Casely-Hayford, J. & Malmberg, L. (2015). Evaluating measurement invariance between parents using the Strengths and Difficulties Questionnaire (SDQ). Assessment, 23, 63–74. First citation in articleCrossref, Google Scholar

  • Cieciuch, J., Davidov, E., Oberski, D. & Algesheimer, R. (2015). Testing for measurement invariance by detecting local misspecification and an illustration across online and paper-and-pencil samples. European Political Science, 14, 521–538. First citation in articleCrossref, Google Scholar

  • Davidov, E. (2010). Nationalism and constructive patriotism: A longitudinal test of comparability in 22 countries with the ISSP. International Journal of Public Opinion Research, 23, 88–103. First citation in articleCrossref, Google Scholar

  • De Los Reyes, A. & Kazdin, A. E. (2005). Informant discrepancies in the assessment of childhood psychopathology: A critical review, theoretical framework, and recommendations for further study [Review]. Psychological Bulletin, 131, 483–509. First citation in articleCrossref, Google Scholar

  • Di Riso, D., Salcuni, S., Chessa, D., Raudino, A., Lis, A. & Altoe, G. (2010). The Strengths and Difficulties Questionnaire (SDQ). Early evidence of its reliability and validity in a community sample of Italian children. Personality and Individual Differences, 49, 570–575. First citation in articleCrossref, Google Scholar

  • Dickey, W. & Blumberg, S. (2004). Revisiting the factor structure of the Strengths and Difficulties Questionnaire. Journal of the American Academy of Child Psychiatry, 43, 1159–1167. First citation in articleCrossref, Google Scholar

  • Essau, C., Olaya, B., Anastassiou-Hadjicharalambous, X., Pauli, G., Gilvarry, C., Bray, D., … Ollendick, T. H. (2012). Psychometric properties of the Strength and Difficulties Questionnaire from five European countries. International Journal of Methods in Psychiatric Research, 21, 232–245. First citation in articleCrossref, Google Scholar

  • Ezpeleta, L., Grancro, R., de la Osa, N., Penelo, E. & Domenech, J. (2012). Psychometric properties of the Strengths and Difficulties Questionnaire in 3-year-old preschoolers. Comprehensive Psychiatry, 25, 364–374. First citation in articleGoogle Scholar

  • Goodman, R. (1997). The Strengths and Difficulties Questionnaire: A research note. Journal of Child Psychology and Psychiatry, 38, 581–586. First citation in articleCrossref, Google Scholar

  • Goodman, R. (2001). Psychometric properties of the Strengths and Difficulties Questionnaire. Journal of the American Academy of Child and Adolescent Psychiatry, 40, 1337–1345. First citation in articleCrossref, Google Scholar

  • Goodman, R., Ford, T., Simmons, H., Gatward, R. & Meltzer, H. (2000). Using the Strengths and Difficulties Questionnaire (SDQ) to screen for child psychiatric disorders in a community sample. The British Journal of Psychiatry, 177, 534–539. First citation in articleCrossref, Google Scholar

  • Goodman, R., Lamping, D. & Ploubidis, G. (2010). When to use broader internalizing and externalizing subscales instead of the hypothesized five subscales on the Strengths and Difficulties Questionnaire (SDQ): Data from British parents, teachers and children. Journal of Abnormal Child Psychology, 38, 1179–1191. First citation in articleCrossref, Google Scholar

  • Goodman, R., Renfrew, D. & Mullick, M. (2000). Predicting type of psychiatric disorder from Strengths and Difficulties Questionnaire (SDQ) scores in child mental health clinics in London and Dhaka. European Child and Adolescent Psychiatry, 9, 129–134. First citation in articleCrossref, Google Scholar

  • Grietens, H., Onghena, P., Prinzie, P., Gadeyne, E., Van Assche, V., Ghesquiere, P. & Hellinckx, W. (2004). Comparisons of mothers, fathers and teachers report on problem behaviors in 5- to 6-year old children. Journal of Psychopathology and Behavioral Assessment, 26, 137–146. First citation in articleCrossref, Google Scholar

  • Hill, C. & Hughes, J. (2007). An examination of the convergent and discriminant validity of the Strengths and Difficulties Questionnaire. School Psychology Quarterly, 22, 380–406. First citation in articleCrossref, Google Scholar

  • Hölling, H., Schlack, R., Petermann, F., Ravens-Sieberer, U. & Mauz, E (2014). Psychische Auffälligkeiten und psychosoziale Beeinträchtigungen bei Kindern und Jugendlichen im Alter von 3 bis 17 Jahren in Deutschland-Prävalenz und zeitliche Trends zu 2 Erhebungszeitpunkten (2003–2006 und 2009–2012) [Psychopathological problems and psychosocial impairment in children and adolescents aged 3–17 years in the German population: Prevalence and time trends at two measurement points (2003–2006 and 2009–2012)]. Results of the KiGGS study: first follow-up (KiGGS Wave 1). Bundesgesundheitsblatt-Gesundheitsforschung-Gesundheitsschutz, 57, 807–819. First citation in articleCrossref, Google Scholar

  • Horn, J. & McArdle, J. (1992). A practical and theoretical guide to measurement invariance in aging research. Experimental Aging Research, 18, 117–144. First citation in articleCrossref, Google Scholar

  • Kersten, P., Czuba, K., McPherson, K., Dudley, M., Hinemoa, E., Tauroa, R. & Vandal, A. (2015). A systematic review of evidence for the psychometric properties of the Strengths and Difficulties Questionnaire. International Journal of Behavioral Development, 40, 64–75. First citation in articleCrossref, Google Scholar

  • Knafl, G. & Grey, M. (2007). Factor analysis model evaluation through likelihood cross-validation. Statistical Methods in Medical Research, 16, 77–102. First citation in articleCrossref, Google Scholar

  • Kristoffersen, J. & Smith, N. (2013). Gender Differences in the effects of behavioral problems on school outcomes. Working Paper. Retrieved from ftp.iza.org/dp7410.pdf First citation in articleGoogle Scholar

  • Kuschel, A., Heinrichs, N., Betram, H., Naumann, S. & Hahlweg, K. (2007). Wie gut stimmen Eltern und Erziehrinnen in der Beurteilung von Verhaltensproblemen bei Kindergartenkindern überein? [How well do parent’s and teacher’s reports agree on behavior problems in pre-school aged children?] Zeitschrift für Kinder- und Jugendpsychiatrie und Psychotherapie, 35, 51–58. First citation in articleLink, Google Scholar

  • Mathai, J., Anderson, P. & Bourne, A. (2004). Comparing psychiatric diagnoses generated by the Strengths and Difficulties Questionnaire with diagnoses made by clinicians. Australian and New Zealand Journal of Psychiatry, 38, 639–643. First citation in articleCrossref, Google Scholar

  • Mieloo, C., Raat, H., van Oort, F., Bevaart, F., Vogel, I., Donker, M. & Jansen, W. (2012). Validity and reliability of the Strengths and Difficulties Questionnaire in 5–6 year olds: Differences by gender of parental education? PLoS One, 7, 1–8. First citation in articleCrossref, Google Scholar

  • Muthén, L. & Muthén, B. (2007). Mplus. Statistical analysis with latent variables. User’s guide (5th ed.). Los Angeles, CA: Muthén and Muthén. First citation in articleGoogle Scholar

  • Niclasen, J., Skovgaard, A., Andersen, A., Somhovd, M. & Obel, C. (2012). A confirmatory approach to examining the factor structure of the Strengths and Difficulties Questionnaire (SDQ): A large scale cohort study. Journal of Abnormal Child Psychology, 41, 355–365. First citation in articleCrossref, Google Scholar

  • Ortuño-Sierra, J., Fonseca-Pedrero, F., Aritio-Solana, R., Moreno Velasco, A., Chocarro de Luis, E., Schumann, G., … Lawrence, C. (2015). New evidence of factor structure and measurement invariance of the SDQ across five European nations. European Child and Adolescent Psychiatry, 24, 1523–1534. First citation in articleCrossref, Google Scholar

  • Percy, A., McCristal, P. & Higgins, K. (2008). Confirmatory factor analysis of the adolescent self-report Strengths and Difficulties Questionnaire. European Journal of Psychological Assessment, 24, 43–48. https://doi.org/10.1027/1015-5759.24.1.43 First citation in articleLink, Google Scholar

  • Petermann, U., Petermann, F. & Schreyer, I. (2010). The German Strengths and Difficulties Questionnaire (SDQ) validity of the teacher version for preschoolers. European Journal of Psychological Assessment, 26, 256–262. https://doi.org/10.1027/1015-5759/a000034 First citation in articleLink, Google Scholar

  • Rademacher, A., Koglin, U. & Petermann, F. (2016). Psychosoziale Gesundheit von Kindergartenkindern im Urteil der Eltern und der Pädagogischen Fachkräfte [Parent and kindergarten teacher report of psychosocial kindergarteners]. Monatszeitschrift für Kinderheilkunde, 5, 386–392. First citation in articleCrossref, Google Scholar

  • Rothenberger, A., Becker, A., Erhart, M., Wille, N., Ravens-Sieberer, U. & The BELLA Study Group. (2008). Psychometric properties of the parent strengths and difficulties questionnaire in the general population of German children and adolescents: Results of the BELLA study. European Child and Adolescent Psychiatry, 17, 99–105. First citation in articleCrossref, Google Scholar

  • Ruchkin, V., Jones, S., Vermeiren, R. & Schwab-Stone, M. (2008). The Strengths and Difficulties Questionnaire: The self-reported version in American urban and suburban youth. Psychological Assessment, 20, 175–182. First citation in articleCrossref, Google Scholar

  • Ruchkin, V., Koposov, R. & Schwab-Stone, M. (2007). The Strengths and Difficulties Questionnaire: Scale validation with Russian adolescents. Journal of Clinical Psychology, 63, 861–869. First citation in articleCrossref, Google Scholar

  • Steenkamp, J. & Baumgartner, H. (1998). Assessing measurement invariance in cross-national consumer research. Journal of Consumer Research, 25, 78–90. First citation in articleCrossref, Google Scholar

  • Stone, L., Otten, R., Engels, R., Vermulst, A. & Janssens, J. (2010). Psychometric properties of the parent and teacher versions of the Strengths and Difficulties Questionnaire for 4 to 12 year-olds: A review. Clinical Child and Family Psychology Review, 13, 254–274. First citation in articleCrossref, Google Scholar

  • Stone, L., Otten, R., Ringlever, L., Hiemstra, M., Engels, R., Vermulst, A. & Janssens, J. (2013). The parent version of the Strengths and Difficulties Questionnaire omega as an alternative to alpha and a test for measurement invariance. European Journal of Psychological Assessment, 29, 44–50. https://doi.org/10.1027/1015-5759/a000119 First citation in articleLink, Google Scholar

  • Svedin, C. & Priebe, G. (2008). The Strengths and Difficulties Questionnaire as a screening instrument in a community sample of high school seniors in Sweden. Nordic Journal of Psychiatric, 62, 225–232. First citation in articleCrossref, Google Scholar

  • Van Leeuwen, K., Meerschaert, T., Bosmans, G., De Medts, L. & Braet, C. (2006). The Strengths and Difficulties Questionnaire in a community sample of young children in Flanders. European Journal of Psychological Assessment, 22, 189–197. https://doi.org/10.1027/1015-5759.22.3.189 First citation in articleLink, Google Scholar

  • Van de Looij-Jansen, P., Goedhart, A., de Wilde, E. & Treffers, P. (2011). Confirmatory factor analysis and factorial invariance analysis of the adolescent self-reported Strengths and Difficulties Questionnaire: How important are method effects and minor factors? The British Journal of Clinical Psychology, 50, 127–144. First citation in articleCrossref, Google Scholar

  • Van Roy, B., Veenstra, M. & Clench-Aas, J. (2008). Construct validity of the five factor Strengths and Difficulties Questionnaire (SDQ) in pre-, early, and late adolescence. Journal of Child Psychology and Psychiatry, 49, 1304–1312. First citation in articleCrossref, Google Scholar

  • Wu, A., Li, Z. & Zumbo, B. (2007). Decoding the meaning of factorial invariance and updating the practice of multi-group confirmatory factor analysis: A demonstration with TIMSS data. Practical Assessment Research and Evaluation, 12, 1–26. First citation in articleGoogle Scholar

  • Zhang, Y., Jing, Z., McWhinnie, C. & Abela, J. (2009). Measuring adolescent psychopathology: Psychometric properties of the self-report Strengths and Difficulties Questionnaire in a sample of Chinese adolescents. Journal of Adolescence Health, 45, 55–62. First citation in articleCrossref, Google Scholar