Reliability and Construct Validity of a Child Self-Report Instrument
The Dominic Interactive
Abstract
Both clinicians and researchers agree on the value of self-report in child mental health assessment. The pictorial format of the computerized Dominic Interactive is an addition to the existing questionnaires, specifically concerning young children. Although prior studies on the Dominic Interactive reported favorable psychometric properties, the reliability was not always satisfactory for every scale, and no studies confirmed the proposed DSM-IV factor structure of the Dominic Interactive. This study examines these two psychometric aspects using a sample of 1,504 Dutch primary-school children aged 6–13 years. α was computed and compared with ω, an alternative index of reliability. CFA was conducted as was the measurement invariance at a configural, scalar, and metric level across both age and sex. The results showed that ω values were above .80, indicating good to high reliability for all scales. The DSM-IV factor structure was confirmed and proved to be identical across age groups and among both boys and girls in this sample. These findings lay the foundation for the meaningful use of the norms needed in clinical practice. They also contribute to the increasing value of the Dominic Interactive as a self-report instrument in child mental health screening.
References
1987). Diagnostic and statistical manual of mental disorders (3rd rev. ed.). Washington, DC: Author.
. (1994). Diagnostic and statistical manual of mental disorders (4th ed.). Washington, DC: Author.
. (1992). Aggregating data from multiple informants in child psychiatry epidemiological research. Journal of the American Academy of Child and Adolescent Psychiatry, 31, 78–85. doi 10.1097/00004583-199201000-00012
(1997). The Screen for Child Anxiety Related Emotional Disorders (SCARED): Scale construction and psychometric characteristics. Journal of the American Academy of Child & Adolescent Psychiatry, 36, 545–553. doi 10.1097/00004583-199704000-00018
(1993). Evaluation of the Diagnostic Interview for Children and Adolescents for use in general population samples. Journal of Abnormal Child Psychology, 21, 663–681. doi 10.1007/BF00916449
(2002). Evaluating goodness-of-fit indexes for testing measurement invariance. Structural Equation Modeling, 9, 233–255. doi 10.1207/S15328007SEM0902_5
(2000). Assessment of symptoms of DSM-IV anxiety and depression in children: A revised child anxiety and depression scale. Behavior Research and Therapy, 38, 835–855. doi 10.1016/S0005-7967(99)00130-8
(2001). Individual and cultural considerations concerning the mental health of children: Use of the Dominic-R. Revue Canadienne de Psychoéducation, 30, 119–138.
(1985). Age differences in the reliability of the psychiatric interview of the child. Child Development, 56, 265–275. doi 10.1111/j.1467-8624.1985.tb00104.x
(2004). Mental health problems in young children: Self-reports and significant others as informants. Psychology Science, 46, 123–140.
(1994). Determinants of reliability in psychiatric survey of children aged 6–12. Journal of Child Psychology and Psychiatry, 35, 1391–1408. doi 10.1111/j.1469-7610.1994.tb01282.x
(2009). Commentary on coefficient α: A cautionary tale. Psychometrika, 74, 121–135. doi 10.1007/S11336-008-9098-4
(2001). DSM-IV internal construct validity: When a taxonomy meets data. Journal of Child Psychology and Psychiatry, 42, 817–836. doi 10.1111/1469-7610.00778
(1999). Cut-off criteria for fit indices in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modelling, 6, 1–55. doi 10.1080/10705519909540118
(2001). A further look at the prognostic power of young children’s reports of depressed mood and feelings. Child Development, 72, 736–747. doi 10.1111/1467-8624.00312
(1999). Parent and child contributions to diagnosis of mental disorder: Are both informants always necessary? Journal of the American Academy of Child and Adolescent Psychiatry, 38, 1569–1579. doi 10.1097/00004583-199912000-00019
(1971). Statistical analysis of sets of congeneric tests. Psychometrika, 36, 109–133. doi 10.1007/BF02291393
(2011). Testing measurement invariance: A comparison of multiple-group categorical CFA and IRT. Structural Equation Modeling, 18, 212–228. doi 10.1080/10705511.2011.557337
(2008). Testing structural models of DSM-IV symptoms of common forms of child and adolescent psychopathology. Journal of Abnormal Child Psychology, 36, 187–206. doi 10.1007/s10802-007-9169-5
(2006). Psychometric properties of the Dominic Interactive assessment. A computerized self-report for children. Assessment, 13, 16–26. doi 10.1177/1073191105284843
(1997). The Multidimensional Anxiety Scale for Children (MASC): Factor structure, reliability, and validity. Journal of the American Academy of Child and Adolescent Psychiatry, 36, 554–565. doi 10.1097/00004583-199704000-00019
(1978). Generalizability in factorable domains: Domain validity and generalizability. Educational and Psychological Measurement, 38, 75–79. doi 10.1177/001316447803800111
(1999). Test theory: A unified treatment. Mahwah, NJ: Erlbaum.
(1984). A general structural equation model with dichotomous, ordered categorical and continuous latent variable indicators. Psychometrika, 49, 115–132. doi 10.1007/BF02294210
(1998–2007). MPLUS user’s guide (4th ed.). Los Angeles, CA: Author.
(2001). Applying developmental theory to the assessment and treatment of childhood disorders: Does it make a difference? Clinical Psychology and Psychotherapy, 8, 304–314. doi 10.1002/cpp.311
(2009). Coefficients α, β, ω, and the glb: Comments on Sijtsma. Psychometrika, 74, 145–154. doi 10.1007/S11336-008-9102-Z
(2003). Evaluating the fit of structural equation models: Test of significance and descriptive goodness-of-fit measures. Online edition of Methods of Psychological Research, 8(2), 23–74.
(1996). Uses and abuses of coefficient α. Psychological Assessment, 8, 350–353. doi 10.1037/1040-3590.8.4.350
(2011). On the changing role of Cronbach’s α in the evaluation of the quality of a measure. European Journal of Psychological Assessment, 27, 143–144. doi 10.1027/1015-5759/a000069
(2008). An exploratory study of the influences on response stability of the Interactive Dominic/Terry Questionnaire. Graduate Student Journal of Psychology, 10, 29–37.
(2009). Psychometric properties of the Dominic Interactive in a large French sample. The Canadian Journal of Psychiatry, 54, 767–776.
(2005). Evidence-based assessment of anxiety and its disorders in children and adolescents. Journal of Clinical Child and Adolescent Psychology, 34, 380–411. doi 10.1207/s15374424jccp3403_2
(2009). On the use, the misuse, and the very limited usefulness of Cronbach’s α. Psychometrika, 74, 107–120. doi 10.1007/S11336-008-9101-0
(1998). A measure of anxiety symptoms among children. Behavior Research and Therapy, 36, 545–566. doi 10.1016/S0005-7967(98)00034-5
(1998). Assessing measurement invariance in cross-national consumer research. The Journal of Consumer Research, 25, 78–90. doi 10.1086/209528
(in press ). The parent version of the Strengths and Difficulties Questionnaire: ω as an alternative to α and a test for measurement invariance. European Journal of Psychological Assessment.2000). Instruction manual for the Dominic Interactive. In , Dominic Interactive (CD-ROM). Montreal: DIMAT.
(2000). The Dominic-R: A pictorial interview for 6- to 11-year-old children. Journal of the American Academy of Child & Adolescent Psychiatry, 39, 85–93. doi 10.1097/00004583-200001000-00020
(2002). A French study of the Dominic Interactive. Social Psychiatry and Psychiatric Epidemiology, 37, 441–448. doi 10.1007/s00127-002-0575-2
(2005). Cronbach’s α, Revelle’s β, and McDonald’s ωh: Their relationship with each other and two alternative conceptualizations of reliability. Psychometrika, 70, 123–133. doi 10.1007/s11336-003-0974-7
(