Cross-Informant Disagreement on Behavioral Symptoms in Adolescent Attention-Deficit/Hyperactivity Disorder and Its Impact on Treatment Effects
Abstract
Abstract. In assessing adolescent behavior difficulties, parents, teachers, and the adolescents themselves are key informants. However, substantial disagreement has been found between informants. Specifically, children with attention-deficit/hyperactivity disorder (ADHD) tend to overestimate their competencies, also known as “positive (illusionary) bias.” This study compared parent, teacher, and adolescent ratings of ADHD and other behavioral symptoms in a sample of 114 adolescents with ADHD. Further, the effect of cross-informant disagreement (CID) on treatment outcomes was investigated in a subsample of 54 adolescents who had undergone a training and coaching intervention. Overall, there was moderate agreement among informants. Parent and adolescent ratings were more strongly correlated with each other than with teacher ratings. The strongest discrepancy was found between teacher and adolescent ratings on prosocial behavior. This discrepancy explained 12% of the variance in parent-rated ADHD symptom severity after the intervention. The treatment was less effective in participants with high teacher-adolescent disagreement on prosocial behavior (d = 0.41) than with low disagreement (d = 0.98). These findings suggest that professionals working with adolescents with ADHD should consider multiple sources of information before initiating treatment and pay attention to cross-informant disagreements because these may indicate a risk of diminished treatment effects.
References
1987). Child/adolescent behavioral and emotional problems: Implications of cross-informant correlations for situational specificity. Psychological Bulletin, 101, 213–232. https://doi.org/10.1037/0033-2909.101.2.213
(2000). Diagnostic and statistical manual of mental disorders (4th ed., text rev.). Washington, DC: Author.
. (2004). Evaluation of the self-reported SDQ in a clinical setting: Do self-reports tell us more than ratings by adult informants? European Child and Adolescent Psychiatry, 13, 17–24. https://doi.org/10.1007/s00787-004-2004-4
(2004). Validation of the parent and teacher SDQ in a clinical sample. European Child and Adolescent Psychiatry, 13, 11–16. https://doi.org/10.1007/s00787-004-2003-5
(2011). The impact of teacher credentials on ADHD stigma perceptions. Psychology in the Schools, 48, 184–197. https://doi.org/10.1002/pits.20536
(2009). Die Erfassung von Merkmalen von Aufmerksamkeitsdefizit-/Hyperaktivitätsstörungen (ADHS) anhand von Lehrerurteilen: Zur Validität und Reliabilität des FBB-HKS
([The assessment of attention deficit hyperactivity disorder (ADHD) by teacher ratings – Validity and reliability of the FBB-HKS] . Zeitschrift für Kinder- und Jugendpsychiatrie und Psychotherapie, 37, 431–440. https://doi.org/10.1024/1422-4917.37.5.4312012). Willingness to use ADHD treatments: A mixed methods study of perceptions by adolescents, parents, health professionals and teachers. Social Science & Medicine, 74, 92–100. https://doi.org/10.1016/j.socscimed.2011.10.009
(2015). The validity of the multi-informant approach to assessing child and adolescent mental health. Psychological Bulletin, 141, 858–900. https://doi.org/10.1037/a0038498
(2012). Annual research review: Embracing not erasing contextual variability in children’s behavior – Theory and utility in the selection and use of methods and informants in developmental psychopathology. Journal of Child Psychology and Psychiatry, 54, 558–574. https://doi.org/10.1111/j.1469-7610.2012.02537.x
(2008). DISYPS-II: Diagnostik-System für Psychische Störungen nach ICD-10 und DSM-IV für Kinder und Jugendliche – II
([DISYPS-II: Diagnostical system for psychiatric disorders according to ICD-10 and DSM-IV for children and adolescents–II] . Bern, Switzerland: Huber.2006). Diagnostik-System für psychische Störungen im Kindes- und Jugendalter nach ICD-10 und DSM-IV (DISYPS-KJ)
([Diagnostical system for psychiatric disorders in childhood and adolescence (DISYPS-KJ)] . Bern, Switzerland: Huber.2007). Perceptions of academic skills of children diagnosed with ADHD. Journal of Attention Disorders, 10, 390–397. https://doi.org/10.1177/1087054706292105
(2008). Psychometric properties of two ADHD questionnaires: Comparing the Conners’ scale and the FBB-HKS in the general population of German children and adolescents – Results of the BELLA study. European Child and Adolescent Psychiatry, 17, 106–115. https://doi.org/10.1007/s00787-008-1012-1
(2014). Interventions for high school students with attention-deficit/hyperactivity disorder: Considerations for future directions. School Psychology Review, 43, 203–209.
(2014). Stigmatization in teachers towards adults with attention deficit hyperactivity disorder. SpringerPlus, 3, 26. https://doi.org/10.1186/2193-1801-3-26
(2002). A DSM-IV-referenced, adolescent self-report rating scale. Journal of the American Academy of Child and Adolescent Psychiatry, 41, 671–679. https://doi.org/10.1097/00004583-200206000-00006
(2009). Strengths and Difficulties Questionnaire as a dimensional measure of child mental health. Journal of the American Academy of Child and Adolescent Psychiatry, 48, 400–403. https://doi.org/10.1097/CHI.0b013e3181985068
(2010). When to use broader internalising and externalising subscales instead of the hypothesised five subscales on the Strengths and Difficulties Questionnaire (SDQ): Data from British parents, teachers and children. Journal of Abnormal Child Psychology, 38, 1179–1191. https://doi.org/10.1007/s10802-010-9434-x
(1997). The Strengths and Difficulties Questionnaire: A research note. Journal of Child Psychology and Psychiatry, 38, 581–586. https://doi.org/10.1111/j.1469-7610.1997.tb01545.x
(2001). Psychometric properties of the Strengths and Difficulties Questionnaire. Journal of the American Academy of Child and Adolescent Psychiatry, 40, 1337–1345. https://doi.org/10.1097/00004583-200111000-00015
(2009). Aufmerksamkeitsdefizit-/Hyperaktivitätsstörungen von Kindern und Jugendlichen im Elternurteil: Eine Analyse an einer Feldstichprobe mit dem Diagnostik-System DISYPS–II
([Parent ratings of attention deficit/hyperactivity disorders in children and adolescents – An analysis in a field sample with the Diagnostic System for Mental Disorders in Childhood and Adolescence (DISYPS-II)] . Zeitschrift für Kinder- und Jugendpsychiatrie und Psychotherapie, 37, 183–194. https://doi.org/10.1024/1422-4917.37.3.1832002). Understanding the relations among gender, disinhibition, and disruptive behavior in adolescents. Journal of Abnormal Psychology, 111, 659–664. https://doi.org/10.1037/0021-843X.111.4.659
(2003). Child, parent, and therapist (dis)agreement on target problems in outpatient therapy: The therapist’s dilemma and its implications. Journal of Consulting and Clinical Psychology, 71, 62–70. https://doi.org/10.1037/0022-006X.71.1.62
(2016). Mediation and moderation of outcome in a training intervention for adolescents with attention-deficit/hyperactivity disorder. Journal of Cognitive Education and Psychology, 15, 412–427. https://doi.org/10.1891/1945-8959.15.3.412
(2014). Adolescent and caregiver reports of ADHD symptoms among inner-city youth: Agreement, perceived need for treatment, and behavioral correlates. Journal of Attention Disorders, 18, 212–225. https://doi.org/10.1177/1087054712443160
(2004). Self-perceptions of competence in children with ADHD and comparison children. Journal of Consulting and Clinical Psychology, 72, 382–391. https://doi.org/10.1037/0022-006X.72.3.382
(2013). Does childhood positive self-perceptual bias mediate adolescent risky behavior in youth from the MTA study? Journal of Consulting and Clinical Psychology, 81, 846–858. https://doi.org/10.1037/a0033536
(2010). Time-dependent changes in positively biased self-perceptions of children with attention-deficit/hyperactivity disorder: A developmental psychopathology perspective. Developmental Psychopathology, 22, 375–390. https://doi.org/10.1017/S095457941000012X
(1995). Social-cognitive predictors of treatment response in children with ADHD. Journal of Social and Clinical Psychology, 14, 23–35. https://doi.org/10.1521/jscp.1995.14.1.23
(2002). Do boys with attention-deficit/hyperactivity disorder have positive illusory self-concepts? Journal of Abnormal Psychology, 111, 268–278. https://doi.org/10.1037/0021-843X.111.2.268
(2001). Academic task persistence of normally achieving ADHD and control boys: Performance, self-evaluations, and attributions. Journal of Consulting and Clinical Psychology, 69, 271–283. https://doi.org/10.1037/0022-006X.69.2.271
(2016). Positively biased self-perceptions in children with ADHD: Unique predictor of future maladjustment. Journal of Abnormal Psychology, 44, 575–586. https://doi.org/10.1007/s10802-015-0056-1
(2013). Influence of problematic child-teacher relationships on future psychiatric disorder: population survey with 3-year follow-up. The British Journal of Psychiatry, 202, 336–341. https://doi.org/10.1192/bjp.bp.112.120741
(2011). ADHS bei Jugendlichen. Das Lerntraining LeJA
([ADHD in adolescence. The training program for learning skills LeJA] . Weinheim, Germany: Beltz PVU.2012). Does a positive bias relate to social behavior in children with ADHD? Behavior Therapy, 43, 862–875. https://doi.org/10.1016/j.beth.2012.05.004
(2010). Positive illusory bias and response to behavioral treatment among children with attention-deficit/hyperactivity disorder. Journal of Clinical Child and Adolescent Psychology, 39, 373–385. https://doi.org/10.1080/15374411003691735
(2002). Are the performance overestimates given by boys with ADHD self-protective? Journal of Clinical Child Psychology, 31, 230–241. https://doi.org/10.1207/S15374424JCCP3102_08
(2007). A critical review of self-perceptions and the positive illusory bias in children with ADHD. Clinical Child and Family Psychology Review, 10, 335–351. https://doi.org/10.1007/s10567-007-0027-3
(2008). Homburger ADHS-Skalen für Erwachsene (HASE): Untersuchungsverfahren zur syndromalen und kategorialen Diagnostik der Aufmerksamkeitsdefizit-/Hyperaktivitätsstörung (ADHS) im Erwachsenenalter
([Homburg ADHD scales for adults (HASE): Diagnostic instruments for syndromal and categorical assessment of adult ADHD] . Göttingen, Germany: Hogrefe.2016). Training problem-solving- and organizational skills in adolescents with ADHD: A randomized controlled trial. Journal of Cognitive Education and Psychology, 15, 391–411. https://doi.org/10.1891/1945-8959.15.3.391
(2016). Parent-teen behavior therapy + motivational interviewing for adolescents with ADHD. Journal of Consulting and Clinical Psychology, 84, 699–712. https://doi.org/10.1037/ccp0000106
(2012). Diagnosing ADHD in adolescence. Journal of Consulting and Clinical Psychology, 80, 139–150. https://doi.org/10.1037/a0026577
(2012). Validity of DSM-IV attention-deficit/hyperactivity disorder symptom dimensions and subtypes. Journal of Abnormal Psychology, 121, 991–1010. https://doi.org/10.1037/a0027347
(