Skip to main content
Search
Search
    Quick Search anywhere
    Quick search in Citations
Advanced Search
Skip main navigation
Previous article
Next article
Review Article

Implementation of Treatment Integrity Procedures

An Analysis of Outcome Studies of Youth Interventions Targeting Externalizing Behavioral Problems

Published Online:February 28, 2015https://doi.org/10.1027/2151-2604/a000161

Abstract

This systematic review evaluates the implementation of treatment integrity procedures in outcome studies of youth interventions targeting behavioral problems. The Implementation of Treatment Integrity Procedures Scale (ITIPS), developed by Perepletchikova, Treat, and Kazdin (2007), was adapted (ITIPS-A) and used to evaluate 32 outcome studies of evidence-based interventions for youths with externalizing behavioral problems. Integrity measures were found to be still rare in these studies. Of the studies that took integrity into account, 80% approached adequacy in implementing procedures for treatment integrity. The ITIPS-A is recommended as an instrument to guide development of integrity instruments and the implementation of treatment integrity procedures in youth care.

References3

  • Barber, J. P. , Gallop, R. , Crits-Christoph, P. , Frank, A. , Thase, M. E. , Weiss, R. D. , Gibbons, B. C. (2006). The role of therapist adherence, therapist competence, and alliance in predicting outcome of individual drug counseling: Results from the national institute drug abuse collaborative cocaine treatment study. Psychotherapy Research, 16, 229–240. doi: 10.1080/10503300500288951 First citation in articleCrossref, Google Scholar

  • Barber, J. P. , Sharpless, B. A. , Klostermann, S. , McCarthy, K. S. (2007). Assessing intervention competence and its relation to therapy outcome. Professional Psychology: Research and Practice, 38, 493–500. doi: 10.1037/0735-7028.38.5.493 First citation in articleCrossref, Google Scholar

  • Barber, J. , Triffleman, E. , Marmar, C. (2007). Considerations in treatment integrity: Implications and recommendations for PTSD research. Journal of Traumatic Stress, 20, 793–805. doi: 10.1002/jts.20295 First citation in articleCrossref, Google Scholar

  • *Barnoski, R. (2004). Outcome evaluation of Washington State’s research-based programs for juvenile offenders. Olympia, WA: Washington State Institute for Public Policy. First citation in articleGoogle Scholar

  • *Bruns, E. J. , Suter, J. C. , Force, M. M. , Burchard, J. D. (2005). Adherence to wraparound principles and association with outcomes. Journal of Child & Family Studies, 14, 521–534. doi: 10.1007/s10826-005-7186-y First citation in articleCrossref, Google Scholar

  • Carroll, C. , Patterson, M. , Wood, S. , Booth, A. , Rick, J. , Balain, S. (2007). A conceptual framework for implementation fidelity. Implementation Science, 2, 40 doi: 10.1186/1748-5908-2-40 First citation in articleCrossref, Google Scholar

  • *Chapman, J. E. , Schoenwald, S. K. (2011). Ethnic similarity, therapist adherence, and long-term multisystemic therapy outcomes. Journal of Emotional & Behavioural Disorders, 19, 3–16. doi: 10.1177/1063426610376773 First citation in articleCrossref, Google Scholar

  • Dishion, T. J. , McCord, J. , Poulin, F. (1999). When interventions harm: Peer groups and problem behavior. American Psychologist, 54, 755–764. First citation in articleCrossref, Google Scholar

  • *Eames, C. , Daley, D. , Hutchings, J. , Whitaker, C. J. , Bywater, T. , Jones, K. , Hughes, J. C. (2010). The impact of group leaders’ behaviour on parents acquisition of key parenting skills during parent training. Behaviour Research and Therapy, 48, 1221–1226. doi: 10.1016/j.brat.2010.07.011 First citation in articleCrossref, Google Scholar

  • *Eames, C. , Daley, D. , Hutchings, J. , Whitaker, C. J. , Jones, K. , Hughes, J. C. , Bywater, T. (2009). Treatment fidelity as a predictor of behaviour change in parents attending group-based parent training. Child: Care, Health & Development, 35, 603–612. doi: 10.1111/j.1365-2214.2009.00975.x First citation in articleCrossref, Google Scholar

  • *Effland, V. , Walton, B. , McIntyre, J. (2011). Connecting the dots: Stages of implementation, wraparound fidelity and youth outcomes. Journal of Child & Family Studies, 20, 736–746. doi: 10.1007/s10826-011-9541-5 First citation in articleCrossref, Google Scholar

  • Farrington, D. P. , Welsh, B. C. (2006). A half-century of randomized experiments on crime and justice. In M. Tonry, (Ed.), Crime and Justice (pp. 55–132). Chicago, IL: University of Chicago Press. First citation in articleCrossref, Google Scholar

  • *Glisson, C. , Schoenwald, S. K. , Hemmelgarn, A. , Green, P. , Dukes, D. , Armstrong, K. S. , Chapman, J. E. (2010). Randomized trial of MST and ARC in a two-level evidence-based treatment implementation strategy. Journal of Consulting and Clinical Psychology, 78, 537–550. doi: 10.1037/a0019160 First citation in articleCrossref, Google Scholar

  • *Henggeler, S. W. , Melton, G. B. , Brondino, M. J. , Scherer, D. G. , Hanley, J. H. (1997). Multisystemic therapy with violent and chronic juvenile offenders and their families: The role of treatment fidelity in successful dissemination. Journal of Consulting and Clinical Psychology, 65, 821–833. First citation in articleCrossref, Google Scholar

  • *Henggeler, S. W. , Pickrel, S. G. , Brondino, M. J. (1999). Multisystemic treatment of substance-abusing and dependent delinquents: Outcomes, treatment fidelity, and transportability. Mental Health Services Research, 1, 171–184. First citation in articleCrossref, Google Scholar

  • *Hogue, A. , Dauber, S. , Samuolis, J. , Liddle, H. A. (2006). Treatment techniques and outcomes in multidimensional family therapy for adolescent behavior problems. Journal of Family Psychology, 20, 535–543. doi: 10.1037/0893-3200.20.4.535 First citation in articleCrossref, Google Scholar

  • *Hogue, A. , Henderson, C. E. , Dauber, S. , Barajas, P. C. , Fried, A. , Liddle, H. A. (2008). Treatment adherence, competence, and outcome in individual and family therapy for adolescent behavior problems. Journal of Consulting & Clinical Psychology, 76, 544–555. First citation in articleCrossref, Google Scholar

  • *Holth, P. , Torsheim, T. , Sheidow, A. J. , Ogden, T. , Henggeler, S. W. (2011). Intensive quality assurance of therapist adherence to behavioral interventions for adolescent substance use problems. Journal of Child & Adolescent Substance Abuse, 20, 289–313. doi: 10.1080/1067828X.2011.581974 First citation in articleCrossref, Google Scholar

  • *Huey, S. J. , Henggeler, S. W. , Brondino, M. J. , Pickrel, S. G. (2000). Mechanisms of change in multisystemic therapy: Reducing delinquent behavior through therapist adherence and improved family and peer functioning. Journal of Consulting and Clinical Psychology, 68, 451–467. First citation in articleCrossref, Google Scholar

  • Liddle, H. A. , Dakof, G. A. , Henderson, C. , Rowe, C. (2011). Implementation outcomes of multidimensional family therapy-detention to community: A reintegration program for drug-using juvenile detainees. International Journal of Offender Therapy and Comparative Criminology, 55, 587–604. First citation in articleCrossref, Google Scholar

  • *Little, E. , Hudson, A. , Wilks, R. (2002). The efficacy of written teacher advice (tip sheets) for managing classroom behaviour problems. Educational Psychology, 22, 251–266. First citation in articleCrossref, Google Scholar

  • McGlinchey, J. B. , Dobson, K. S. (2003). Treatment integrity concerns in cognitive therapy for depression. Journal of Cognitive Psychotherapy: An International Quarterly, 17, 299–318. First citation in articleCrossref, Google Scholar

  • Parhar, K. K. , Wormith, J. S. , Derkzen, D. M. , Beauregard, A. M. (2008). Offender coercion in treatment: A meta-analysis of effectiveness. Criminal Justice and Behavior, 35, 1109–1135. First citation in articleCrossref, Google Scholar

  • Perepletchikova, F. (2006). Treatment integrity [Addendum to Perepletchikova, Treat, & Kazdin, 2007]. Retrieved from www.treatmentintegrity.com First citation in articleGoogle Scholar

  • Perepletchikova, F. , Kazdin, A. (2005). Treatment integrity and therapeutic change: Issues and research recommendations. Clinical Psychology-Science and Practice, 12, 365–383. doi: 10.1093/clipsy/bpi045 First citation in articleCrossref, Google Scholar

  • Perepletchikova, F. , Treat, T. A. , Kazdin, A. E. (2007). Treatment integrity in psychotherapy research: Analysis of the studies and examination of the associated factors. Journal of Consulting and Clinical Psychology, 75, 829–841. First citation in articleCrossref, Google Scholar

  • *Robbins, M. S. , Feaster, D. J. , Horigian, V. E. , Puccinelli, M. J. , Henderson, C. , Szapocznik, J. (2011). Therapist adherence in brief strategic family therapy for adolescent drug abusers. Journal of Consulting and Clinical Psychology, 79, 43–53. First citation in articleCrossref, Google Scholar

  • *Schoenwald, S. K. , Carter, R. E. , Chapman, J. E. , Sheidow, A. J. (2008). Therapist adherence and organizational effects on change in youth behavior problems one year after multisystemic therapy. Administration and Policy in Mental Health and Mental Health Services Research, 35, 379–394. doi: 10.1007/s10488-008-0181-z First citation in articleCrossref, Google Scholar

  • *Schoenwald, S. K. , Chapman, J. E. , Sheidow, A. J. , Carter, R. E. (2009). Long-term youth criminal outcomes in MST transport: The impact of therapist adherence and organizational climate and structure. Journal of Clinical Child and Adolescent Psychology, 38, 91–105. doi: 10.1080/15374410802575388 First citation in articleCrossref, Google Scholar

  • Schoenwald, S. K. , Garland, A. F. , Southam-Gerow, M. A. , Chorpita, B. F. , Chapman, J. E. (2011). Adherence measurement in treatments for disruptive behavior disorders: Pursuing clear vision through varied lenses. Clinical Psychology-Science and Practice, 18, 331–341. doi: 10.1111/j.1468-2850.2011.01264.x First citation in articleCrossref, Google Scholar

  • *Schoenwald, S. K. , Sheidow, A. J. , Chapman, J. E. (2009). Clinical supervision in treatment transport: Effects on adherence and outcomes. Journal of Consulting & Clinical Psychology, 77, 410–421. doi: 10.1037/a0013788 First citation in articleCrossref, Google Scholar

  • *Schoenwald, S. K. , Sheidow, A. J. , Letourneau, E. J. (2004). Toward effective quality assurance in evidence-based practice: Links between expert consultation, therapist fidelity, and child outcomes. Journal of Clinical Child & Adolescent Psychology, 33, 94–104. First citation in articleCrossref, Google Scholar

  • *Schoenwald, S. K. , Sheidow, A. J. , Letourneau, E. J. , Liao, J. (2003). Transportability of multisystemic therapy: Evidence for multilevel influences. Mental Health Services Research, 5, 223–239. doi: 10.1023/A:1026229102151 First citation in articleCrossref, Google Scholar

  • *Sexton, T. , Turner, C. W. (2010). The effectiveness of functional family therapy for youth with behavioral problems in a community practice setting. Journal of Family Psychology, 24, 339–348. First citation in articleCrossref, Google Scholar

  • *Stambaugh, L. F. , Mustillo, S. A. , Burns, B. J. , Stephens, R. L. , Baxter, B. , Edwards, D. , DeKraai, M. (2007). Outcomes from wraparound and multisystemic therapy in a center for mental health services system-of-care demonstration site. Journal of Emotional and Behavioral Disorders, 15, 143–155. First citation in articleCrossref, Google Scholar

  • *Sundell, K. , Hansson, K. , Löfholm, C. A. , Olsson, T. , Gustle, L. H. , Kadesjö, C. (2008). The transportability of multisystemic therapy to sweden: Short-term results from a randomized trial of conduct-disordered youths. Journal of Family Psychology, 22, 550–560. First citation in articleCrossref, Google Scholar

  • de Swart, J. J. W. , van den Broek, H. , Stams, G. J. J. M. , Asscher, J. J. , van der Laan, P. H. , Holsbrink-Engels, G. A. , vanderHelm, G. H. P. (2012). The effectiveness of institutional youth care over the past three decades: A meta-analysis. Children and Youth Services Review, 34, 1818–1824. First citation in articleCrossref, Google Scholar

  • Toffalo, D. A. D. (2000). An investigation of treatment integrity and outcomes in wraparound services. Journal of Child and Family Studies, 9, 351–361. First citation in articleCrossref, Google Scholar

  • Veerman, J. W. , van Yperen, T. A. (2007). Degrees of freedom and degrees of certainty: A developmental model for the establishment of evidence-based youth care. Evaluation and Program Planning, 30, 212–221. First citation in articleCrossref, Google Scholar

  • *Walker, H. M. , Golly, A. , McLane, J. Z. , Kimmich, M. (2005). The oregon first step to success replication initiative: Statewide results of an evaluation of the program’s impact. Journal of Emotional & Behavioral Disorders, 13, 163–172. First citation in articleCrossref, Google Scholar

  • Waltz, J. , Addis, M. , Koerner, K. , Jacobson, N. (1993). Testing the integrity of a psychotherapy protocol: Assessment of adherence and competence. Journal of Consulting and Clinical Psychology, 61, 620–630. First citation in articleCrossref, Google Scholar

  • Weisburd, D. (2003). Ethical practice and evaluation of interventions in crime and justice: The moral imperative for randomized trials. Evaluation Review, 27, 336–354. First citation in articleCrossref, Google Scholar

  • Weisz, J. R. , Jensen-Doss, A. , Hawley, K. M. (2006). Evidence-based youth psychotherapiesversus usual clinical care: A meta-analysis of direct comparisons. American Psychologist, 61, 671–689. First citation in articleCrossref, Google Scholar