Skip to main content
Research Trends

Measuring Trainer Fidelity in the Transfer of Suicide Prevention Training

Published Online:https://doi.org/10.1027/0227-5910/a000253

Background: Finding effective and efficient models to train large numbers of suicide prevention interventionists, including ’hotline’ crisis counselors, is a high priority. Train-the-trainer (TTT) models are widely used but understudied. Aims: To assess the extent to which trainers following TTT delivered the Applied Suicide Intervention Skills Training (ASIST) program with fidelity, and to examine fidelity across two trainings and seven training segments. Method: We recorded and reliably rated trainer fidelity, defined as adherence to program content and competence of program delivery, for 34 newly trained ASIST trainers delivering the program to crisis center staff on two separate occasions. A total of 324 observations were coded. Trainer demographics were also collected. Results: On average, trainers delivered two-thirds of the program. Previous training was associated with lower levels of trainer adherence to the program. In all, 18% of trainers’ observations were rated as solidly competent. Trainers did not improve fidelity from their first to second training. Significantly higher fidelity was found for lectures and lower fidelity was found for interactive training activities including asking about suicide and creating a safe plan. Conclusions: We found wide variability in trainer fidelity to the ASIST program following TTT and few trainers had high levels of both adherence and competence. More research is needed to examine the cost-effectiveness of TTT models.

References

  • Abatemarco, A. , Beckley, J. , Borjan, M. , & Robson, M. (2007). Assessing and improving bioterrorism preparedness among first responders: A pilot study. Journal of Environmental Health, 69(6), 16–22. First citation in articleMedlineGoogle Scholar

  • Allen, E. S. , Connelly, E. N. , Morris, C. D. , Elmer, P. J. , Zwickey, H. (2011). A train-the-trainer model for integrating evidence-based medicine into a complementary and alternative medicine training program. Journal of Science and Healing, 7(2), 88–93. First citation in articleGoogle Scholar

  • Assemi, M. , Mutha, S. , Hudmon, K. S. (2007). Evaluation of a train-the-trainer program for cultural competence. American Journal of Pharmaceutical Education, 71, 110. First citation in articleCrossref MedlineGoogle Scholar

  • Beidas, R. S. , Kendall, P. C. (2010). Training clinicians in evidence-based practice: A critical review of studies from a systems-contextual perspective. Clinical Psychology: Science & Practice, 17, 1–30. First citation in articleCrossref MedlineGoogle Scholar

  • Becker, S. M. (2009). Psychosocial care for women survivors of the tsunami disaster in India. American Journal of Public Health, 99(4), 654–658. First citation in articleCrossref MedlineGoogle Scholar

  • Besculides, M. , Trebino, L. , & Nelson, H. (2012). Successful strategies for educating hard-to-reach populations: Lessons learned from the Massachusetts train-the-trainer project using the Helping you Take Care of Yourself curriculum. Health Education Journal, 71(3), 350–357. doi: 10.1177/0017896911398982 First citation in articleCrossrefGoogle Scholar

  • Bobevski, I. , Holgate, A. M. (1997). Characteristics of effective telephone counselling skills. British Journal of Guidance & Counselling, 25(2), 239–249. First citation in articleCrossrefGoogle Scholar

  • Bowes, D. , Marquis, M. , Young, W. , Holowaty, P. , Isaac, W. (2009). Process evaluation of a school-based intervention to increase physical activity and reduce bullying. Health Promotion Practice, 10(3), 394–401. First citation in articleCrossref MedlineGoogle Scholar

  • Brown, T. A. (2006). Confirmatory factor analysis for applied research. New York, NY: Guilford Press. First citation in articleGoogle Scholar

  • Burns, M. K. , Peters, R. , Noell, G. H. (2008). Using performance feedback to enhance implementation fidelity of the problem-solving team process. Journal of School Psychology, 46(5), 537–550. First citation in articleCrossref MedlineGoogle Scholar

  • Byrne, B. M. (2010). Structural equation modeling With Mplus. New York, NY: Routledge, Taylor & Francis Group. First citation in articleGoogle Scholar

  • Byrne, M. K. , Willis, A. , Deane, F. P. , Hawkins, B. , Quinn, R. (2010). Training inpatient mental health staff how to enhance patient engagement with medications: Medication alliance training and dissemination outcomes in a large US mental health hospital. Journal of Evaluation in Clinical Practice, 16(1), 114–120. First citation in articleCrossref MedlineGoogle Scholar

  • Caffarella, R. S. (2002) Planning programs for adult learners: A practical guide for educators, trainers and staff developers (2nd ed.). San Francisco, CA: Jossey-Bass.  First citation in articleGoogle Scholar

  • Carroll, K. M. , Nich, C. , Sifry, R. L. , Nuro, K. F. , Frankforter, T. L. , Ball, S. A. , Fenton, L. , Rounsaville, B. J. (2000). A general system for evaluating therapist adherence and competence in psychotherapy research in the addictions. Drug and Alcohol Dependence, 57, 225–238. First citation in articleCrossref MedlineGoogle Scholar

  • Cattell, R. B. (1966). The scree test for the number of factors. Multivariate Behavior Research, 1, 245–276. First citation in articleCrossrefGoogle Scholar

  • Conner, K. R. , Gunzler, D. , Tang, W. , Tu, X. M. , Maisto, S. A. (2011). Test of a clinical model of drinking and suicidal risk. Alcoholism: Clinical and Experimental Research, 35, 60–65. First citation in articleCrossref MedlineGoogle Scholar

  • Coveney, C. M. , Pollock, K. , Armstrong, S. , Moore, J. (2012). Callers’ experiences of contacting a national suicide prevention helpline: Report of an online survey. Crisis, 33, 313–324. First citation in articleGoogle Scholar

  • Covington, D. , Hogan, M. , Abreu, J. , Berman, A. , Breux, P. (2011). Suicide care in systems framework. Retrieved from National Action Alliance: Clinical Care & Intervention Task Force website: actionallianceforsuicideprevention.org/sites/actionallianceforsuicideprevention.org/files/taskforces/ClinicalCareInterventionReport.pdf. First citation in articleGoogle Scholar

  • Cross, W. , Cerulli, C. , Richards, H. , He, H. , Hermann, J. (2010). Predicting dissemination of a disaster mental health ”train-the-trainer” program. Disaster Medicine and Public Health Preparedness, 4(4), 339–343. First citation in articleCrossref MedlineGoogle Scholar

  • Cross, W. , Seaburn, D. , Gibbs, D. , Schmeelk-Cone, K. , White, A. M. , Caine, E. D. (2011). Does practice make perfect? A randomized control trail of behavioral practice on suicide prevention gatekeeper skills. Journal of Primary Prevention, 32, 195–211. First citation in articleCrossref MedlineGoogle Scholar

  • Cross, W. , West, J. (2011). Examining implementer fidelity: Conceptualizing and measuring adherence and competence. Journal of Children’s Services, 6(1), 18–33. First citation in articleCrossrefGoogle Scholar

  • Fixsen, D. L. , Naoom, S. F. , Blase, K. A. , Freidman, R. M. , Wallace, F. (2005) Implementation research: A synthesis of the literature. Tampa, FL: University of South Florida, Louis de la Parte Florida Mental Health Institute, The National Implementation Research Network. First citation in articleGoogle Scholar

  • Forgatch, M. S. , DeGarmo, D. S. (2011). Sustaining fidelity following the nationwide PMTO implementation in Norway. Prevention Science, 12(3), 235–246. First citation in articleCrossref MedlineGoogle Scholar

  • Gelkopf, M. , Ryan, P. , Cotton, S. J. , Berger, R. (2008). The impact of ”training the trainers” course for helping tsunami-survivor children on Sri Lankan disaster volunteer workers. International Journal of Stress Management, 15(2), 117–135. First citation in articleCrossrefGoogle Scholar

  • Gould, M. S. , Cross, W. , Pisani, A. R. , Munfakh, J. L. , Kleinman, M. (2013). Impact of Applied Suicide Intervention Skills Training (ASIST) on national suicide prevention lifeline counselor interventions and suicidal caller outcomes. Suicide and Life-Threatening Behavior, 43, 676–69. First citation in articleCrossref MedlineGoogle Scholar

  • Gould, M. S. , Kalafat, J. , Munfakh, J. L. , & Kleinman, M. (2007). An evaluation of crisis hotline outcomes, Part II: Suicidal callers. Suicide and Life Threatening Behavior, 37(3), 338–352. First citation in articleCrossref MedlineGoogle Scholar

  • Hansen, W. B. , Graham, J. W. , Wolkenstein, B. H. , Rohrbach, L. A. (1991). Program integrity as a moderator of prevention program effectiveness: Results for fifth grade students in the adolescent alcohol prevention trial. Journal of Studies on Alcohol, 52(6), 568–579. First citation in articleCrossref MedlineGoogle Scholar

  • Hepner, K. A. , Hunter, S. B. , Paddock, S. M. , Zhou, A. J. , Watkins, K. E. (2011). Training addiction counselors to implement CBT for depression. Administration and Policy in Mental Health, 38, 313–323. First citation in articleCrossref MedlineGoogle Scholar

  • Hogue, A. , Henderson, C. E. , Dauber, S. , Barajas, P. C. , Fried, A. , & Liddle, H. A. (2008). Treatment adherence, competence, and outcome in individual and family therapy for adolescent behavior problems. Journal of Consulting & Clinical Psychology, 76, 544–555. First citation in articleCrossref MedlineGoogle Scholar

  • Jaccard, J. C. (1996). LISREL approaches to interaction effects in multiple regression. Thousand Oaks, CA: Sage. First citation in articleCrossrefGoogle Scholar

  • Kalafat, J. , Gould, M. S. , Munfakh, J. L. H. , Kleinman, M. (2007). An evaluation of crisis hotline outcomes, Part I: Non-Suicidal Crisis Callers. Suicide and Life-Threatening Behavior, 37(3), 322–337. First citation in articleCrossref MedlineGoogle Scholar

  • King, R. , Nurcombe, R. , Bickman, L. , Hides, L. , Reid, W. (2003). Telephone counseling for adolescent suicide prevention: Changes in suicidality and mental state from beginning to end of a counseling session. Suicide and Life-Threatening Behavior, 33(4), 400–411. First citation in articleCrossref MedlineGoogle Scholar

  • Kline, R. B. (2011). Principles and practice of structural equation modeling (3rd ed.). New York, NY: Guilford. First citation in articleGoogle Scholar

  • Knoche, L. L. , Sheridan, S. M. , Edwards, C. P. , Osborn, A. Q. (2010). Implementation of a relationship-based school readiness intervention: A multidimensional approach to fidelity measurement for early childhood. Early Childhood Research Quarterly, 25(3), 299–313. First citation in articleCrossref MedlineGoogle Scholar

  • Lang, W. A. , Ramsay, K. F. , Tanney, B. C. , Kinzel, T. (2008). Applied Suicide Interventions Skills Training: Trainer manual. Calgary, Canada: Living Works Education. First citation in articleGoogle Scholar

  • Lillehoj, C. J. , Griffin, K. W. , Spoth, R. (2004). Program provider and observer ratings of school-based preventive intervention implementation: Agreement and relation to youth outcomes. Health Education & Behavior, 31, 242–257. First citation in articleCrossref MedlineGoogle Scholar

  • LivingWorks . (2010). ASIST trainer manual (Edition X.2 BETA). Calgary, Canada: LivingWorks Education. First citation in articleGoogle Scholar

  • McHugh, R. K. , Barlow, D. H. (2010). Dissemination and implementation of evidence-based psychological interventions: A review of current effortsAmerican Psychologist, 65(2), 73–84. First citation in articleCrossref MedlineGoogle Scholar

  • Moore, J. E. , Beck, T. C. , Sylvertsen, A. , Domitrovich, C. (2009). Making sense of implementation: multiple dimensions, multiple sources, multiple methods. Paper presented to the 17th Annual Meeting of the Society for Prevention Research, Washington, DC, USA. First citation in articleGoogle Scholar

  • Mplus (Version 7) [Computer software]. Los Angeles, CA: Muthen & Muthen. First citation in articleGoogle Scholar

  • Pisani, A. R. , Cross, W. F. , Gould, M. S. (2011). The assessment and management of suicide risk: State of workshop education. Suicide and Life-Threatening Behavior, 41(3), 255–276. First citation in articleCrossref MedlineGoogle Scholar

  • Schoenwald, S. K. , Garland, A. F. , Chapman, J. E. , Frazier, S. L. , Sheidow, A. J. , Southam-Gerow, M. A. (2011). Toward effective and efficient measurement of implementation fidelity. Administration and Policy in Mental Health and Mental Health Services Research, 38(1), 32–43. First citation in articleCrossref MedlineGoogle Scholar

  • Sholomskas, D. E. , Syracuse-Siewert, G. , Rounsaville, B. J. , Ball, S. A. , Nuro, K. F. , Carroll, K. M. (2005). We don’t train in vain: A dissemination trial of three strategies of training clinicians in cognitive-behavioral therapy. Journal of Consulting and Clinical Psychology, 73, 106–115. First citation in articleCrossref MedlineGoogle Scholar

  • Smith, G. T. , McCarthy, D. M. (1995) Methodological considerations in the refinement of clinical assessment instruments. Psychological Assessment, 7(3), 300–308. First citation in articleCrossrefGoogle Scholar

  • Trepka, C. , Rees, A. , Shapiro, D. A. , Hardy, G. E. , Barkham, M. (2004). Therapist competence and outcome of cognitive therapy for depression. Cognitive Therapy and Research, 28(2), 143–157. First citation in articleCrossrefGoogle Scholar

  • Tulving, E. (2008). On the law of primary. In M. A. Gluck, J. R. Anderson, S. M. Kosslyn, (Eds.), Memory and mind: A festschrift for Gordon H. Bower (pp. 31–48). Mahwah, NJ: Lawrence Erlbaum Associates Publishers. First citation in articleGoogle Scholar

  • Waltz, J. , Addis, M. E. , Koerner, K. , Jacobson, N. S. (1993). Testing the integrity of a psychotherapy protocol: Assessment of adherence and competence. Journal of Consulting & Clinical Psychology, 61(4), 620–630. First citation in articleCrossref MedlineGoogle Scholar

  • Welber, M. (2002). Save by growing your own trainers. Workforce, 81, 44–48. First citation in articleGoogle Scholar

  • World Health Organization . (2012). Mental health: Suicide prevention (SUPRE). Geneva, Switzerland: Author. Retrieved from www.who.int/mental_health/prevention/suicideprevent/en/index.html First citation in articleGoogle Scholar

  • Wiltsey-Stirman, S. , Miller, C. J. , Toder, K. , Calloway, A. , Beck, A. T. , Evans, A. C. , Crits-Christoph, P. (2012). Perspectives on cognitive therapy training within community mental health settings: Implications for clinician satisfaction and skill development. Depression Research and Treatment, Article ID 391084. doi:10.1155/2012/391084 First citation in articleGoogle Scholar

  • Wlodkowski, R. J. (2008). Enhancing adult motivation to learn: A comprehensive guide for teaching all adults. San Francisco, CA: Wiley & Sons. First citation in articleGoogle Scholar