Skip to main content
Original Article

Measuring Youth Residential Care Provider Attitudes

A Confirmatory Factor Analysis of the Evidence-Based Practice Attitude Scale

Published Online:https://doi.org/10.1027/1015-5759/a000397

Abstract. In this study the 15-item Evidence-Based Practices Attitude Scale (EBPAS), a measure designed to assess attitudes toward the adoption of EBPs, was collected from administrators of residential care facilities for youth in the United States. As the EBPAS was administered to a different sample for which it was originally developed (i.e., community mental health), we conducted a Confirmatory Factor Analysis (CFA) to investigate if its factor structure was maintained. Results confirm the factor structure of the EBPAS as a valid measure of attitude toward evidence-based practice among youth residential care providers. Limitations and areas of future research are discussed.

References

  • Aarons, G. (2004). Mental health provider attitudes toward adoption of evidence-based practice: The Evidence-Based Practice Attitude Scale (EBPAS). Mental Health Services Research, 6, 61–74. First citation in articleCrossrefGoogle Scholar

  • Aarons, G. (2005). Measuring provider attitudes toward adoption of evidence-based practice: Consideration of organizational context and individual differences. Child and Adolescent Psychiatric Clinics of North America, 14, 225–271. doi: 10.1016/j.cjc.2004.04.008 First citation in articleCrossrefGoogle Scholar

  • Aarons, G. (2006). Transformational and transactional leadership: Association with attitudes toward evidence-based practice. Psychiatric Services, 57, 1162–1169. doi: 10.1176/appi.ps57.8.1162 First citation in articleCrossrefGoogle Scholar

  • Aarons, G. A., Cafri, G., Lugo, L. & Sawitzky, A. (2012). Expanding the domains of attitudes towards evidence-based practice: The Evidence Based Practice Attitude Scale-50. Administration and Policy in Mental Health and Mental Health Services Research, 39, 331–340. doi: 10.1007/s10488-010-0302-3 First citation in articleCrossrefGoogle Scholar

  • Aarons, G. A., Glissen, C., Hoagwood, K., Kelleher, K., Landsverk, J., & Cafri, G. The Research Network on Youth Mental Health. (2010). Psychometric properties and US National norms of the Evidence-Based Practice Attitude Scale (EBPAS). Psychological Assessment, 22, 356–365. doi: 10.1037/a0019188 First citation in articleCrossrefGoogle Scholar

  • Aarons, G. A., Green, A. E. & Miller, E. (2012). Researching readiness for implementation of evidence-based practice: A comprehensive review of the evidence-based practice attitude scale (EBPAS). In B. KellyD. PerkinsEds., Cambridge handbook of implementation science for psychology in education (pp. 150–164). New York, NY: Cambridge University Press. First citation in articleGoogle Scholar

  • Aarons, G. A., Hurlburt, M. & Horwitz, S. M. (2011). Advancing a conceptual model of evidence-based implementation in public service sectors. Administration & Policy in Mental Health & Mental Health Services Research, 38, 4–23. doi: 10.1007/s10488-010-0327-7 First citation in articleCrossrefGoogle Scholar

  • Aarons, G. A., McDonald, E. J., Sheehan, A. K. & Walrath-Greene, C. M. (2007). Confirmatory factor analysis of the Evidence-based Practice Attitude Scale (EBPAS) in a geographically diverse sample of community mental health providers. Administration & Policy in Mental Health & Mental Health Services Research, 34, 465–469. First citation in articleCrossrefGoogle Scholar

  • Aarons, G. A. & Sawitzky, A. C. (2006). Organizational culture and climate and mental health provider attitudes toward evidence-based practice. Psychological Services, 31, 61–72. doi: 10.1037/1541-1559.3.1.61 First citation in articleCrossrefGoogle Scholar

  • Aarons, G. A. & Sommerfeld, D. H. (2012). Leadership, innovation climate, and attitudes toward evidence-based practice during a statewide implementation. Journal of the American Academy of Child & Adolescent Psychiatry, 51, 423–431. doi: 10.1016/j.jaac.2012.01.018 First citation in articleCrossrefGoogle Scholar

  • Aarons, G. A., Sommerfeld, D. H. & Walrath-Greene, C. M. (2009). Evidence-based practice implementation: The impact of public versus private sector organization type on organizational support, provider attitudes, and adoption of evidence-based practice. Implementation Science: IS, 4, 83. doi: 10.1186/1748-5908-4-83 First citation in articleCrossrefGoogle Scholar

  • Ajzen, I. & Sheikh, S. (2013). Action versus inaction: Anticipated affect in the theory of planned behavior. Journal of Applied Social Psychology, 43, 155–162. doi: 10.1111/j.1559-1816.2012.00989.x First citation in articleCrossrefGoogle Scholar

  • Allen, B., Gharagozloo, L. & Johnson, J. C. (2012). Clinician knowledge and utilization of empirically-supported treatments for maltreated children. Child Maltreatment, 17, 11–21. doi: 10.1177/1077559511426333 First citation in articleCrossrefGoogle Scholar

  • American Association of Children’s Residential Centers. (2009). Redefining residential: Integrating evidence-based practices. Residential Treatment for Children & Youth, 26, 246–251. doi: 10.1080/08865710903256288 First citation in articleCrossrefGoogle Scholar

  • Attanasio, O. P. (2014). Evidence on public policy: Methodological issues, political issues and examples. Scandinavian Journal of Public Health, 42(Suppl 13), 28–40. doi: 10.1177/1403494813516717 First citation in articleCrossrefGoogle Scholar

  • Barth, R. P. (2005). Residential care: From here to eternity. International Journal of Social Welfare, 14, 158–162. doi: 10.1111/j.1468-2397.2005.00355.x First citation in articleCrossrefGoogle Scholar

  • Baurch, Y. & Holtom, B. C. (2008). Survey response rate levels and trends in organizational research. Human Relations, 61, 1139–1160. doi: 10.1177/0018726708094863 First citation in articleCrossrefGoogle Scholar

  • Beidas, R. S., Edmunds, J., Ditty, M., Watkins, J., Walsh, L., Marcus, S. & Kendall, P. (2014). Are inner context factors related to implementation outcomes in Cognitive-Behavioral Therapy for youth anxiety? Administration and Policy in Mental Health and Mental Health Services Research, 41, 788–799. doi: 10.1007/s10488-013-0529-x First citation in articleCrossrefGoogle Scholar

  • Courtney M. E.Iwaniec D. (2009). Residential care of children: Comparative perspectives. New York, NY: Oxford University Press. First citation in articleCrossrefGoogle Scholar

  • de Paul, J., Arruabarrena, I. & Indies, S. (2015). Pilot Implementation of two evidence based programs (safecare and incredible years) in child protecton services in Gipuzkoa (Spain). Psychosocial Intervention, 24, 105–120. doi: 10.1016/j.psi.2015.07.001 First citation in articleCrossrefGoogle Scholar

  • Dunn, G., Everitt, B. & Pickles, A. (1993). Modeling covariances and latent variables using EQS. New York, NY: Chapman & Hall. First citation in articleGoogle Scholar

  • Essock, S. M., Goldman, H. H., Van Tosh, L., Anthony, W. A., Appell, C. R. & Bond, G. R. (2003). Evidence-based practices: Setting the context and responding to concerns. Psychiatric Clinics of North America, 26, 919–938. doi: 10.1016/S0193-953X(03)00069-8 First citation in articleCrossrefGoogle Scholar

  • Frambach, R. T. & Schillewaert, N. (2002). Organizational innovation adoption: A multi-level framework of determinants and opportunities research. Journal of Business Research, 55, 163–176. doi: 10.1016/S0148-2963(00)00152-1 First citation in articleCrossrefGoogle Scholar

  • Frantz, I. & Heinrichs, N. (2015). Implementation of studied in the research prevention programs into practice: Acceptance and barriers. Journal of Clinical Psychology and Psychotherapy, 44, 56–61. doi: 10.1026/1616-3443/a000289 First citation in articleLinkGoogle Scholar

  • Frensch, K. M. & Cameron, G. (2002). Treatment of choice or last resort? A review of residential mental health placements for children and youth. Child & Youth Care Forum, 31, 307–339. doi: 10.1023/A:1016826627406 First citation in articleCrossrefGoogle Scholar

  • Gray, M. J., Elhai, J. D. & Schmidt, L. O. (2007). Trauma professionals’ attitudes toward and utilization of evidence-based practices. Behavior Modification, 31, 732–748. doi: 10.1177/0145445507302877 First citation in articleCrossrefGoogle Scholar

  • Henggeler, S. W., Chapman, J. E., Rowland, M. D., Halliday-Boykins, C. A., Randall, J., Shackelford, J. & Schoenwald, S. K. (2008). Statewide adoption and initial implementation of contingency management for substance-abusing adolescents. Journal of Consulting and Clinical Psychology, 76, 556–567. doi: 10.1037/0022-006X.76.4.556 First citation in articleCrossrefGoogle Scholar

  • Hu, L. & Bentier, P. M. (1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling: A Multidisciplinary Journal, 6, 1–55. doi: 10.1080/10705519909540118 First citation in articleCrossrefGoogle Scholar

  • James, S. (2011a). What works in group care? A structured review of treatment models for group home and residential care. Children and Youth Services Review, 33, 308–321. doi: 10.1016/j.childyouth.2010.09.014 First citation in articleCrossrefGoogle Scholar

  • James, S. (2011b, February). Research with group homes: Preliminary findings from the California Group Home Survey and other challenges in group home research. Paper presented at the California Alliance Winter Executive Conference, Napa, CA. First citation in articleGoogle Scholar

  • James, S. (2015). J. K. WhittakerF. del ValleL. Holmes Evidence-based practice in therapeutic residential care. Therapeutic residential care for children and youth: Developing evidence-based international practice. London, UK: Jessica Kingsley, 142–155. First citation in articleGoogle Scholar

  • James, S., Alemi, Q. & Zepeda, V. (2013). Effectiveness and implementation of evidence-based practices in residential care settings. Children and Youth Services Review, 35, 642–656. First citation in articleCrossrefGoogle Scholar

  • James, S., Thompson, R., Sternberg, N., Schnur, E., Ross, J., Butler, L., … Muirhead, J. (2015). Attitudes, perceptions, and utilization of evidence-based practices in residential care. Residential Treatment for Children & Youth, 32, 144–166. doi: 10.1016/j.childyouth.2013.01.007 First citation in articleCrossrefGoogle Scholar

  • James, S., Zhang, J. & Landsverk, J. (2012). Residential care for youth in the child welfare system: Stop-gap option or not? Residential Treatment for Children and Youth, 29, 48–65. doi: 10.1080/0886571X.2012.643678 First citation in articleCrossrefGoogle Scholar

  • Jameson, J. P., Chambless, D. L. & Blank, M. B. (2009). Empirically supported treatments in rural community mental health centers: A preliminary report on current utilization and attitudes toward adoption. Community Mental Health Journal, 45, 463–467. doi: 10.1007/s10597-009-9230-7 First citation in articleCrossrefGoogle Scholar

  • Kelloway, K. E. (1998). Using LISREL for structural equation modeling: A researcher’s guide (2nd ed.). Thousand Oaks, CA: Sage. First citation in articleGoogle Scholar

  • Mason, W. A., Fleming, C. B., Thompson, R. W., Haggerty, K. P. & Snyder, J. J. (2014). A framework for testing and promoting the expanded dissemination of promising preventive interventions that are being implemented in community settings. Preventive Science, 15, 674–683. doi: 10.1007/s11121-013-0409-3 First citation in articleCrossrefGoogle Scholar

  • McCurdy, B. L. & McIntyre, E. K. (2004). “And what about residential…?” Re-conceptualizing residential treatment as a stop-gap service for youth with emotional and behavioral disorders. Behavioral Interventions, 3, 137–158. doi: 10.1002/bin.151 First citation in articleCrossrefGoogle Scholar

  • Melas, C. D., Zampetakis, L. A., Dimopoulou, A. & Moustakis, V. (2012). Evaluating the properties of the Evidence-Based Practice Attitude Scale (EBPAS) in health care. Psychological Assessment, 24, 867–876. doi: 10.1037/a0027445 First citation in articleCrossrefGoogle Scholar

  • Mullen, E. J. & Streiner, D. L. (2004). The evidence for and against evidence-based practice. Brief Treatment and Crisis Intervention, 4, 111–121. doi: 10.1093/brief-treatment/mhh009 First citation in articleCrossrefGoogle Scholar

  • Muthén, L. K. & Muthén, B. O. (2012). Mplus User’s Guide (3rd ed.). Los Angeles, CA: Author. First citation in articleGoogle Scholar

  • Okpych, N. J. & Yu, J. L. H. (2014). A historical analysis of evidence-based practice in social work: The unfinished journey toward an empirically grounded profession. Social Service Review, 88, 3–58. doi: 10.1086/674969 First citation in articleCrossrefGoogle Scholar

  • Pignotti, M. & Thyer, B. A. (2009). Use of novel unsupported and empirically supported therapies by licensed clinical social workers: An exploratory study. Social Work Research, 33, 5–17. doi: 10.1093/swr/33.1.5 First citation in articleCrossrefGoogle Scholar

  • Rogers, E. M. (1995). Diffusion of innovations (4th ed.). New York, NY: The Free Press. First citation in articleGoogle Scholar

  • Rosen, E. K. & Proctor, A. (2002). Standards for evidence-based social work practice: The role of replicable and appropriate interventions outcomes, and practice guidelines. In A. R. RobertsG. J. GreeneEds., Social workers’ desk reference (2nd ed., pp. 743–747). New York, NY: Oxford University Press. First citation in articleGoogle Scholar

  • Schurer, J., Kohl, P. L. & Bellamy, J. L. (2010). Organizational context and readiness for change: A study of community-based parenting programs in one midwestern city. Administration in Social Work, 34, 178–195. doi: 10.1080/03643101003609487 First citation in articleCrossrefGoogle Scholar

  • Sexton, T. L., Chamberlin, P., Landsverk, J., Ortiz, A. & Schoenwald, S. K. (2010). Action brief: Future directions in the implementation of evidence based treatment and practices in child and adolescent mental health. Administration and Policy in Mental Health Services Research, 37, 132–134. doi: 10.1007/s10488-009-0262-7 First citation in articleCrossrefGoogle Scholar

  • Shlonsky, A. & Mildon, R. (2014). Methodological pluralism in the age of evidence-informed practice and policy. Scandinavian Journal of Public Health, 42, 18–27. doi: 10.1177/1403494813516716 First citation in articleCrossrefGoogle Scholar

  • Soydan, H., Mullen, E. J., Alexandra, L., Rehnman, J. & Li, Y.-P. (2011). Evidence-based clearinghouses in social work. Research on Social Work Practice, 20, 690–700. First citation in articleCrossrefGoogle Scholar

  • Stahmer, A. C. & Aarons, G. A. (2009). Attitudes toward adoption of evidence-based practices: A comparison of autism early intervention providers and children’s mental health providers. Psychological Services, 6, 223–234. doi: 10.1037/a0010738 First citation in articleCrossrefGoogle Scholar

  • Stuck, E. N., Small, R. W. & Ainsworth, F. (2000). Questioning the continuum of care: Toward a reconceptualization of child welfare services. Residential Treatment for Children & Youth, 17, 79–92. doi: 10.1300/J007v17n03_12 First citation in articleCrossrefGoogle Scholar

  • van Sonsbeek, M. A. S., Hutschemaekers, G. J. M., Veerman, J. W., Kleinjan, M., Aarons, G. A. & Tiemens, B. G. (2015). Psychometric properties of the Dutch version of the Evidence-Based Practice Attitude Scale (EBPAS). Health Research Policy and Systems, 13, 69. doi: 10.1186/s12961-015-0058-z First citation in articleCrossrefGoogle Scholar

  • Weist, M., Lever, N., Stephan, S., Youngstrom, E., Moore, E., Harrison, B., … Ghunney, A. (2009). Formative evaluation of a framework for high quality, evidence-based services in school mental health. School Mental Health, 1, 196–211. doi: 10.1007/s12310-009-9018-5 First citation in articleCrossrefGoogle Scholar

  • J. K. WhittakerF. del ValleL. Holmes (2015). Therapeutic residential care for children and youth: Developing evidence-based international practice. London, UK: Jessica Kingsley. First citation in articleGoogle Scholar

  • Whittaker, J. K., Greene, K., Schubert, D., Blum, R., Cheng, K., Blum, K., … Roy, R. (2006). Integrating evidence-based practice in the child mental health agency: A template for clinical and organizational change. American Journal of Orthopsychiatry, 76, 194–201. doi: 10.1037/0002-9432.76.2.194 First citation in articleCrossrefGoogle Scholar

  • Zebregs, S., van den Putte, B., Neijens, P. & de Graaf, A. (2015). The differential impact of statistical and narrative evidence on beliefs, attitude and intention: A meta-analysis. Health Communication, 30, 282–289. doi: 10.1080/10410236.2013.842528 First citation in articleCrossrefGoogle Scholar