Skip to main content
Article

Cross-Cultural Collaborative Translation/Adaptation of Assessments Via International Working Groups

A Case Study With the Cognitive and Linguistic Scale

Published Online:https://doi.org/10.1027/2157-3891/a000094

Abstract: Most neuropsychological assessments are developed in English, yet nearly 95% of the global population are not native English speakers. To further compound this problem, translating and adapting assessments is a complex, expensive, and time-consuming process that few individual psychologists can undertake on their own. To overcome these obstacles, we formed an international consulting group of bilingual pediatric rehabilitation/hospital clinicians to translate and adapt a common assessment of cognitive recovery, the Cognitive and Linguistic Scale (CALS), for use with youth in three linguistic/cultural groups: Spanish-speaking youth residing in the United States, Dutch-speaking youth residing in the Netherlands, and Hebrew-speaking youth residing in Israel. We describe the collaborative process of translating and adapting the CALS for the respective populations following the first two stages of the International Test Committee guidelines (Precondition and Test Development). We also present new, more culturally accessible versions of visual stimuli that can be used across many linguistic/cultural groups in the Western world. Initial examination of responses from a preliminary pilot sample of US youth (N = 11) supported the acceptability of the Spanish translation and new visual stimuli. Next steps for each translated/adapted version of the CALS are discussed, including plans for validation in each respective population. We hope this overview will serve as a model for other groups to help decrease the translation burden on individual clinicians and promote higher-quality translated/adapted assessments that better serve diverse and often underserved patient populations.

Impact and Implications:

We describe our international consulting groups’ process of translating/adapting a measure of cognitive recovery for use with youth in three diverse linguistic and cultural groups and provide preliminary evidence to support the acceptability of the Spanish translation. Our cross-cultural collaborative approach to translation/adaptation decreases the translation burden on individual psychologists and promotes the development of higher-quality neuropsychological assessments for underserved linguistic populations. We hope this work will serve as a model for other teams interested in translating/adapting measures for diverse cultural-linguistic groups and thus reduce inequality in the access to neuropsychological assessment services within and across cultures.

References

  • Bartram, D., Berberoglu, G., Grégoire, J., Hambleton, R., Muñiz, J., & Van de Vijver, F. (2018). ITC guidelines for translating and adapting tests (2nd ed.). International Journal of Testing, 18(2) 101–134. 10.1080/15305058.2017.1398166 First citation in articleCrossrefGoogle Scholar

  • Bender, H. A., García, A. M., & Barr, W. B. (2010). An interdisciplinary approach to neuropsychological test construction: Perspectives from translation studies. Journal of the International Neuropsychological Society, 16(2), 227–232. 10.1017/S1355617709991378 First citation in articleCrossrefGoogle Scholar

  • Berube, S., Nonnemacher, J., Demsky, C., Glenn, S., Saxena, S., Wright, A., Tippett, D. C., & Hillis, A. E. (2019). Stealing cookies in the twenty-first century: Measures of spoken narrative in healthy versus speakers with aphasia. American Journal of Speech-Language Pathology, 28(1S), 321–329. 10.1044/2018_AJSLP-17-0131 First citation in articleCrossrefGoogle Scholar

  • Blackwell, L. S., Shishido, Y., & Howarth, R. (2022). Cognitive recovery of children and adolescents with moderate to severe TBI during inpatient rehabilitation. Disability and Rehabilitation, 44(7), 1035–1041. 10.1080/09638288.2020.1788176 First citation in articleCrossrefGoogle Scholar

  • Brislin, R. W. (1970). Back-translation for cross-cultural research. Journal of Cross-Cultural Psychology, 1(3), 185–216. 10.1177/135910457000100301 First citation in articleCrossrefGoogle Scholar

  • Byrne, B. M. (2016). Adaptation of assessment scales in cross-national research: Issues, guidelines, and caveats. International Perspectives in Psychology, 5(1), 51–65. 10.1037/ipp0000042 First citation in articleLinkGoogle Scholar

  • Dewan, M. C., Mummareddy, N., Wellons, J. C., & Bonfield, C. M. (2016). Epidemiology of global pediatric traumatic brain injury: Qualitative review. World Neurosurgery, 91, 497–509. 10.1016/j.wneu.2016.03.045 First citation in articleCrossrefGoogle Scholar

  • Fortuny, L. A. I., Garolera, M, Romo, D. H., Feldman, E., Barillas, H. F., Keefe, R., Lemaître, M. J., Martín, A. O., Mirsky, A., Monguió, I. S., Morote, G., Parchment, S., Da Pena, E., Politis, D. G., Sedó, M. A., Taussik, I., Valdivia, F., De Valdivia, L. E., & Maestre, K. V. (2005). Research with Spanish-speaking populations in the United States: Lost in the translation a commentary and a plea. Journal of Clinical and Experimental Neuropsychology, 27(5), 555–564. 10.1080/13803390490918282 First citation in articleCrossrefGoogle Scholar

  • Fortuny, L. A. I., & Mullaney, H. A. (1997). Neuropsychology with Spanish speakers: Language use and proficiency issues for test development. Journal of Clinical and Experimental Neuropsychology, 19(4), 615–622. 10.1080/01688639708403747 First citation in articleCrossrefGoogle Scholar

  • Goh, M. S. L., Looi, D. S. H., Goh, J. L., Sultana, R., Goh, S. S. M., Lee, J. H., & Chong, S.-L. (2021). The impact of traumatic brain injury on neurocognitive outcomes in children: A systematic review and meta-analysis. Journal of Neurology, Neurosurgery & Psychiatry, 92(8), 847–853. 10.1136/jnnp-2020-325066 First citation in articleCrossrefGoogle Scholar

  • Goodglass, H., Kaplan, E., & Barresi, B. (2001). Boston diagnostic aphasia examination (3rd ed.). Lippincott Williams & Wilkins. First citation in articleGoogle Scholar

  • Hambleton, R. K. (1993). Translating achievement tests for use in cross-national studies. European Journal of Psychological Assessment, 9(1), 57–68. First citation in articleGoogle Scholar

  • Hurks, P., Hendriksen, J., Dek, J., & Kooij, A. (2016). Accuracy of short forms of the Dutch Wechsler preschool and primary scale of intelligence: Third edition. Assessment, 23(2), 240–249. 10.1177/1073191115577189 First citation in articleCrossrefGoogle Scholar

  • Jimenez, N., Ebel, B. E., Wang, J., Koepsell, T. D., Jaffe, K. M., Dorsch, A., Durbin, D., Vavilala, M. S., Temkin, N., & Rivara, F. P. (2013). Disparities in disability after traumatic brain injury among Hispanic children and adolescents. Pediatrics, 131(6), Article e1850. 10.1542/peds.2012-3354 First citation in articleCrossrefGoogle Scholar

  • Jimenez, N., Symons, R. G., Wang, J., Ebel, B. H., Vavilala, M. S., Buchwald, D., Temkin, N., Jaffe, K. M., & Rivara, F. P. (2016). Outpatient rehabilitation for Medicaid-insured children hospitalized with traumatic brain injury. Pediatrics, 137(6), Article e20153500. 10.1542/peds.2015-3500 First citation in articleCrossrefGoogle Scholar

  • Payson, A., Pulido, A., San Martin, S., Garlesky, C., Garcia, E., Reyes, C., Reyes, M., & Leyenaar, J. (2022). Inequities in pain assessment and care of hospitalized children with limited English proficiency. Hospital Pediatrics, 12(6), 561–568. 10.1542/hpeds.2021-006445 First citation in articleCrossrefGoogle Scholar

  • Poisson, S. N., Block, K. L., & Orjuela, K. D. (2022). Implications of the national institutes of health stroke scale cookie theft picture—A closer look. JAMA Neurology, 79(8), 734–735. 10.1001/jamaneurol.2022.1409 First citation in articleCrossrefGoogle Scholar

  • Povoroznyuk, R., Dzerovych, N., & Povoroznyuk, V. (2016). A new voice: Translating medical questionnaires. Journal of World Languages, 3(2), 139–159. 10.1080/21698252.2016.1262220 First citation in articleCrossrefGoogle Scholar

  • Romero, H. R., Lageman, S. K., Kamath, V., Irani, F., Sim, A., Suarez, P., Manly, J. J., Attix, D. K., & the Summit Participants (2009). Challenges in the neuropsychological assessment of ethnic minorities: Summit proceedings. The Clinical Neuropsychologist, 23(5), 761–779. 10.1080/13854040902881958 First citation in articleCrossrefGoogle Scholar

  • San Miguel Montes, L. E., Allen, D. N., Puente, A. E., & Neblina, C. (2010). Validity of the WISC-IV Spanish for a clinically referred sample of Hispanic children. Psychological Assessment, 22(2), 465–469. 10.1037/a0018895 First citation in articleCrossrefGoogle Scholar

  • Slomine, B., Eikenberg, J., Salorio, C., Suskauer, S., Trovato, M., & Christensen, J. (2008). Preliminary evaluation of the cognitive and linguistic scale: A measure to assess recovery in inpatient rehabilitation following pediatric brain injury. Journal of Head Trauma Rehabilitation, 23(5), 286–293. 10.1097/01.HTR.0000336841.53338.2f First citation in articleCrossrefGoogle Scholar

  • Slomine, B., Grasmick, P. H., Suskauer, S. J., & Salorio, C. F. (2016). Psychometric properties of the cognitive and linguistic scale: A follow-up study. Rehabilitation Psychology, 61(3), 328–335. 10.1037/rep0000096 First citation in articleCrossrefGoogle Scholar

  • Sousa, V. D., & Rojjanasrirat, W. (2011). Translation, adaptation and validation of instruments or scales for use in cross‐cultural health care research: A clear and user‐friendly guideline. Journal of Evaluation in Clinical Practice, 17(2), 268–274. 10.1111/j.1365-2753.2010.01434.x First citation in articleCrossrefGoogle Scholar

  • van de Vijver, F., & Hambleton, R. K. (1996). Translating tests: Some practical guidelines. European Psychologist, 1(2), 89–99. 10.1027/1016-9040.1.2.89 First citation in articleLinkGoogle Scholar

  • van de Vijver, F. J. R., & Leung, K. (2021). Methods and data analysis for cross-cultural research. Cambridge University Press. First citation in articleCrossrefGoogle Scholar

  • van de Vijver, F. J., & Poortinga, Y. H. (1997). Towards an integrated analysis of bias in cross-cultural assessment. European Journal of Psychological Assessment, 13(1), 29–37. 10.1027/1015-5759.13.1.29 First citation in articleLinkGoogle Scholar

  • Wechsler, D. (2010). Hebrew adaptation 2010. WISC-IVHE. PsychTech. First citation in articleGoogle Scholar