Abstract
Summary: To facilitate the development of valid multicultural/multilingual tests, the International Test Commission (ITC) prepared the ITC Guidelines on Test Adaptations. This paper reviews the current version (cf. Van de Vijver & Hambleton, 1996), which consists of 22 guidelines on recommended practices pertaining to context, development, administration, documentation, and test-score interpretation, by identifying key principles in test adaptations and comparing them to a content analysis of the ITC Guidelines. The content analysis revealed a number of inconsistencies and ambiguities in a few guidelines, and proposals for reformulating them are given. A checklist to supplement the more narrative guidelines would also be helpful. Nevertheless, the review clearly demonstrates that the ITC Guidelines on Test Adaptations address key principles in test adaptations and constitute a significant standard or “code of conduct” in this field.
References
References
Bartram, D. Coyne, I. (1999). The ITC international guidelines for test use . Hull, UK: University of Hull, Psychology DepartmentBracken, B.A. Barona, A. (1991). State of the art procedures for translating, validating and using psychoeducational tests in cross-cultural assessment. School Psychology International, 12, 119– 132Brislin, R.W. (1980). Translation and content analysis of oral and written material. In H.C. Triandis & J.W. Berry (Eds.), Handbook of cross-cultural psychology (Vol. 1, pp. 389-444). Boston: Allyn & BaconBrislin, R.W. (1986). The wording and translation of research instruments. In W.J. Lonner & J.W. Berry (Eds.), Field methods in cross-cultural research (pp. 137-164). Newbury Park, CA: SageChapman, J.W. Tumner, W.E. (1995). Development of young children's reading self-concepts: An examination of emerging subcomponents and their relationship with reading achievement. Journal of Educational Psychology, 87, 154– 167Cheung, F.M. Leung, K. Fan, R.M. Song, W.Z. Zhang, J.X. Chang, J.P. (1996). Development of the Chinese Personality Assessment Inventory. Journal of Cross-Cultural Psychology, 27, 181– 199Geisinger, K.F. (1994). Cross-cultural normative assessment: Translation and adaptation issues influencing the normative interpretation of assessment instruments. Psychological Assessment, 6, 304– 312Goodwin, R. Lee, I. (1994). Taboo topics among Chinese and English friends. A cross-cultural comparison. Journal of Cross-Cultural Psychology, 25, 325– 338Greenfield, P.M. (1997). You can't take it with you. Why ability tests don't cross cultures. American Psychologist, 52, 1115– 1124Hambleton, R.K. (1994). Guidelines for adapting educational and psychological tests: A progress report. European Journal of Psychological Assessment, 10, 229– 244Hambleton, R.K. Bollwark, J. (1991). Adapting tests for use in different cultures: Technical issues and methods. Bulletin of the International Test Commission, 19, 3– 32Hambleton, R.K. Patsula, L. (1998). Bibliography of articles on adapting tests from one language and culture to others (Research Report). Amherst, MA: University of Massachusetts at Amherst, Laboratory of Psychometrics and Evaluative ResearchHambleton, R.K. Merenda, P. Spielberger, C.D. (in press) Adapting educational and psychological tests for cross-cultural assessment . Hillsdale, NJ: ErlbaumLandis, D. Bhagat, R.S. (1996). Handbook of intercultural training (2nd ed.). London: SageMarsh, H.W. (1988). Self-Description-Questionnaire I. SDQ-I manual and research monograph . San Antonio: The Psychological CorporationMarsh, H.W. Craven, R. Debus, R. (in press) Separation of competency and affect components of multiple dimensions of academic self-concept: A developmental perspective. Merrill Palmer Quarterly,McFadden, J. (1993). Transcultural counseling: Bilateral and international perspectives . Alexandria, VA: American Counseling AssociationPaniagua, F.A. (1994). Assessing and treating culturally diverse clients: A practical guide . Thousand Oaks, CA: SagePonterotto, J.G. Casas, J.M. Suzuki, L.A. Alexander, C.M. (1995). Handbook of multicultural counseling . Thousand Oaks, CA: SageSchneller, R. (1989). Intercultural and intrapersonal processes and factors of misunderstanding: Implications for multicultural training. International Journal of Intercultural Relations, 13, 465– 484Tanzer, N.K. (1998). Assessment of domain specificity in school-related Likert-type inventories: Conceptual issues, psychometric approaches, and cross-cultural evidence . Unpublished habilitation monograph. Graz, Austria: University of GrazTanzer, N.K. (in press) Developing tests for use in multiple languages and cultures: A plea for simultaneous development. In R. Hambleton, P. Merenda, & C.D. Spielberger (Eds.), Adapting educational and psychological tests for cross-cultural assessment. Hillsdale, NJ: ErlbaumVan de Vijver, F.J.R. Hambleton, R.K. (1996). Translating tests: Some practical guidelines. European Psychologist, 1, 89– 99Van de Vijver, F.J.R. Leung, K. (1997a). Methods and data analysis of comparative research. In J.W. Berry, Y.H. Poortinga, & J. Pandey (Eds.), Handbook of cross-cultural psychology (2nd ed., Vol. 1, pp. 257-300). Chicago: Allyn & BaconVan de Vijver, F.J.R. Leung, K. (1997b). Methods and data analysis for cross-cultural research . Newbury Park, CA: SageVan de Vijver, F.J.R. Tanzer, N.K. (1997). Bias and equivalence in cross-cultural assessment: An overview. European Review of Applied Psychology, 4, 263– 279Yang, K.-S. Bond, M.H. (1990). Exploring implicit personality theories with indigenous or imported constructs: The Chinese case. Journal of Personality and Social Psychology, 58, 1087– 1095Zhang, J.X. Bond, M.H. (1998). Personality and filial piety among college students in two Chinese societies. The added value of indigenous constructs. Journal of Cross-Cultural Psychology, 29, 402– 417