Skip to main content
Search
Search
    Quick Search anywhere
    Quick search in Citations
Advanced Search
Skip main navigationClose Drawer MenuOpen Drawer Menu
Previous article
Next article
Original Article

Consequences of Test Anxiety on Adaptive Versus Fixed Item Testing

Published Online:June 22, 2011https://doi.org/10.1027/1015-5759/a000062

Abstract

We investigated the effects of test anxiety on test performance using computerized adaptive testing (CAT) versus conventional fixed item testing (FIT). We hypothesized that tests containing mainly items with medium probabilities of being solved would have negative effects on test performance for testtakers high in test anxiety. A total of 110 students (aged 16 to 20) from a German secondary modern school filled out a short form of the Test Anxiety Inventory (TAI-G; Wacker, Jaunzeme, & Jaksztat, 2008) and then were presented with items from the Adaptive Matrices Test (AMT; Hornke, Etzel, & Rettig, 1999) on the computer, either in CAT form or in a fixed item test form with a selection of items arranged in order of increasing item difficulty. Additionally, half of the students were given a short summary of information about the mode of item selection in adaptive testing before working on the CAT. In a moderated regression approach, a significant interaction of test anxiety and test mode was revealed. The effect of test mode on the AMT score was stronger for students with higher scores on test anxiety than for students with lower test anxiety. Furthermore, getting information about CAT led to significantly better results than receiving standard test instructions. Results are discussed with reference to test fairness.

References

  • Aiken, L. S. , West, S. G. (1991). Multiple regression: Testing and interpreting interactions. Thousand Oaks, CA: Sage. First citation in articleGoogle Scholar

  • Betz, N. E. (1975). New types of information and psychological implications (Research report 75-5). Minneapolis: University of Minnesota, Department of Psychology, Psychometric Methods Program. First citation in articleGoogle Scholar

  • Bradshaw, G. D. , Gaudry, E. (1968). The effects of a single experience of successor failure on test anxiety. Australian Journal of Psychology, 20, 219–223. First citation in articleCrossref, Google Scholar

  • Chen, S. Y. , Ankenmann, R. D. , Chang, H. H. (2000). A comparison of item selection rules at the early stages of computerized adaptive testing. Applied Psychological Measurement, 24, 241–255. First citation in articleCrossref, Google Scholar

  • Fayers, P. M. (2007). Applying item response theory and computer adaptive testing: the challenges for health outcomes assessment. Quality of Life Research, 16, 187–194. First citation in articleCrossref, Google Scholar

  • Feather, N. T. (1965). The relationship of expectation of success to need achievement and test anxiety. Journal of Personality and Social Psychology, 1, 118–126. First citation in articleCrossref, Google Scholar

  • Frey, A. , Hartig, J. , & Moosbrugger, H. (2009). Effects of adaptive testing on test-taking motivation with the example of the Frankfurt Adaptive Concentration Test. Diagnostica, 55, 20–28. First citation in articleLink, Google Scholar

  • Gibbons, R. D. , Weiss, D. J. , Kupfer, D. J. , Frank, E. , Fagiolini, A. , Grochocinski, V. J. , ... Immekus, J. C. (2008). Using computerized adaptive testing to reduce the burden of mental health assessment. Psychiatric Services, 59, 361–368. First citation in articleCrossref, Google Scholar

  • Hau, K. T. , & Chang, H. H. (2001). Item selection in computerized adaptive testing: Should more discriminating items be used first? Journal of Educational Measurement, 38, 249–266. First citation in articleCrossref, Google Scholar

  • Häusler, J. , Sommer, M. (2008). The effect of success probability on test economy and self-confidence in computerized adaptive tests. Psychology Science Quarterly, 50, 75–87. First citation in articleGoogle Scholar

  • Helms, J. E. (2004). Fair and valid use of educational testing in grades K-12. In J. E. Wall, G. R. Walz, (Eds.), Measuring up: Assessment issues for teachers, counselors, and administrators (pp. 81–88). Greensboro, NC: CAPS Press. First citation in articleGoogle Scholar

  • Helms, J. E. (2006). Fairness is not validity or cultural bias in racial-group assessment: A quantitative perspective. American Psychologist, 61, 845–859. First citation in articleCrossref, Google Scholar

  • Hembree, R. (1988). Correlates, causes, effects, and treatment of test anxiety. Review of Educational Research, 58, 47–77. First citation in articleCrossref, Google Scholar

  • Hodapp, V. (1991). Das Prüfungsängstlichkeitsinventar TAI-G: Eine erweiterte und modifizierte Version mit vier Komponenten [The German Test Anxiety Inventory (TAI-G): An extended and modified version with four components]. Zeitschrift für Pädagogische Psychologie, 5, 121–130. First citation in articleGoogle Scholar

  • Hornke, L. F. (2002). Item-generation models for higher order cognitive functions. In S. H. Irvine, P. C. Kyllonen, (Eds.), Item generation for test development (pp. 159–178). Mahwah, NJ: Erlbaum. First citation in articleGoogle Scholar

  • Hornke, L. F. , Etzel, S. , Rettig, K. (1999). Adaptiver Matrizentest – AMT [Adaptive Matrices Test – AMT]. Mödling: Schuhfried GmbH. First citation in articleGoogle Scholar

  • Hornke, L. F. , Küppers, A. , Etzel, S. (2000). Design and evaluation of an adaptive matrices test. Diagnostica, 46, 182–188. First citation in articleLink, Google Scholar

  • Keith, N. , Hodapp, V. , Schermelleh-Engel, K. , Moosbrugger, H. (2003). Cross-sectional and longitudinal confirmatory factor models for the German Test Anxiety Inventory: A construct validation. Anxiety Stress and Coping, 16, 251–270. First citation in articleCrossref, Google Scholar

  • Legg, S. M. , Buhr, D. C. (1992). Computerized adaptive testing with different groups. Educational Measurement: Issues and Practice, 11, 23–27. First citation in articleCrossref, Google Scholar

  • Lord, F. M. (1980). Applications of item response theory to practical testing problems. Hillsdale, NJ: Erlbaum. First citation in articleGoogle Scholar

  • Meijer, R. R. , Nering, M. L. (1999). Computerized adaptive testing: Overview and introduction. Applied Psychological Measurement, 23, 187–194. First citation in articleCrossref, Google Scholar

  • Moreno, K. E. , Wetzel, C. D. , McBride, J. R. , Weiss, D. J. (1984). Relationship between corresponding armed services vocational aptitude battery (ASVAB) and computerized adaptive testing (CAT) subtests. Applied Psychological Measurement, 8, 155–163. First citation in articleCrossref, Google Scholar

  • Overton, R. C. , Harms, H. J. , Taylor, L. R. , Zickar, M. J. (1997). Adapting to adaptive testing. Personnel Psychology, 50, 171–185. First citation in articleCrossref, Google Scholar

  • Paulman, R. , Kennelly, K. (1984). Test anxiety and ineffective test taking: Different names, same constructs? Journal of Educational Psychology, 76, 279–288. First citation in articleCrossref, Google Scholar

  • Pine, S. M. , Church, A. T. , Gialluca, K. A. , Weiss, D. J. (1979). Effects of computerized adaptive testing on black and white students (Research Report 79–2). Minneapolis, MN: University of Minnesota, Department of Psychology, Psychometric Methods Program. First citation in articleGoogle Scholar

  • Ponsoda, V. , Olea, J. , Rodriguez, M. S. , Revuelta, J. (1999). The effect of test difficulty manipulation in computerized-adaptive testing and self-adapted testing. Applied Measurement in Education, 12, 167–184. First citation in articleCrossref, Google Scholar

  • Rasch, G. (1960). Probabilistic models for some intelligence and attainment tests. Copenhagen: Nielsen & Lydiche. First citation in articleGoogle Scholar

  • Rauch, M. , Weber, W. , & Wildgrube, W. (1993). Computer-based assessment within the psychological service of the federal armed forces Germany. Zeitschrift für Arbeits- und Organizationspsychologie, 37, 142–145. First citation in articleGoogle Scholar

  • Sarason, I. G. , Sarason, B. R. (1990). Test anxiety. In H. Leitenberg, (Ed.), Handbook of social and evaluative anxiety (pp. 475–496). New York: Plenum. First citation in articleCrossref, Google Scholar

  • Seipp, B. (1991). Anxiety and academic performance: A meta analysis of findings. Anxiety Research, 4, 27–41. First citation in articleCrossref, Google Scholar

  • Sieber, J. E. , O’Neil Jr., H. F. , Tobias, S. (1977). Anxiety, learning and instruction. Hillsdale, NJ: Erlbaum. First citation in articleGoogle Scholar

  • Thissen, D. , Mislevy, R. J. (2000). Computerized adaptive testing: A primer. In H. Wainer, (Ed.), Testing algorithms (pp. 101–133). Hillsdale, NJ: Erlbaum. First citation in articleGoogle Scholar

  • Tonidandel, S. , Quinones, M. A. (2000). Psychological reactions to adaptive testing. International Journal of Selection and Assessment, 8, 7–15. First citation in articleCrossref, Google Scholar

  • Tonidandel, S. , Quinones, M. A. , Adams, A. A. (2002). Computer-adaptive testing: The impact of test characteristics on perceived performance and testtakers’ reactions. Journal of Applied Psychology, 87, 320–332. First citation in articleCrossref, Google Scholar

  • Van der Linden, W. J. , Glas, C. A. W. (Eds.). (2000). Computerized adaptive testing: Theory and practice. St. Paul, MN: Assessment Systems Corporation. First citation in articleCrossref, Google Scholar

  • Vispoel, W. P. , Rocklin, T. R. , Wang, T. (1994). Individual differences and test administration procedures: A comparison of fixed-item, computerized-adaptive, and self-adapted testing. Applied Measurement in Education, 7, 53–79. First citation in articleCrossref, Google Scholar

  • Wacker, A. , Jaunzeme, J. , Jaksztat, S. (2008). Eine Kurzform des Prüfungsängstlichkeitsinventars TAI-G [A short form of the Test Anxiety Inventory TAI-G.]. Zeitschrift für Pädagogische Psychologie, 22, 73–81. First citation in articleLink, Google Scholar

  • Wainer, H. (2000). Introduction and history. In H. Wainer, (Ed.), Computerized adaptive testing: A primer (pp. 1–21). Hillsdale, NJ: Erlbaum. First citation in articleCrossref, Google Scholar

  • Wainer, H. , Dorans, N. J. , Flaugher, R. , Green, B. F. , Mislevy, R. J. , Steinberg, L. , Thissen, D. (1990). Computerized adaptive testing: A primer. Hillsdale, NJ: Erlbaum. First citation in articleGoogle Scholar

  • Wainer, H. , & Eignor, D. (2000). Caveats, pitfalls, and unexpected consequences of implementing large scale computerized testing. In H. Wainer, (Ed.), Computerized adaptive testing: A primer (pp. 271–299). Hillsdale, NJ: Erlbaum. First citation in articleCrossref, Google Scholar

  • Wang, T. Y. , Vispoel, W. P. (1998). Properties of ability estimation methods in computerized adaptive testing. Journal of Educational Measurement, 35, 109–135. First citation in articleCrossref, Google Scholar

  • Weiss, D. J. (1982). Improving measurement quality and efficiency with adaptive testing. Applied Psychological Measurement, 6, 473–492. First citation in articleCrossref, Google Scholar

  • Weiss, D. J. (2004). Computerized adaptive testing for effective and efficient measurement in counseling and education. Measurement and Evaluation in Counseling and Development, 37, 70–84. First citation in articleCrossref, Google Scholar

  • Weiss, D. J. , Betz, N. E. (1973). Ability measurement: Conventional or adaptive? (Research Report 73–1). Minneapolis, MN: University of Minnesota, Department of Psychology, Psychometric Methods Program. First citation in articleGoogle Scholar

  • Weiss, D. J. , Kingsbury, G. G. (1984). Application of computerized adaptive testing to educational problems. Journal of Educational Measurement, 21, 361–375. First citation in articleCrossref, Google Scholar

  • Willingham, W. W. , Cole, N. S. (1997). Introduction. In W. W. Willingham, N. S. Cole, (Eds.), Gender and fair assessment (pp. 1–15). Mahwah, NJ: Erlbaum. First citation in articleGoogle Scholar

  • Wine, J. (1971). Test anxiety and direction of attention. Psychological Bulletin, 76, 92–104. First citation in articleCrossref, Google Scholar