Skip to main content
Search
Search
    Quick Search anywhere
    Quick search in Citations
Advanced Search
Skip main navigationClose Drawer MenuOpen Drawer Menu
Previous article
Next article

Development, Validation, and Evidence of Measurement Invariance of a Shortened Measure of Trait Test Anxiety

Published Online:March 23, 2023https://doi.org/10.1027/1015-5759/a000761

Abstract

Abstract: We develop and validate a short self-report measure of test anxiety, the Trait Test Anxiety Inventory – Short (TTAI-S) following the Kane (2013) validation framework. Data were collected from three independent samples of young adults in the US (N = 629; Mage = 22.25 years). Evidence was gathered to support three aspects of the validity argument (i.e., scoring, extrapolation, and generalization). Good internal consistency and confirmed structure of a single factor supported scoring inferences. Scalar measurement invariance between different samples (Internet vs. undergraduate students) and demographic subgroups (i.e., gender, race/ethnicity, and parental educational attainment) provided evidence for generalization inferences. Significant associations between the TTAI-S score and theoretically relevant (state test anxiety, performance expectation, and self-confidence in math) and weaker associations with less relevant constructs (enjoyment, motivation, and values in learning math) substantiated extrapolation inferences. Having established measurement invariance, we examined demographic differences and found that students historically underserved or underrepresented in STEM disciplines reported greater test anxiety than their counterparts. These findings support the validity of the TTAI-S, a concise measure that is easy to administer and easy to score. The TTAI-S may be used to further investigate trait test anxiety for a diverse population, particularly factors that may contribute to or mitigate group differences.

References

  • Baer, R. A., Samuel, D. B., & Lykins, E. L. (2011). Differential item functioning on the Five Facet Mindfulness Questionnaire is minimal in demographically matched meditators and nonmeditators. Assessment, 18(1), 3–10. https://doi.org/10.1177/1073191110392498 First citation in articleCrossref, Google Scholar

  • Bentler, P. M. (2007). On tests and indices for evaluating structural models. Personality and Individual Differences, 42(5), 825–829. https://doi.org/10.1016/j.paid.2006.09.024 First citation in articleCrossref, Google Scholar

  • Brosseau-Liard, P. E., & Savalei, V. (2014). Adjusting incremental fit indices for nonnormality. Multivariate Behavioral Research, 49(5), 460–470. https://doi.org/10.1080/00273171.2014.933697 First citation in articleCrossref, Google Scholar

  • Brosseau-Liard, P. E., Savalei, V., & Li, L. (2012). An investigation of the sample performance of two nonnormality corrections for RMSEA. Multivariate Behavioral Research, 47(6), 904–930. https://doi.org/10.1080/00273171.2012.715252 First citation in articleCrossref, Google Scholar

  • Cassady, J. C., & Johnson, R. E. (2002). Cognitive test anxiety and academic performance. Contemporary Educational Psychology, 27(2), 270–295. https://doi.org/10.1006/ceps.2001.1094 First citation in articleCrossref, Google Scholar

  • Chen, F. F. (2007). Sensitivity of goodness of fit indexes to lack of measurement invariance. Structural Equation Modeling: A Multidisciplinary Journal, 14, 464–504. https://doi.org/10.1080/10705510701301834 First citation in articleCrossref, Google Scholar

  • Cheung, G. W., & Rensvold, R. B. (2002). Evaluating goodness-of-fit indexes for testing measurement invariance. Structural Equation Modeling, 9(2), 233–255. https://doi.org/10.1207/S15328007SEM0902_5 First citation in articleCrossref, Google Scholar

  • Clark, D. A., Crandall, J. R., & Robinson, D. H. (2018). Incentives and test anxiety may moderate the effect of retrieval on learning. Learning and Individual Differences, 63, 70–77. https://doi.org/10.1016/j.lindif.2018.03.001 First citation in articleCrossref, Google Scholar

  • Cohen, J. (1992). A power primer. Psychological Bulletin, 112(1), 155–159. https://doi.org/10.1037/0033-2909.112.1.155 First citation in articleCrossref, Google Scholar

  • Cook, D. A., Brydges, R., Ginsburg, S., & Hatala, R. (2015). A contemporary approach to validity arguments: a practical guide to Kane’s framework. Medical Education, 49(6), 560–575. https://doi.org/10.1111/medu.12678 First citation in articleCrossref, Google Scholar

  • Eysenck, M. W., & Calvo, M. G. (1992). Anxiety and performance: The processing efficiency theory. Cognition & Emotion, 6(6), 409–434. https://doi.org/10.1080/02699939208409696 First citation in articleCrossref, Google Scholar

  • Fan, X., & Wang, L. (1998). Effects of potential confounding factors on fit indices and parameter estimates for true and misspecified SEM models. Educational and Psychological Measurement, 58(5), 701–735. https://doi.org/10.1177/0013164498058005001 First citation in articleCrossref, Google Scholar

  • Fan, X., Thompson, B., & Wang, L. (1999). Effects of sample size, estimation methods, and model specification on structural equation modeling fit indexes. Structural Equation Modeling: A Multidisciplinary Journal, 6(1), 56–83. https://doi.org/10.1080/10705519909540119 First citation in articleCrossref, Google Scholar

  • Gerwing, T. G., Rash, J. A., Allen Gerwing, A. M., Bramble, B., & Landine, J. (2015). Perceptions and incidence of test anxiety. The Canadian Journal for the Scholarship of Teaching and Learning, 6(3). https://doi.org/10.5206/cjsotl-rcacea.2015.3.3 First citation in articleCrossref, Google Scholar

  • Harris, R. B., Grunspan, D. Z., Pelch, M. A., Fernandes, G., Ramirez, G., & Freeman, S. (2019). Can test anxiety interventions alleviate a gender gap in an undergraduate STEM course. CBE – Life Sciences Education, 18(3), Article 35. https://doi.org/10.1187/cbe.18-05-0083 First citation in articleCrossref, Google Scholar

  • Hong, M., Steedle, J. T., & Cheng, Y. (2020). Methods of detecting insufficient effort responding: Comparisons and practical recommendations. Educational and Psychological Measurement, 80(2), 312–345. https://doi.org/10.1177/0013164419865316 First citation in articleCrossref, Google Scholar

  • Hu, L. T., & Bentler, P. M. (1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling: A Multidisciplinary Journal, 6(1), 1–55. https://doi.org/10.1080/10705519909540118 First citation in articleCrossref, Google Scholar

  • Jin, Y. (2020). A note on the cutoff values of alternative fit indices to evaluate measurement invariance for ESEM models. International Journal of Behavioral Development, 44(2), 166–174. https://doi.org/10.1177/0165025419866911 First citation in articleCrossref, Google Scholar

  • Joiner, T. E., Steer, R. A., Beck, A. T., Schmidt, N. B., Rudd, M. D., & Catanzaro, S. J. (1999). Physiological hyperarousal: Construct validity of a central aspect of the tripartite model of depression and anxiety. Journal of Abnormal Psychology, 108(2), 290–298. https://doi.org/10.1037/0021-843X.108.2.290 First citation in articleCrossref, Google Scholar

  • Kane, M. T. (2013). Validating the interpretations and uses of test scores. Journal of Educational Measurement, 50(1), 1–73. https://doi.org/10.1111/jedm.12000 First citation in articleCrossref, Google Scholar

  • Korkmaz, G., & Toraman, Ç. (2020). Are we ready for the post-COVID-19 educational practice? An investigation into what educators think as to online learning. International Journal of Technology in Education and Science, 4(4), 293–309. https://eric.ed.gov/?id=EJ1271308 First citation in articleCrossref, Google Scholar

  • Liebert, R. M., & Morris, L. W. (1967). Cognitive and emotional components of test anxiety: A distinction and some initial data. Psychological Reports, 20(3), 975–978. https://doi.org/10.2466/pr0.1967.20.3.975 First citation in articleCrossref, Google Scholar

  • Lim, S. Y., & Chapman, E. (2013). Development of a short form of the attitudes toward mathematics inventory. Educational Studies in Mathematics, 82(1), 145–164. https://doi.org/10.1007/s10649-012-9414-x First citation in articleCrossref, Google Scholar

  • Lotz, C., & Sparfeldt, J. R. (2017). Does test anxiety increase as the exam draws near? – Students’ state test anxiety recorded over the course of one semester. Personality and Individual Differences, 104, 397–400. https://doi.org/10.1016/j.paid.2016.08.032 First citation in articleCrossref, Google Scholar

  • Lowe, P. A. (2014). The Test Anxiety Measure for Adolescents (TAMA) examination of the reliability and validity of the scores of a new multidimensional measure of test anxiety for middle and high school students. Journal of Psychoeducational Assessment, 32(5), 404–416. https://doi.org/10.1177/0734282913520595 First citation in articleCrossref, Google Scholar

  • Lowe, P. A. (2015). Should test anxiety be measured differently for males and females? Examination of measurement bias across gender on measures of test anxiety for middle and high school, and college students. Journal of Psychoeducational Assessment, 33(3), 238–246. https://doi.org/10.1177/0734282914549428 First citation in articleCrossref, Google Scholar

  • Lowe, P. A. (2018). An investigation into the psychometric properties of the test anxiety measure for college students. Journal of Psychoeducational Assessment, 36(4), 322–336. https://doi.org/10.1177/0734282916678536 First citation in articleCrossref, Google Scholar

  • Lowe, P. A. (2019). Cross-national comparison between UK and US higher education students in test anxiety. Higher Education Studies, 9(3), 88–97. https://eric.ed.gov/?id=EJ1223014 First citation in articleCrossref, Google Scholar

  • Lowe, P. A. (2021). The test anxiety measure for college students-short form: Development and examination of its psychometric properties. Journal of Psychoeducational Assessment, 39(2), 139–152. https://doi.org/10.1177/0734282920962947 First citation in articleCrossref, Google Scholar

  • Lowe, P. A., & Ang, R. P. (2012). Cross-cultural examination of test anxiety among US and Singapore students on the Test Anxiety Scale for Elementary Students (TAS-E). Educational Psychology, 32(1), 107–126. https://doi.org/10.1080/01443410.2011.625625 First citation in articleCrossref, Google Scholar

  • Lowe, P. A., Ang, R. P., & Loke, S. W. (2011). Psychometric analyses of the Test Anxiety Scale for Elementary Students (TAS-E) scores among Singapore primary school students. Journal of Psychopathology and Behavioral Assessment, 33(4), 547–558. https://doi.org/10.1007/s10862-011-9250-9 First citation in articleCrossref, Google Scholar

  • Lowe, P. A., & Lee, S. W. (2008). Factor structure of the Test Anxiety Inventory for Children and Adolescents (TAICA) scores across gender among students in elementary and secondary school settings. Journal of Psychoeducational Assessment, 26(3), 231–246. https://doi.org/10.1177/0734282907303760 First citation in articleCrossref, Google Scholar

  • Mandler, G., & Sarason, S. B. (1952). A study of anxiety and learning. Journal of Abnormal and Social Psychology, 47(2), 166–173. https://doi.org/10.1037/h0062855 First citation in articleCrossref, Google Scholar

  • Martin, A. J., & Lazendic, G. (2018). Computer-adaptive testing: Implications for students’ achievement, motivation, engagement, and subjective test experience. Journal of Educational Psychology, 110(1), 27–45. https://doi.org/10.1037/edu0000205 First citation in articleCrossref, Google Scholar

  • Meade, A. W., & Craig, S. B. (2012). Identifying careless responses in survey data. Psychological Methods, 17(3), 437–455. https://doi.org/10.1037/a0028085 First citation in articleCrossref, Google Scholar

  • Melby, J. N., Conger, R. D., Fang, S. A., Wickrama, K. A. S., & Conger, K. J. (2008). Adolescent family experiences and educational attainment during early adulthood. Developmental Psychology, 44(6), 1519–1536. https://doi.org/10.1037/a0013352 First citation in articleCrossref, Google Scholar

  • Möcklinghoff, S., Rapoport, O., Heckel, C., Messerschmidt-Grandi, C., & Ringeisen, T. (2021). Latent profiles of test anxiety: Considering its multi-faceted structure. International Journal of Educational Research, 110, Article 101882. https://doi.org/10.1016/j.ijer.2021.101882 First citation in articleCrossref, Google Scholar

  • Mowbray, T., Jacobs, K., & Boyle, C. (2015). Validity of the German Test Anxiety Inventory (TAI-G) in an Australian sample. Australian Journal of Psychology, 67(2), 121–129. https://doi.org/10.1111/ajpy.12058 First citation in articleCrossref, Google Scholar

  • Nadler, J. T., & Clark, M. H. (2011). Stereotype threat: A meta‐analysis comparing African Americans to Hispanic Americans. Journal of Applied Social Psychology, 41(4), 872–890. https://doi.org/10.1111/j.1559-1816.2011.00739.x First citation in articleCrossref, Google Scholar

  • National Academies of Sciences, Engineering, and Medicine [NASEM]. (2018). Data science for undergraduates: Opportunities and options. National Academies Press. https://www.annualreviews.org/doi/full/10.1146/annurev-statistics-060116-053930 First citation in articleGoogle Scholar

  • National Center for Science and Engineering Statistics [NCES]. (2021, April). Women, minorities, and persons with disabilities in science and engineering. Directorate for Social, Behavioral and Economic Sciences, National Science Foundation. https://ncses.nsf.gov/pubs/nsf21321 First citation in articleGoogle Scholar

  • Newsom, J. T. (2020). Nested models, model modifications, and correlated errors. Lecture notes from PSY 523/623: Structural equation modeling. Personal Collection of J. T. Newsom, Portland State University. https://web.pdx.edu/~newsomj/semclass/ho_nested.pdf First citation in articleGoogle Scholar

  • Núñez-Peña, M. I., Guilera, G., & Suárez-Pellicioni, M. (2014). The single-item Math Anxiety Scale: An alternative way of measuring mathematical anxiety. Journal of Psychoeducational Assessment, 32(4), 306–317. https://doi.org/10.1177/0734282913508528 First citation in articleCrossref, Google Scholar

  • O’Brien, L. T., Garcia, D. M., Blodorn, A., Adams, G., Hammer, E., & Gravelin, C. (2020). An educational intervention to improve women’s academic STEM outcomes: Divergent effects on well-represented vs. underrepresented minority women. Cultural Diversity and Ethnic Minority Psychology, 26(2), 163–168. https://doi.org/10.1037/cdp0000289 First citation in articleCrossref, Google Scholar

  • O’Brien, L. T., Garcia, D. M., Adams, G., Villalobos, J. G., Hammer, E., & Gilbert, P. (2015). The threat of sexism in a stem educational setting: The moderating impacts of ethnicity and legitimacy beliefs on test performance. Social Psychology of Education, 18, 667–684. https://doi.org/10.1007/s11218-015-9310-1 First citation in articleCrossref, Google Scholar

  • Ober, T. M., & Cheng, Y. (2022). Test Anxiety Inventory – Scale validation. https://osf.io/ajfzx First citation in articleGoogle Scholar

  • Ober, T. M., Cheng, Y., Jacobucci, R., & Whitney, B. M. (2021). Examining the factor structure of the Big Five Inventory-2 with an adolescent sample. Psychological Assessment, 33(1), 14–28. https://doi.org/10.1037/pas0000962 First citation in articleCrossref, Google Scholar

  • Pekrun, R., Frenzel, A. C., Goetz, T., & Perry, R. P. (2007). The control-value theory of achievement emotions: An integrative approach to emotions in education. In P. A. SchutzR. PekrunEds., Emotion in education (pp. 13–36). Academic Press. First citation in articleGoogle Scholar

  • Primi, R., Santos, D., De Fruyt, F., & John, O. P. (2019). Comparison of classical and modern methods for measuring and correcting for acquiescence. British Journal of Mathematical and Statistical Psychology, 72(3), 447–465. https://doi.org/10.1111/bmsp.12168 First citation in articleCrossref, Google Scholar

  • Putnick, D. L., & Bornstein, M. H. (2016). Measurement invariance conventions and reporting: The state of the art and future directions for psychological research. Developmental Review, 41, 71–90. https://doi.org/10.1016/j.dr.2016.06.004 First citation in articleCrossref, Google Scholar

  • Putwain, D. W. (2008). Test anxiety and GCSE performance: The effect of gender and socio‐economic background. Educational Psychology in Practice, 24(4), 319–334. https://doi.org/10.1080/02667360802488765 First citation in articleCrossref, Google Scholar

  • Putwain, D. W., & Daly, A. L. (2014). Test anxiety prevalence and gender differences in a sample of English secondary school students. Educational Studies, 40(5), 554–570. https://doi.org/10.1080/03055698.2014.953914 First citation in articleCrossref, Google Scholar

  • Putwain, D. W., & Pescod, M. (2018). Is reducing uncertain control the key to successful test anxiety intervention for secondary school students? Findings from a randomized control trial. School Psychology Quarterly, 33(2), 283–292. https://doi.org/10.1037/spq0000228 First citation in articleCrossref, Google Scholar

  • Putwain, D. W., & Symes, W. (2011). Achievement goals as mediators of the relationship between competence beliefs and test anxiety. British Journal of Educational Psychology, 82(2), 207–224. https://doi.org/10.1111/j.2044-8279.2011.02021.x First citation in articleCrossref, Google Scholar

  • Putwain, D. W., von der Embse, N. P., Rainbird, E. C., & West, G. (2020). The development and validation of a new Multidimensional Test Anxiety Scale (MTAS). European Journal of Psychological Assessment, 37(3), 236–246. https://doi.org/10.1027/1015-5759/a000604 First citation in articleLink, Google Scholar

  • Raufelder, D., & Ringeisen, T. (2016). Self-perceived competence and test anxiety: The role of academic self-concept and self-efficacy. Journal of Individual Differences, 37(3), 159–167. https://doi.org/10.1027/1614-0001/a000202 First citation in articleLink, Google Scholar

  • Rodebaugh, T. L., Woods, C. M., & Heimberg, R. G. (2007). The reverse of social anxiety is not always the opposite: The reverse-scored items of the Social Interaction Anxiety Scale do not belong. Behavior Therapy, 38(2), 192–206. https://doi.org/10.1016/j.beth.2006.08.001 First citation in articleCrossref, Google Scholar

  • Roick, J., & Ringeisen, T. (2017). Self-efficacy, test anxiety, and academic success: A longitudinal validation. International Journal of Educational Research, 83, 84–93. https://doi.org/10.1016/j.ijer.2016.12.006 First citation in articleCrossref, Google Scholar

  • Rozek, C. S., Ramirez, G., Fine, R. D., & Beilock, S. L. (2019). Reducing socioeconomic disparities in the STEM pipeline through student emotion regulation. Proceedings of the National Academy of Sciences, 116(5), 1553–1558. https://doi.org/10.1073/pnas.1808589116 First citation in articleCrossref, Google Scholar

  • Sarason, I. G. (1972). Experimental approaches to test anxiety: Attention and the uses of information. In C. D. SpielbergerEd., Anxiety: Current trends in theory and research (Vol. 2, pp. 383–403). Academic Press. First citation in articleGoogle Scholar

  • Sarason, I. G. (1984). Stress, anxiety and cognitive interference: Reactions to tests. Journal of Personality and Social Psychology, 46(4), 929–938. https://doi.org/10.1037/0022-3514.46.4.929 First citation in articleCrossref, Google Scholar

  • Satorra, A., & Bentler, P. M. (2010). Ensuring positiveness of the scaled difference chi-square test statistic. Psychometrika, 75(2), 243–248. https://doi.org/10.1007/s11336-009-9135-y First citation in articleCrossref, Google Scholar

  • Schillinger, F. L., Mosbacher, J. A., Brunner, C., Vogel, S. E., & Grabner, R. H. (2021). Revisiting the role of worries in explaining the link between test anxiety and test performance. Educational Psychology Review, 33(4), 1887–1906. https://doi.org/10.1007/s10648-021-09601-0E First citation in articleCrossref, Google Scholar

  • Schneider, R., Sparfeldt, J. R., Niepel, C., Buch, S. R., & Rost, D. H. (2022). Measurement invariance of test anxiety across four school subjects. European Journal of Psychological Assessment, 38(5), 356–364. https://doi.org/10.1027/1015-5759/a000676 First citation in articleLink, Google Scholar

  • Simmons, J. P., Nelson, L. D., & Simonsohn, U. (2012, October 14). A 21 word solution. https://doi.org/10.2139/ssrn.2160588 First citation in articleCrossref, Google Scholar

  • Sireci, S. G., & Randall, J. (2021). Evolving notions of fairness in testing in the United States. In B. E. ClauserM. B. BunchEds., The history of educational measurement (pp. 111–135). Routledge. First citation in articleCrossref, Google Scholar

  • Spielberger, C. D., & Gonzalez, H. P. (1980). Preliminary professional manual for the Test Anxiety Inventory: (“Test Attitude Inventory”): TAI. Consulting Psychologists Press. First citation in articleGoogle Scholar

  • Spielberger, C. D., & Vagg, P. R. (1995). Test anxiety: A transactional process model. In C. D. SpielbergerP. R. VaggEds., Test anxiety: Theory, assessment, and treatment (pp. 3–14). Taylor & Francis. First citation in articleGoogle Scholar

  • Steedle, J. T., Hong, M., & Cheng, Y. (2019). The effects of inattentive responding on construct validity evidence when measuring social–emotional learning competencies. Educational Measurement: Issues and Practice, 38(2), 101–111. https://doi.org/10.1111/emip.12256 First citation in articleCrossref, Google Scholar

  • Sung, Y. T., Chao, T. Y., & Tseng, F. L. (2016). Reexamining the relationship between test anxiety and learning achievement: An individual-differences perspective. Contemporary Educational Psychology, 46, 241–252. https://doi.org/10.1016/j.cedpsych.2016.07.001 First citation in articleCrossref, Google Scholar

  • Szafranski, D. D., Barrera, T. L., & Norton, P. J. (2012). Test Anxiety Inventory: 30 years later. Anxiety, Stress & Coping, 25(6), 667–677. https://doi.org/10.1080/10615806.2012.663490 First citation in articleCrossref, Google Scholar

  • Talsma, K., Schüz, B., & Norris, K. (2019). Miscalibration of self-efficacy and academic performance: Self-efficacy ≠ self-fulfilling prophecy. Learning and Individual Differences, 69, 182–195. https://doi.org/10.1016/j.lindif.2018.11.002 First citation in articleCrossref, Google Scholar

  • Tavares, W., Brydges, R., Myre, P., & Prpic, J. (2018). Applying Kane’s validity framework to a simulation based assessment of clinical competence. Advances in Health Sciences Education, 23(1), 323–338. https://doi.org/10.1007/s10459-017-9800-3 First citation in articleCrossref, Google Scholar

  • Taylor, J., & Deane, F. P. (2002). Development of a short form of the Test Anxiety Inventory (TAI). The Journal of General Psychology, 129(2), 127–136. https://doi.org/10.1080/00221300209603133 First citation in articleCrossref, Google Scholar

  • von der Embse, N., & Hasson, R. (2012). Test anxiety and high-stakes test performance between school settings: Implications for educators. Preventing School Failure: Alternative Education for Children and Youth, 56(3), 180–187. https://doi.org/10.1080/1045988X.2011.633285 First citation in articleCrossref, Google Scholar

  • von der Embse, N. P., Kilgus, S. P., Segool, N., & Putwain, D. (2013). Identification and validation of a brief test anxiety screening tool. International Journal of School & Educational Psychology, 1(4), 246–258. https://doi.org/10.1080/21683603.2013.826152 First citation in articleCrossref, Google Scholar

  • von der Embse, N. P., Putwain, D. W., & Francis, G. (2021). Interpretation and use of the Multidimensional Test Anxiety Scale (MTAS). School Psychology, 36(2), 86–96. https://doi.org/10.1037/spq0000427 First citation in articleCrossref, Google Scholar

  • von der Embse, N., Barterian, J., & Segool, N. (2012). Test anxiety interventions for children and adolescents: A systematic review of Treatment Studies from 2000–2010. Psychology in the Schools, 50(1), 57–71. https://doi.org/10.1002/pits.21660 First citation in articleCrossref, Google Scholar

  • von der Embse, N., Jester, D., Roy, D., & Post, J. (2018). Test anxiety effects, predictors, and correlates: A 30-year meta-analytic review. Journal of Affective Disorders, 227, 483–493. https://doi.org/10.1016/j.jad.2017.11.048 First citation in articleCrossref, Google Scholar

  • Weijters, B., & Baumgartner, H. (2012). Misresponse to reversed and negated items in surveys: A review. Journal of Marketing Research, 49(5), 737–747. https://doi.org/10.1509/jmr.11.0368 First citation in articleCrossref, Google Scholar

  • Weiland, T. (2017). Problematizing statistical literacy: An intersection of critical and statistical literacies. Educational Studies in Mathematics, 96(1), 33–47. https://doi.org/10.1007/s10649-017-9764-5 First citation in articleCrossref, Google Scholar

  • Wetzel, E., & Carstensen, C. H. (2015). Multidimensional modeling of traits and response styles. European Journal of Psychological Assessment, 33(5), 352–364. https://doi.org/10.1027/1015-5759/a000291 First citation in articleLink, Google Scholar

  • Whitney, B. M., Cheng, Y., Brodersen, A. S., & Hong, M. R. (2019). The scale of student engagement in statistics: Development and initial validation. Journal of Psychoeducational Assessment, 37(5), 553–565. https://doi.org/10.1177/0734282918769983 First citation in articleCrossref, Google Scholar

  • Woldeab, D., & Brothen, T. (2019). 21st Century assessment: Online proctoring, test anxiety, and student performance. International Journal of E-Learning & Distance Education, 34(1). http://www.ijede.ca/index.php/jde/article/view/1106 First citation in articleGoogle Scholar

  • Zeidner, M., & Safir, M. P. (1989). Sex, ethnic, and social differences in test anxiety among Israeli adolescents. Journal of Genetic Psychology, 150(2), 175–185. https://doi.org/10.1080/00221325.1989.9914589 First citation in articleCrossref, Google Scholar

  • Zhang, X., & Savalei, V. (2016). Improving the factor structure of psychological scales: The Expanded format as an alternative to the Likert scale format. Educational and Psychological Measurement, 76(3), 357–386. https://doi.org/10.1177/0013164415596421 First citation in articleCrossref, Google Scholar