Skip to main content
Original Article

Applying Item Response Theory to the Evaluation and Revision of the Wettkampfangst-Inventar-State (WAI-S)

Published Online:https://doi.org/10.1026/1612-5010/a000384

Abstract: Research investigating competitive anxiety is typically based on the Competitive State Anxiety Inventory-2 (Martens, Burton et al., 1990), its revision, or its derivatives in other languages. The psychometric quality of these scales as a whole has been determined according to classic test theory but it has not been assessed at the item level. Thus, the present research assessed the psychometric properties of the German derivative of this instrument, the German Wettkampfangst-Inventar-State (WAI-S; Ehrlenspiel et al., 2009) at the item level and tested a revised and extended version of the WAI-S by using an analytical approach based on item response theory. In Study 1, graded response models (GRMs) were fitted to the three subscales of the WAI-S using the original dataset collected for its development. We provided evidence indicating the sufficient psychometric properties of the somatic subscale, but we also identified some unfavorable properties of items in the cognitive anxiety and the self-confidence subscales. Thus, in Study 2, a revised and extended 16-item version of the WAI-S with 10 new items was generated and administered to a new sample of 322 German athletes. On the basis of the GRM results, we identified items with poor quality. We subsequently selected 12 appropriate items to generate a revised version of the WAI-S with stronger psychometric properties than the original instrument. We believe that the revised version of the WAI-S will increase the usability of competitive state anxiety assessments in both research and practice.


Evaluation und Revision des Wettkampfangst-Inventar-State mit Hilfe der Item Response Theory

Zusammenfassung: Die Forschung zu Wettkampfangst basiert in der Regel auf dem Competitive State Anxiety Inventory-2 (Martens, Burton, Vealey, Bump & Smith, 1990). Anders als in bisherigen Studien, welche die psychometrischen Eigenschaften auf Basis der Klassischen Testtheorie prüfen, wurde in dieser Studie das Wettkampfangst-Inventar-State (WAI-S; Ehrlenspiel, Brand & Graf, 2009) auf der Basis der Item-Response-Theorie untersucht. In Studie 1 wurden Graded-Response-Modelle (GRMs) an die drei Subskalen des WAI-S angepasst. Die psychometrischen Eigenschaften der somatischen Subskala zeigen sich als ausreichend, Items der Subskalen Kognitive Angst und Zuversicht besitzen teilweise ungünstige Eigenschaften. Daher wurde in Studie 2 eine überarbeitete und erweiterte 16-Item-Version des WAI-S und getestet. Auf der Grundlage der GRM-Ergebnisse werden abschließend 12 geeignete Items und damit eine überarbeitete Version des WASI-S vorgeschlagen. Wir sind davon überzeugt, dass die überarbeitete Version des WAI-S die Präzision bei der Erfassung von Wettkampfangst sowohl in der Forschung als auch in der Praxis erhöhen wird.

Literatur

  • Acevedo-Mesa, A., Tendeiro, J. N., Roest, A., Rosmalen, J. G., & Monden, R. (2021). Improving the measurement of functional somatic symptoms with item response theory. Assessment, 28 (8), 1960 – 1970. https://doi.org/10.1177/1073191120947153 First citation in articleCrossrefGoogle Scholar

  • Baker, F. B. (2001). The basics of item response theory (2nd ed.). ERIC. https://eric.ed.gov/?id=ED458219 First citation in articleGoogle Scholar

  • Beckmann, J., Gröpel, P., & Ehrlenspiel, F. (2013). Preventing motor skill failure through hemisphere—specific priming: Cases from choking under pressure. Journal of Experimental Psychology: General, 142 (3), 679 – 691. https://doi.org/10.1037/a0029852 First citation in articleCrossrefGoogle Scholar

  • Chalmers, R. P. (2012). mirt: A multidimensional item response theory package for the R environment. Journal of Statistical Software, 48 (6), 1 – 29. https://doi.org/10.18637/jss.v048.i06 First citation in articleCrossrefGoogle Scholar

  • Cohen, J. (1988). Statistical power analyses for the behavioral sciences (2nd ed.). Lawrence Erlbaum Associates. First citation in articleGoogle Scholar

  • Cox, R. H., Martens, M. P., & Russell, W. D. (2003). Measuring anxiety in athletics: the revised competitive state anxiety inventory–2. Journal of Sport and Exercise Psychology, 25 (4), 519 – 533. https://doi.org/10.1123/jsep.25.4.519 First citation in articleCrossrefGoogle Scholar

  • Dietrich, H., & Ehrlenspiel, F. (2010). Cognitive interviewing: A qualitative tool for improving questionnaires in sport science. Measurement in Physical Education and Exercise Science, 14 (1), 51 – 60. https://doi.org/10.1080/10913670903455025 First citation in articleCrossrefGoogle Scholar

  • Durante, R., & Ainsworth, B. E. (1996). The recall of physical activity: Using a cognitive model of the question-answering process. Medicine & Science in Sports & Exercise, 28 (10), 1282 – 1291. https://doi.org/10.1097/00005768-199610000-00012 First citation in articleCrossrefGoogle Scholar

  • Ehrlenspiel, F., Brand, R., & Graf, K. (2009). Das Wettkampfangst-Inventar–State [The competitive anxiety inventory state]. In R. BrandF. EhrlenspielK. Graf (Eds.), Das Wettkampfangst-Inventar, Manual [The competitive anxiety inventory, manual] (pp. 71 – 100). Bundesinstitut für Sportwissenschaft. First citation in articleGoogle Scholar

  • Ehrlenspiel, F., Graf, K., Kühn, C., & Brand, R. (2011). Stabilität und Variabilität von Wettkampfangst [Stability and variability of competitive anxiety]. Zeitschrift für Sportpsychologie, 18 (1), 31 – 43. https://doi.org/10.1026/1612-5010/a000034 First citation in articleLinkGoogle Scholar

  • Ehrlenspiel, F., Wei, K., & Sternad, D. (2010). Open-loop, closed-loop and compensatory control: performance improvement under pressure in a rhythmic task. Experimental Brain Research, 201, 729 – 741. https://doi.org/10.1007/s00221-009-2087-8 First citation in articleCrossrefGoogle Scholar

  • Embretson, S. E., & Reise, S. P. (2000). Item response theory for psychologists. Lawrence Erlbaum Associates. First citation in articleGoogle Scholar

  • Hanton, S., Mellalieu, S. D., & Hall, R. (2004). Self-confidence and anxiety interpretation: A qualitative investigation. Psychology of Sport and Exercise, 5 (4), 477 – 495. https://doi.org/10.1016/S1469-0292(03)00040-2 First citation in articleCrossrefGoogle Scholar

  • Heine, J.-H. (2019). Pairwise: Rasch model parameters by pairwise algorithm (Version 0.4.4-5.1). https://CRAN.R-project.org/package=pairwise First citation in articleGoogle Scholar

  • Khazaal, Y., Breivik, K., Billieux, J., Zullino, D., Thorens, G., Achab, S., Gmel, G., & Chatton, A. (2018). Game addiction scale assessment through a nationally representative sample of young adult men: Item response theory graded–response modeling. Journal of Medical Internet Research, 20 (8), 1 – 16. https://doi.org/10.2196/10058 First citation in articleCrossrefGoogle Scholar

  • Kuan, G., Morris, T., Kueh, Y. C., & Terry, P. C. (2018). Effects of relaxing and arousing music during imagery training on dart-throwing performance, physiological arousal indices, and competitive state anxiety. Frontiers in Psychology, 9, Article 14 https://doi.org/10.3389/fpsyg.2018.00014 First citation in articleCrossrefGoogle Scholar

  • Liebert, R. M., & Morris, L. W. (1967). Cognitive and emotional components of test anxiety: A distinction and some initial data. Psychological Reports, 20 (3), 975 – 978. https://doi.org/10.2466/pr0.1967.20.3.975 First citation in articleCrossrefGoogle Scholar

  • Linacre, J. M. (1998). Detecting multidimensionality: Which residual data-type works best? Journal of Outcome Measurement, 2 (3), 266 – 283. First citation in articleGoogle Scholar

  • Lundqvist, C., & Hassmén, P. (2005). Competitive State Anxiety Inventory-2 (CSAI-2): Evaluating the Swedish version by confirmatory factor analyses. Journal of Sports Sciences, 23 (7), 727 – 736. https://doi.org/10.1080/02640410400021484 First citation in articleCrossrefGoogle Scholar

  • Martens, R., Burton, D., Vealey, R. S., Bump, L. A., & Smith, D. E. (1990). Development and validation of the Competitive State Anxiety Inventory-2. In R. MartensR. S. VealeyD. Burton (Eds.), Competitive anxiety in sport (pp. 117 – 213). Human Kinetics. First citation in articleGoogle Scholar

  • Martens, R., Vealey, R. S., & Burton, D. (1990). Competitive anxiety in sport. Human Kinetics. First citation in articleGoogle Scholar

  • R Core Team. (2019). R: A language and environment for statistical computing. R Foundation for Statistical Computing. First citation in articleGoogle Scholar

  • Reise, S. P., & Waller, N. G. (2009). Item response theory and clinical measurement. Annual Review of Clinical Psychology, 5, 27 – 48. https://doi.org/10.1146/annurev.clinpsy.032408.153553 First citation in articleCrossrefGoogle Scholar

  • Reise, S. R., Cook, K. F., & Moore, T. M. (2015). Evaluating the impact of multidimensionality on unidimensional item response theory model parameters. In S. P. ReiseD. A. Revicki (Eds.), Handbook of item response theory modeling: Applications to typical performance assessment (pp. 13 – 40). Routledge. First citation in articleGoogle Scholar

  • Röthlin, P., Horvath, S., Trösch, S., & Birrer, D. (2020). Differential and shared effects of psychological skills training and mindfulness training on performance-relevant psychological factors in sport: a randomized controlled trial. BMC Psychology, 8 Article 80 https://doi.org/10.1186/s40359-020-00449-7 First citation in articleCrossrefGoogle Scholar

  • Samejima, F. (1969). Estimation of latent ability using a response pattern of graded scores. Psychometrika, 34, 1 – 97. https://doi.org/10.1007/BF03372160 First citation in articleCrossrefGoogle Scholar

  • Schönbrodt, F. D., & Gerstenberg, F. X. (2012). An IRT analysis of motive questionnaires: The unified motive scales. Journal of Research in Personality, 46 (6), 725 – 742. https://doi.org/10.1016/j.jrp.2012.08.010 First citation in articleCrossrefGoogle Scholar

  • Smith, R. E., Smoll, F. L., & Schutz, R. W. (1990). Measurement and correlates of sport-specific cognitive and somatic trait anxiety: The Sport Anxiety Scale. Anxiety Research, 2 (4), 263 – 280. https://doi.org/10.1080/08917779008248733 First citation in articleCrossrefGoogle Scholar

  • Spielberger, C. D. (1966). Theory and research on anxiety. In C. D. Spielberger (Ed.), Anxiety and behavior (pp. 3 – 20). Academic Press. First citation in articleCrossrefGoogle Scholar

  • Stochl, J., Jones, P. B., & Croudace, T. J. (2012). Mokken scale analysis of mental health and well-being questionnaire item responses: A non-parametric IRT method in empirical research for applied health researchers. BMC Medical Research Methodology, 12 Article 74 https://doi.org/10.1186/1471-2288-12-74 First citation in articleCrossrefGoogle Scholar

  • Strahler, K., Ehrlenspiel, F., Heene, M., & Brand, R. (2010). Competitive anxiety and cortisol awakening response in the week leading up to a competition. Psychology of Sport and Exercise, 11 (2), 148 – 154. https://doi.org/10.1016/j.psychsport.2009.10.003 First citation in articleCrossrefGoogle Scholar

  • Thissen, D. (2000). Reliability and measurement precision. In H. Wainer (Ed.), Computerized adaptive testing: A primer (2nd ed., pp. 159 – 184). Lawrence Erlbaum Associates. First citation in articleGoogle Scholar

  • Tsorbatzoudis, H., Barkoukis, V., Sideridis, G., & Grouios, G. (2002). Confirmatory factor analysis of the Greek version of the Competitive State Anxiety Inventory-2 (CSAI-2). International Journal of Sport Psychology, 33 (2), 182 – 194. First citation in articleGoogle Scholar

  • Van der Ark, L. A. (2007). Mokken scale analysis in R. Journal of Statistical Software, 20 (11), 1 – 19. https://doi.org/10.18637/jss.v020.i11. First citation in articleCrossrefGoogle Scholar

  • Weis, M., & Heine, J.-H. (2020). Assessing emotion regulation strategies in Chile: A Spanish language adaptation of the German SSKJ 3 – 8 scales. Frontiers in Psychology, 10, Article 2870 https://doi.org/10.3389/fpsyg.2019.02870 First citation in articleCrossrefGoogle Scholar

  • Willis, G. B. (2005). Cognitive interviewing – a tool for improving questionnaire design. Sage. First citation in articleCrossrefGoogle Scholar

  • Woodman, T. I. M., & Hardy, L. E. W. (2003). The relative impact of cognitive anxiety and self-confidence upon sport performance: A meta-analysis. Journal of Sports Sciences, 21 (6), 443 – 457. https://doi.org/10.1080/0264041031000101809 First citation in articleCrossrefGoogle Scholar

  • Wright, B. D. (1996). Comparing Rasch measurement and factor analysis. Structural Equation Modeling, 3 (1), 3 – 24. https://doi.org/10.1080/10705519609540026 First citation in articleCrossrefGoogle Scholar

  • Ziegler, M., Ehrlenspiel, F., & Brand, R. (2009). Latent state–trait theory: An application in sport psychology. Psychology of Sport and Exercise, 10 (3), 344 – 349. https://doi.org/10.1016/j.psychsport.2008.12.004 First citation in articleCrossrefGoogle Scholar