Applying Item Response Theory to the Evaluation and Revision of the Wettkampfangst-Inventar-State (WAI-S)
Abstract
Abstract: Research investigating competitive anxiety is typically based on the Competitive State Anxiety Inventory-2 (Martens, Burton et al., 1990), its revision, or its derivatives in other languages. The psychometric quality of these scales as a whole has been determined according to classic test theory but it has not been assessed at the item level. Thus, the present research assessed the psychometric properties of the German derivative of this instrument, the German Wettkampfangst-Inventar-State (WAI-S; Ehrlenspiel et al., 2009) at the item level and tested a revised and extended version of the WAI-S by using an analytical approach based on item response theory. In Study 1, graded response models (GRMs) were fitted to the three subscales of the WAI-S using the original dataset collected for its development. We provided evidence indicating the sufficient psychometric properties of the somatic subscale, but we also identified some unfavorable properties of items in the cognitive anxiety and the self-confidence subscales. Thus, in Study 2, a revised and extended 16-item version of the WAI-S with 10 new items was generated and administered to a new sample of 322 German athletes. On the basis of the GRM results, we identified items with poor quality. We subsequently selected 12 appropriate items to generate a revised version of the WAI-S with stronger psychometric properties than the original instrument. We believe that the revised version of the WAI-S will increase the usability of competitive state anxiety assessments in both research and practice.
Zusammenfassung: Die Forschung zu Wettkampfangst basiert in der Regel auf dem Competitive State Anxiety Inventory-2 (Martens, Burton, Vealey, Bump & Smith, 1990). Anders als in bisherigen Studien, welche die psychometrischen Eigenschaften auf Basis der Klassischen Testtheorie prüfen, wurde in dieser Studie das Wettkampfangst-Inventar-State (WAI-S; Ehrlenspiel, Brand & Graf, 2009) auf der Basis der Item-Response-Theorie untersucht. In Studie 1 wurden Graded-Response-Modelle (GRMs) an die drei Subskalen des WAI-S angepasst. Die psychometrischen Eigenschaften der somatischen Subskala zeigen sich als ausreichend, Items der Subskalen Kognitive Angst und Zuversicht besitzen teilweise ungünstige Eigenschaften. Daher wurde in Studie 2 eine überarbeitete und erweiterte 16-Item-Version des WAI-S und getestet. Auf der Grundlage der GRM-Ergebnisse werden abschließend 12 geeignete Items und damit eine überarbeitete Version des WASI-S vorgeschlagen. Wir sind davon überzeugt, dass die überarbeitete Version des WAI-S die Präzision bei der Erfassung von Wettkampfangst sowohl in der Forschung als auch in der Praxis erhöhen wird.
Literatur
2021). Improving the measurement of functional somatic symptoms with item response theory. Assessment, 28 (8), 1960 – 1970. https://doi.org/10.1177/1073191120947153
(2001). The basics of item response theory (2nd ed.). ERIC. https://eric.ed.gov/?id=ED458219
(2013). Preventing motor skill failure through hemisphere—specific priming: Cases from choking under pressure. Journal of Experimental Psychology: General, 142 (3), 679 – 691. https://doi.org/10.1037/a0029852
(2012). mirt: A multidimensional item response theory package for the R environment. Journal of Statistical Software, 48 (6), 1 – 29. https://doi.org/10.18637/jss.v048.i06
(1988). Statistical power analyses for the behavioral sciences (2nd ed.). Lawrence Erlbaum Associates.
(2003). Measuring anxiety in athletics: the revised competitive state anxiety inventory–2. Journal of Sport and Exercise Psychology, 25 (4), 519 – 533. https://doi.org/10.1123/jsep.25.4.519
(2010). Cognitive interviewing: A qualitative tool for improving questionnaires in sport science. Measurement in Physical Education and Exercise Science, 14 (1), 51 – 60. https://doi.org/10.1080/10913670903455025
(1996). The recall of physical activity: Using a cognitive model of the question-answering process. Medicine & Science in Sports & Exercise, 28 (10), 1282 – 1291. https://doi.org/10.1097/00005768-199610000-00012
(2009).
(Das Wettkampfangst-Inventar–State [The competitive anxiety inventory state ]. In R. BrandF. EhrlenspielK. Graf (Eds.), Das Wettkampfangst-Inventar, Manual [The competitive anxiety inventory, manual] (pp. 71 – 100). Bundesinstitut für Sportwissenschaft.2011). Stabilität und Variabilität von Wettkampfangst [Stability and variability of competitive anxiety]. Zeitschrift für Sportpsychologie, 18 (1), 31 – 43. https://doi.org/10.1026/1612-5010/a000034
(2010). Open-loop, closed-loop and compensatory control: performance improvement under pressure in a rhythmic task. Experimental Brain Research, 201, 729 – 741. https://doi.org/10.1007/s00221-009-2087-8
(2000). Item response theory for psychologists. Lawrence Erlbaum Associates.
(2004). Self-confidence and anxiety interpretation: A qualitative investigation. Psychology of Sport and Exercise, 5 (4), 477 – 495. https://doi.org/10.1016/S1469-0292(03)00040-2
(2019). Pairwise: Rasch model parameters by pairwise algorithm (Version 0.4.4-5.1). https://CRAN.R-project.org/package=pairwise
(2018). Game addiction scale assessment through a nationally representative sample of young adult men: Item response theory graded–response modeling. Journal of Medical Internet Research, 20 (8), 1 – 16. https://doi.org/10.2196/10058
(2018). Effects of relaxing and arousing music during imagery training on dart-throwing performance, physiological arousal indices, and competitive state anxiety. Frontiers in Psychology, 9, Article 14 https://doi.org/10.3389/fpsyg.2018.00014
(1967). Cognitive and emotional components of test anxiety: A distinction and some initial data. Psychological Reports, 20 (3), 975 – 978. https://doi.org/10.2466/pr0.1967.20.3.975
(1998). Detecting multidimensionality: Which residual data-type works best? Journal of Outcome Measurement, 2 (3), 266 – 283.
(2005). Competitive State Anxiety Inventory-2 (CSAI-2): Evaluating the Swedish version by confirmatory factor analyses. Journal of Sports Sciences, 23 (7), 727 – 736. https://doi.org/10.1080/02640410400021484
(1990).
(Development and validation of the Competitive State Anxiety Inventory-2 . In R. MartensR. S. VealeyD. Burton (Eds.), Competitive anxiety in sport (pp. 117 – 213). Human Kinetics.1990). Competitive anxiety in sport. Human Kinetics.
(2019). R: A language and environment for statistical computing. R Foundation for Statistical Computing.
(2009). Item response theory and clinical measurement. Annual Review of Clinical Psychology, 5, 27 – 48. https://doi.org/10.1146/annurev.clinpsy.032408.153553
(2015).
(Evaluating the impact of multidimensionality on unidimensional item response theory model parameters . In S. P. ReiseD. A. Revicki (Eds.), Handbook of item response theory modeling: Applications to typical performance assessment (pp. 13 – 40). Routledge.2020). Differential and shared effects of psychological skills training and mindfulness training on performance-relevant psychological factors in sport: a randomized controlled trial. BMC Psychology, 8 Article 80 https://doi.org/10.1186/s40359-020-00449-7
(1969). Estimation of latent ability using a response pattern of graded scores. Psychometrika, 34, 1 – 97. https://doi.org/10.1007/BF03372160
(2012). An IRT analysis of motive questionnaires: The unified motive scales. Journal of Research in Personality, 46 (6), 725 – 742. https://doi.org/10.1016/j.jrp.2012.08.010
(1990). Measurement and correlates of sport-specific cognitive and somatic trait anxiety: The Sport Anxiety Scale. Anxiety Research, 2 (4), 263 – 280. https://doi.org/10.1080/08917779008248733
(1966).
(Theory and research on anxiety . In C. D. Spielberger (Ed.), Anxiety and behavior (pp. 3 – 20). Academic Press.2012). Mokken scale analysis of mental health and well-being questionnaire item responses: A non-parametric IRT method in empirical research for applied health researchers. BMC Medical Research Methodology, 12 Article 74 https://doi.org/10.1186/1471-2288-12-74
(2010). Competitive anxiety and cortisol awakening response in the week leading up to a competition. Psychology of Sport and Exercise, 11 (2), 148 – 154. https://doi.org/10.1016/j.psychsport.2009.10.003
(2000).
(Reliability and measurement precision . In H. Wainer (Ed.), Computerized adaptive testing: A primer (2nd ed., pp. 159 – 184). Lawrence Erlbaum Associates.2002). Confirmatory factor analysis of the Greek version of the Competitive State Anxiety Inventory-2 (CSAI-2). International Journal of Sport Psychology, 33 (2), 182 – 194.
(2007). Mokken scale analysis in R. Journal of Statistical Software, 20 (11), 1 – 19. https://doi.org/10.18637/jss.v020.i11.
(2020). Assessing emotion regulation strategies in Chile: A Spanish language adaptation of the German SSKJ 3 – 8 scales. Frontiers in Psychology, 10, Article 2870 https://doi.org/10.3389/fpsyg.2019.02870
(2005). Cognitive interviewing – a tool for improving questionnaire design. Sage.
(2003). The relative impact of cognitive anxiety and self-confidence upon sport performance: A meta-analysis. Journal of Sports Sciences, 21 (6), 443 – 457. https://doi.org/10.1080/0264041031000101809
(1996). Comparing Rasch measurement and factor analysis. Structural Equation Modeling, 3 (1), 3 – 24. https://doi.org/10.1080/10705519609540026
(2009). Latent state–trait theory: An application in sport psychology. Psychology of Sport and Exercise, 10 (3), 344 – 349. https://doi.org/10.1016/j.psychsport.2008.12.004
(