Convergent and Predictive Validity of Implicit and Explicit Anxiety Measures as a Function of Specificity Similarity and Content Similarity
Abstract
In the present study we applied a validation strategy for implicit measures like the IAT, which complements multitrait-multimethod (MTMM) analyses. As the measurement method (implicit vs. explicit) and underlying representation format (associative vs. propositional) are often confounded, the validation of implicit measures has to go beyond MTMM analysis and requires substantive theoretical models. In the present study (N = 133), we employed such a model (Hofmann, Gschwendner, Nosek, & Schmitt, 2005) and investigated two moderator constructs in the realm of anxiety: specificity similarity and content similarity. In the first session, different general and specific anxiety measures were administered, among them an Implicit Association Test (IAT) general anxiety, an IAT-spider anxiety, and an IAT that assesses speech anxiety. In the second session, participants had to deliver a speech and behavioral indicators of speech anxiety were measured. Results showed that (a) implicit and explicit anxiety measures correlated significantly only on the same specification level and if they measured the same content, and (b) specific anxiety measures best predicted concrete anxious behavior. These results are discussed regarding the validation of implicit measures.
References
1977). Attitude-behavior relations: A theoretical analysis and review of empirical research. Psychological Bulletin, 84, 888–918.
(2002). Double dissociation between implicit and explicit personality self-concept: The case of shy behavior. Journal of Personality and Social Psychology, 83, 380–393.
(2001). Implicit attitudes toward homosexuality: Reliability, validity, and controllability of the IAT. Zeitschrift für Experimentelle Psychologie, 48, 145–160.
(1997). Interaktions-Angst-Fragebogen [
(Interaction anxiety questionnaire ]. Göttingen: Beltz.1956). Perception and representative design of psychological experiments. Berkeley: University of California Press.
(1959). Convergent and discriminant validation by the multitrait-multimethod matrix. Psychological Bulletin, 56, 81–105.
(1966). The scientific analysis of personality. Chicago: Aldine.
(1955). Construct validity in psychological tests. Psychological Bulletin, 52, 281–302.
(2002). Implicit and explicit prejudice and interracial interaction. Journal of Personality and Social Psychology, 82, 62–68.
(2002). Predictive validity of an implicit association test for assessing anxiety. Journal of Personality and Social Psychology, 83, 1441–1455.
(2006). From fear to love: Individual differences in implicit spider associations. Emotion, 6, 18–27.
(1962). An S-R-Inventory of anxiousness. Psychological Monographs, 76.
(1979). The stability of behavior: I. On predicting most of the people much of the time. Journal of Personality and Social Psychology, 37, 1097–1126.
(2002). What does the Implicit Association Test measure? A test of the convergent and discriminant validity of prejudice related IATs. Experimental Psychology, 49, 171–180.
(2006). Associative and propositional processes in evaluation: An integrative review of implicit and explicit attitude change. Psychological Bulletin, 132, 692–731.
(1998). Measuring individual differences in implicit cognition: The Implicit Association Test. Journal of Personality and Social Psychology, 74, 1464–1480.
(2003). Understanding and using the Implicit Association Test I: An improved scoring algorithm. Journal of Personality and Social Psychology, 85, 197–216.
(2005). A meta-analysis on the correlation between the Implicit Association Test and explicit self-report measures. Personality and Social Psychology Bulletin, 31, 1369–1385.
(2005). What moderates implicit-explicit consistency? European Review of Social Psychology, 16, 335–390.
(1973). The effects of two stressors on state anxiety for students who differ in trait anxiety. Journal of Research in Personality, 7, 116–126.
(1981). Das State-Trait-Angstinventar. Theoretische Grundlagen und Handanweisung [
(State-Trait Anxiety Inventory. Theoretical basics and manual ]. Weinheim: Beltz.2003). Method-specific variance in the Implicit Association Test. Journal of Personality and Social Psychology, 85, 1180–1192.
(1968). Personality and assessment. New York: Wiley.
(2007). Mplus users guide (4th ed.). Los Angeles: Muthén & Muthén.
(2007). A multitrait-multimethod validation of the Implicit Association Test: Implicit and explicit attitudes are related but distinct constructs. Experimental Psychology, 54, 14–29.
(2003). Big Five factors of personality and replicated prediction of behavior. Journal of Personality and Social Psychology, 84, 411–424.
(2005). Predictive models of implicit and explicit attitudes. British Journal of Social Psychology, 44, 29–45.
(in press ). Distinguishing automatic and controlled components of attitudes from direct and indirect measurement methods. Journal of Experimental Social Psychology.2002). Reliability and validity of German versions of three instruments measuring fear of spiders. Diagnostica, 48, 141–149.
(2003). Evaluating the fit of structural equation models: Test of significance and descriptive goodness-of-fit measures. Methods of Psychological Research Online, 8, 23–74.
(1992). The consistency of personality. In , Modern personality psychology. Critical reviews and new directions (pp. 29–55). New York: Harvester-Wheatsheaf.
(1983). Manual for the State-Trait Anxiety Inventory (STAI Form Y). Palo Alto, CA: Consulting Psychologists Press.
(1980). Tests for comparing elements of a correlation matrix. Psychological Bulletin, 87, 245–251.
(2004). Reflective and impulsive determinants of social behavior. Personality and Social Psychology Review, 8, 220–247.
(2001). Implicit associations for fear-relevant stimuli among individuals with snake and spider fears. Journal of Abnormal Psychology, 110, 226–235.
(