Through a Glass, Less Darkly?
Reassessing Convergent and Discriminant Validity in Measures of Implicit Self-Esteem
Abstract
Self-esteem has been traditionally assessed via self-report (explicit self-esteem: ESE). However, the limitations of self-report have prompted efforts to assess self-esteem indirectly (implicit self-esteem: ISE). It has been theorized that ISE and ESE reflect the operation of largely distinct mental systems. However, although low correlations between measures of ISE and ESE empirically support their discriminant validity, similarly low correlations between different measures of ISE do not support their convergent validity. We explored whether such patterns would reemerge if more recently developed, specific, and reliable ISE measures were used. They did, although some convergent validity among ISE measures emerged once confounds resulting from conceptual mismatch, individual differences, and random variability were minimized. Nonetheless, low correlations among ISE measures are not primarily caused by the usual psychometric suspects, and may be the result of other factors including subtle differences between structural features of such measures.
References
2000). Stalking the perfect measure of implicit self-esteem: The blind men and the elephant revisited? Journal of Personality and Social Psychology, 79, 631–643.
(2001). Structural equation modeling with AMOS, basic concepts, applications, and programming. Hillsdale, NJ: Erlbaum.
(2003). The extrinsic affective Simon task. Experimental Psychology, 50, 77–85.
(2007). How to define and examine the implicitness of implicit measures. In , Implicit measures of attitudes: Procedures and controversies (pp. 179–194). New York: Guilford.
(2007). The identification-EAST as a valid measure of implicit attitudes toward alcohol-related stimuli. Journal of Behavior Therapy and Experimental Psychiatry, 38, 95–104.
(2008). When the method makes a difference: Antagonistic effects on automatic evaluations as a function of task characteristics of the measure. Manuscript submitted for publication.
(2000). Using the Implicit Association Test to measure self-esteem and self-concept. Journal of Personality and Social Psychology, 79, 1022–1038.
(1998). Measuring individual differences in implicit cognition: The Implicit Association Test. Journal of Personality and Social Psychology, 74, 1464–1480.
(2003). Understanding and using the Implicit Association Test: I. An improved scoring algorithm. Journal of Personality and Social Psychology, 85, 197–216.
(2008). Implicit self-esteem and narcissism: Rethinking the link. Manuscript submitted for publication.
(2005). A meta-analysis on the correlation between the Implicit Association Test and explicit self-report measures. Personality and Social Psychology Bulletin, 31, 1369–1385.
(2007). Intuition and the correspondence between implicit and explicit self-esteem. Journal of Personality and Social Psychology, 93, 1067–1079.
(2004). Measuring self-esteem using the Implicit Association Test: The role of the other. Personality and Social Psychology Bulletin, 30, 22–34.
(2006). The Single Category Implicit Association Test as a measure of implicit social cognition. Journal of Personality and Social Psychology, 91, 16–32.
(2007). Self-affection without self-reflection: Origins, models, and consequences of implicit self-esteem. In , The self (pp. 36–85). New York: Psychology Press.
(2001). Whats in a name: Implicit self-esteem and the automatic self. Journal of Personality and Social Psychology, 80, 669–685.
(2006). Reciprocal effects of self-concept and performance from a multidimensional perspective: Beyond seductive pleasure and unidimensional perspectives. Perspectives on Psychological Science, 1, 133–163.
(2001). The go/no-go association task. Social Cognition, 19, 625–666.
(2007). A multitrait-multimethod validation of the Implicit Association Test: Implicit and explicit attitudes are related but distinct constructs. Experimental Psychology, 54, 14–29.
(2007). Reporting tendencies underlie discrepancies between implicit and explicit measures of self-esteem. Psychological Science, 18, 287–291.
(1997). Psychological defence: Contemporary theory and research. In , Handbook of personality psychology (pp. 543–579). New York: Academic Press.
(2008). Why do implicit and explicit attitude tests diverge? The role of structural fit. Journal of Personality and Social Psychology, 94, 16–31.
(1977). Self-reference and the encoding of personal information. Journal of Personality Social Psychology, 35, 677–688.
(1965). Society and the adolescent self-image. Princeton, NJ: Princeton University Press.
(2004). Underlying processes in the Implicit Association Test (IAT): Dissociating salience from associations. Journal of Experimental Psychology: General, 133, 139–165.
(2006). Ein Impliziter Assoziationstest zur Erfassung von Selbstwertschätzung [
(An Implicit Association Test measuring self-esteem ]. In , Theorie und Praxis Objektiver Persönlichkeitstests [Theory and application of objective personality tests ] (pp. 153–163). Bern: Huber.2007). The hidden sides of self-esteem: Two dimensions of implicit self-esteem and their relation to narcissistic reactions. Journal of Experimental Social Psychology, 43, 995–1001.
(1982). Social anxiety and self-presentation: A conceptualization and model. Psychological Bulletin, 92, 641–669.
(2006). Assessing anxiety with extrinsic Simon tasks. Experimental Psychology, 53, 149–160.
(2007). High implicit self-esteem is not necessarily advantageous: Discrepancies between explicit and implicit self-esteem and their relationship with anger expression and psychological health. European Journal of Personality, 21, 319–339.
(2006). Die Multidimensionale Selbstwertskala (MSWS) [
(The multidimensional self-esteem scale ]. Göttingen: Hogrefe.2003). Portraits of the self. In , Sage handbook of social psychology (pp. 110–138). London: Sage.
(2008). Self-enhancement: Food for thought. Perspectives on Psychological Science, 3, 102–116.
(1997). Self-evaluation: To thine own self be good, to thine own self be sure, to thine own self be true, and to thine own self be better. In , Advances in experimental social psychology, 29 (pp. 209–269). New York: Academic Press.
(2004). Reflective and impulsive determinants of social behavior. Personality and Social Psychological Review, 8, 220–247.
(1968). Self-persuasion, social approval, and task success as determinants of self-esteem following impression management. Journal of Experimental Social Psychology, 4, 143–152.
(2002). Strangers to ourselves: Discovering the adaptive unconscious. Cambridge, MA: Harvard University Press.
(