Skip to main content
Original Articles

Through a Glass, Less Darkly?

Reassessing Convergent and Discriminant Validity in Measures of Implicit Self-Esteem

Published Online:https://doi.org/10.1027/1015-5759.24.4.273

Self-esteem has been traditionally assessed via self-report (explicit self-esteem: ESE). However, the limitations of self-report have prompted efforts to assess self-esteem indirectly (implicit self-esteem: ISE). It has been theorized that ISE and ESE reflect the operation of largely distinct mental systems. However, although low correlations between measures of ISE and ESE empirically support their discriminant validity, similarly low correlations between different measures of ISE do not support their convergent validity. We explored whether such patterns would reemerge if more recently developed, specific, and reliable ISE measures were used. They did, although some convergent validity among ISE measures emerged once confounds resulting from conceptual mismatch, individual differences, and random variability were minimized. Nonetheless, low correlations among ISE measures are not primarily caused by the usual psychometric suspects, and may be the result of other factors including subtle differences between structural features of such measures.

References

  • Bosson, J.K. , Swann, W.B., Jr. , Pennebaker, J. (2000). Stalking the perfect measure of implicit self-esteem: The blind men and the elephant revisited? Journal of Personality and Social Psychology, 79, 631–643. First citation in articleCrossrefGoogle Scholar

  • Byrne, B.M. (2001). Structural equation modeling with AMOS, basic concepts, applications, and programming. Hillsdale, NJ: Erlbaum. First citation in articleGoogle Scholar

  • De Houwer, J. (2003). The extrinsic affective Simon task. Experimental Psychology, 50, 77–85. First citation in articleLinkGoogle Scholar

  • De Houwer, J. , Moors, A. (2007). How to define and examine the implicitness of implicit measures. In B. Wittenbrink, N. Schwarz, (Eds.), Implicit measures of attitudes: Procedures and controversies (pp. 179–194). New York: Guilford. First citation in articleGoogle Scholar

  • De Houwer, J. , De Bruycker, E. (2007). The identification-EAST as a valid measure of implicit attitudes toward alcohol-related stimuli. Journal of Behavior Therapy and Experimental Psychiatry, 38, 95–104. First citation in articleCrossrefGoogle Scholar

  • Deutsch, R. , Gawronski, B. (2008). When the method makes a difference: Antagonistic effects on “automatic evaluations” as a function of task characteristics of the measure. Manuscript submitted for publication. First citation in articleGoogle Scholar

  • Greenwald, A.G. , Farnham, S.D. (2000). Using the Implicit Association Test to measure self-esteem and self-concept. Journal of Personality and Social Psychology, 79, 1022–1038. First citation in articleCrossrefGoogle Scholar

  • Greenwald, A.G. , McGhee, D.E. , Schwartz, J.K.L. (1998). Measuring individual differences in implicit cognition: The Implicit Association Test. Journal of Personality and Social Psychology, 74, 1464–1480. First citation in articleCrossrefGoogle Scholar

  • Greenwald, A.G. , Nosek, B.A. , Banaji, M.R. (2003). Understanding and using the Implicit Association Test: I. An improved scoring algorithm. Journal of Personality and Social Psychology, 85, 197–216. First citation in articleCrossrefGoogle Scholar

  • Gregg, A.P. , Sedikides, C. (2008). Implicit self-esteem and narcissism: Rethinking the link. Manuscript submitted for publication. First citation in articleGoogle Scholar

  • Hofmann, W. , Gawronski, B. , Gschwendner, T. , Le, H. , Schmitt, M. (2005). A meta-analysis on the correlation between the Implicit Association Test and explicit self-report measures. Personality and Social Psychology Bulletin, 31, 1369–1385. First citation in articleCrossrefGoogle Scholar

  • Jordan, C.H. , Whitfield, M. , Zeigler-Hill, V. (2007). Intuition and the correspondence between implicit and explicit self-esteem. Journal of Personality and Social Psychology, 93, 1067–1079. First citation in articleCrossrefGoogle Scholar

  • Karpinski, A. (2004). Measuring self-esteem using the Implicit Association Test: The role of the other. Personality and Social Psychology Bulletin, 30, 22–34. First citation in articleCrossrefGoogle Scholar

  • Karpinski, A. , Steinman, R.B. (2006). The Single Category Implicit Association Test as a measure of implicit social cognition. Journal of Personality and Social Psychology, 91, 16–32. First citation in articleCrossrefGoogle Scholar

  • Koole, S.L. , DeHart, T. (2007). Self-affection without self-reflection: Origins, models, and consequences of implicit self-esteem. In C. Sedikides, S.J. Spencer, (Eds.), The self (pp. 36–85). New York: Psychology Press. First citation in articleGoogle Scholar

  • Koole, S.L. , Dijksterhuis, A. , van Knippenberg, A. (2001). What’s in a name: Implicit self-esteem and the automatic self. Journal of Personality and Social Psychology, 80, 669–685. First citation in articleCrossrefGoogle Scholar

  • Marsh, H.W. , Craven, R.G. (2006). Reciprocal effects of self-concept and performance from a multidimensional perspective: Beyond seductive pleasure and unidimensional perspectives. Perspectives on Psychological Science, 1, 133–163. First citation in articleCrossrefGoogle Scholar

  • Nosek, B.A. , Banaji, M.R. (2001). The go/no-go association task. Social Cognition, 19, 625–666. First citation in articleCrossrefGoogle Scholar

  • Nosek, B.A. , Smyth, F.L. (2007). A multitrait-multimethod validation of the Implicit Association Test: Implicit and explicit attitudes are related but distinct constructs. Experimental Psychology, 54, 14–29. First citation in articleLinkGoogle Scholar

  • Olson, M.A. , Fazio, R.H. , Hermann, A.D. (2007). Reporting tendencies underlie discrepancies between implicit and explicit measures of self-esteem. Psychological Science, 18, 287–291. First citation in articleGoogle Scholar

  • Paulhus, D.L. , Fridhandler, B. , Hayes, S. (1997). Psychological defence: Contemporary theory and research. In J. Johnson, R. Hogan, S.R. Briggs, (Eds.), Handbook of personality psychology (pp. 543–579). New York: Academic Press. First citation in articleCrossrefGoogle Scholar

  • Payne, B.K. , Burkley, M.A. , Stokes, M.B. (2008). Why do implicit and explicit attitude tests diverge? The role of structural fit. Journal of Personality and Social Psychology, 94, 16–31. First citation in articleCrossrefGoogle Scholar

  • Rogers T.B., Kuiper , N.A., & , Kirker, W.S. (1977). Self-reference and the encoding of personal information. Journal of Personality Social Psychology, 35, 677–688. First citation in articleCrossrefGoogle Scholar

  • Rosenberg, M. (1965). Society and the adolescent self-image. Princeton, NJ: Princeton University Press. First citation in articleCrossrefGoogle Scholar

  • Rothermund, K. , Wentura, D. (2004). Underlying processes in the Implicit Association Test (IAT): Dissociating salience from associations. Journal of Experimental Psychology: General, 133, 139–165. First citation in articleCrossrefGoogle Scholar

  • Rudolph, A. , Schröder, M. , Schütz, A. (2006). Ein Impliziter Assoziationstest zur Erfassung von Selbstwertschätzung [An Implicit Association Test measuring self-esteem]. In T.M. Ortner, R.T. Proyer, K.D. Kubinger, (Hrsg.), Theorie und Praxis Objektiver Persönlichkeitstests [Theory and application of objective personality tests] (pp. 153–163). Bern: Huber. First citation in articleGoogle Scholar

  • Sakellaropoulo, M. , Baldwin, M.W. (2007). The hidden sides of self-esteem: Two dimensions of implicit self-esteem and their relation to narcissistic reactions. Journal of Experimental Social Psychology, 43, 995–1001. First citation in articleCrossrefGoogle Scholar

  • Schlenker, B.R. , Leary, M.R. (1982). Social anxiety and self-presentation: A conceptualization and model. Psychological Bulletin, 92, 641–669. First citation in articleCrossrefGoogle Scholar

  • Schmukle, S.C. , Egloff, B. (2006). Assessing anxiety with extrinsic Simon tasks. Experimental Psychology, 53, 149–160. First citation in articleLinkGoogle Scholar

  • Schröder-Abé, M. , Rudolph, A. , Schütz, A. (2007). High implicit self-esteem is not necessarily advantageous: Discrepancies between explicit and implicit self-esteem and their relationship with anger expression and psychological health. European Journal of Personality, 21, 319–339. First citation in articleCrossrefGoogle Scholar

  • Schütz, A. , Sellin, I. (2006). Die Multidimensionale Selbstwertskala (MSWS) [The multidimensional self-esteem scale]. Göttingen: Hogrefe. First citation in articleGoogle Scholar

  • Sedikides, C. , Gregg, A.P. (2003). Portraits of the self. In M.A. Hogg, J. Cooper, (Eds.), Sage handbook of social psychology (pp. 110–138). London: Sage. First citation in articleGoogle Scholar

  • Sedikides, C. , Gregg, A.P. (2008). Self-enhancement: Food for thought. Perspectives on Psychological Science, 3, 102–116. First citation in articleCrossrefGoogle Scholar

  • Sedikides, C. , Strube, M.J. (1997). Self-evaluation: To thine own self be good, to thine own self be sure, to thine own self be true, and to thine own self be better. In M.P. Zanna, (Ed.), Advances in experimental social psychology, 29 (pp. 209–269). New York: Academic Press. First citation in articleCrossrefGoogle Scholar

  • Strack, F. , Deutsch, R. (2004). Reflective and impulsive determinants of social behavior. Personality and Social Psychological Review, 8, 220–247. First citation in articleCrossrefGoogle Scholar

  • Upshaw, H.S. , Yates, L.A. (1968). Self-persuasion, social approval, and task success as determinants of self-esteem following impression management. Journal of Experimental Social Psychology, 4, 143–152. First citation in articleCrossrefGoogle Scholar

  • Wilson, T.D. (2002). Strangers to ourselves: Discovering the adaptive unconscious. Cambridge, MA: Harvard University Press. First citation in articleGoogle Scholar