A Cross-Cultural Validation of the Implicit Positive and Negative Affect Test (IPANAT)
Results From Ten Countries Across Three Continents
Abstract
Abstract. Self-report measures of affect come with a number of difficulties that can be circumvented by using indirect measurement procedures. The Implicit Positive and Negative Affect Test (IPANAT) is a recently developed measure of automatic activation of representations of affective states and traits that draws on participants’ ratings of the extent to which nonsense words purportedly originating from an artificial language bear positive or negative meaning. Here we compared psychometric properties of this procedure across 10 countries and provide versions in corresponding languages (Chinese, Dutch, English, French, German, Italian, Polish, Russian, and Spanish). The results suggest good reliability, metric invariance, and construct validity across countries and languages. The IPANAT thus turns out as a useful tool for the indirect assessment of affect in different languages and cultures.
References
1989). The 2-factor model of self-reported mood: A cross-cultural replication. Journal of Personality Assessment, 53, 10–21.
(2013). Multi-country evaluation of affective experience: Validation of an abbreviated version of the Day Reconstruction Method in seven countries. PLoS One, 8, e61534.
(1998). Are women the “more emotional” sex? Evidence from emotional experiences in social context. Cognition and Emotion, 12, 555–578.
(2009). Implicit measure of emotions: Distinguishing among emotions of the same valence. Chicago, IL: University of Illinois Retrieved from http://indigo.uic.edu/bitstream/handle/10027/9163/Bartoszek_Gregory.pdf?sequence=1
(2000). Stalking the perfect measure of implicit self-esteem: The blind men and the elephant revisited? Journal of Personality and Social Psychology, 79, 631–643.
(2010). Skala uczuć pozytywnych i negatywnych (SUPIN). Polska adaptacja PANAS
([Positive and Negative Affect Scales: The Polish adaptation] . Warsaw, Poland: Pracownia Testów Psychologicznych.1989). Testing for the equivalence of factor covariance and mean structures: The issue of partial measurement invariance. Psychological Bulletin, 105, 456–466.
(1994). Relationship between attitudes and evaluative space: A critical review, with emphasis on the separability of positive and negative substrates. Psychological Bulletin, 115, 401–423.
(1999). The affect system: Architecture and operating characteristics. Current Directions in Psychological Science, 8, 133–137.
(2011). Are cross-cultural comparisons of personality profiles meaningful? Differential item and facet functioning in the Revised NEO Personality Inventory. Journal of Personality and Social Psychology, 101, 1068–1089.
(2001). Gender differences in personality traits across cultures: Robust and surprising findings. Journal of Personality and Social Psychology, 81, 322–331.
(2004). The positive and negative affect schedule (PANAS): Construct validity, measurement properties and normative data in a large non-clinical sample. British Journal of Clinical Psychology, 43, 245–265.
(2009). Implicit measures: A normative analysis and review. Psychological Bulletin, 135, 347–368.
(2012). The significance of hidden feelings. Validation of the IPANAT in two samples and its relationship with creativity. Ghent, Belgium: Ghent University Retrieved from http://lib.ugent.be/fulltxt/RUG01/001/893/964/RUG01-001893964_2012_0001_AC.pdf
(1995). The personality structure of affect. Journal of Personality and Social Psychology, 69, 130–141.
(1991). Gender and age stereotypes of emotionality. Personality and Social Psychology Bulletin, 17, 532–540.
(1995). Variability in automatic activation as an unobtrusive measure of racial attitudes: A bona fide pipeline? Journal of Personality and Social Psychology, 69, 1013–1027.
(2003). Implicit measures in social cognition research: Their meaning and use. Annual Review of Psychology, 54, 297–327.
(1998). Independence and bipolarity in the structure of current affect. Journal of Personality and Social Psychology, 74, 967–984.
(1995). Mood and judgment: The affect infusion model (AIM). Psychological Bulletin, 117, 39–66.
(1998). Affect in social judgments. Australian Journal of Psychology, 81, 1001–1013.
(2006). Positive and negative affective states in a performance-related setting: Testing the factorial structure of the PANAS across two samples of French-Canadian participants. European Journal of Psychological Assessment, 22, 240–249.
(2011). Psychometric properties of the Hungarian version of the original and the short form of the Positive and Negative Affect Schedule (PANAS). Neuropsychopharmacologia Hungarica, 13, 73–79.
(1992). When racial ambivalence evokes negative affect, using a disguised measure of mood. Personality and Social Psychology Bulletin, 18, 786–797.
(2011). Subliminal mere exposure and explicit and implicit positive affective responses. Cognition and Emotion, 25, 726–729.
(2005). A meta-analysis on the correlation between the Implicit Association Test and explicit self-report measures. Personality and Social Psychology Bulletin, 31, 1369–1385.
(2010). Cultures and Organizations: Software of the Mind (3rd ed.) Columbus, OH: McGraw-Hill.
(2007).
(Affect assessment through self-report methods . In J. RottenbergS. L. JohnsonEds., Emotion and psychopathology: Bridging affective and clinical science (pp. 13–34). Washington, DC: American Psychological Association.2005). Ascertaining the validity of individual protocols from Web-based personality inventories. Journal of Research in Personality, 39, 103–129.
(2005). The relation between culture and response styles. Evidence from 19 countries. Journal of Cross-Cultural Psychology, 36, 264–277.
(2011). Does survey format influence self-disclosure on sensitive question items? Computers in Human Behavior, 28, 251–256.
(2014). Personality interacts with implicit affect to predict performance in analytic vs. holistic processing. Journal of Personality. Advance online publication. doi: 10.1111/jopy.12100.
(2011). Reliability of implicit self-esteem measures revisited. European Journal of Personality, 25, 239–251.
(1996). Untersuchungen mit einer deutschen Version der “Positive and Negative Affect Schedule” (PANAS).
([Investigations with a German version of the “Positive and Negative Affect Schedule” (PANAS)] Diagnostica, 42, 139–156.2002). Tantalizing fantasies: Positive imagery induces negative mood in individuals high in fear of failure. Imagination, Cognition, and Personality, 21, 281–292.
(2001). Can people feel happy and sad at the same time? Journal of Personality and Social Psychology, 81, 684–696.
(1987). The relationship of emotion to cognition: A functional approach to a semantic controversy. Cognition and Emotion, 1, 3–28.
(1999). A short form of the positive and negative affect schedule: Evaluation of factorial validity and invariance across demographic variables in a community sample. Personality and Individual Differences, 27, 405–416.
(1990). Refining the measurement of mood: The UWIST Mood Adjective Checklist. British Journal of Psychology, 81, 17–42.
(2000). Some psychometric properties of the Positive and Negative Affect Schedule among Australian youth. Psychological Reports, 86, 1209–1212.
(2013). Psychometric properties of Positive and Negative Affect Schedule (PANAS) original and short forms in an African American community sample. Journal of Affective Disorders, 151, 942–949.
(2009). Exploratory factor analysis, confirmatory factor analysis, and structural equation modeling for continuous outcomes. Retrieved from https://www.statmodel.com/download/Topic%201.pdf
(2010). Mplus User’s Guide (Sixth Edition) Los Angeles, CA: Muthén & Muthén.
(2008). Testing the measurement equivalence of personality adjective items across cultures. Journal of Research in Personality, 42, 1524–1536.
(1994). The experience of emotions in everyday life. Cognition & Emotion, 8, 369–381.
(2012). Izmerenie pozitivnykh i negativnykh emotcii: razrabotka russkoiazychnogo analoga metodiki PANAS [Measuring Positive and Negative Affect: Development of a Russian Version of PANAS]. The Psychology. Journal of Higher School of Economics, 4, 91–110.
(2007).
(The self-report method . In R. W. RobinsR. C. FraleyR. F. KruegerEds., Handbook of research methods in personality psychology (pp. 224–239). New York, NY: Guilford.2005). An inkblot for attitudes: Affect misattribution as implicit measurement. Journal of Personality and Social Psychology, 89, 277–293.
(2008). Revision of the Positive Affect and Negative Affect Scale. Chinese Journal of Applied Psychology, 14, 249–254.
(2014). An alternative to self-reports of trait and state affect: The Implicit Positive and Negative Affect Test (IPANAT). European Journal of Psychological Assessment, 30, 231–237.
(2009). When nonsense sounds happy or helpless: The Implicit Positive and Negative Affect Test (IPANAT). Journal of Personality and Social Psychology, 97, 500–516.
(2009). Implicit but not explicit affectivity predicts circadian and reactive cortisol: Using the Implicit Positive and Negative Affect Test. Journal of Personality, 77, 401–425.
(2014). Profound versus superficial coping with mortality threats: Action orientation moderates implicit but not explicit outgroup prejudice. Personality and Social Psychology Bulletin. Advance online publication. doi: 10.1177/0146167214536928
(2002). Belief and feeling: Evidence for an accessibility model of emotional self-report. Psychological Bulletin, 128, 934–960.
(2003). Estudio sobre la traducción al español y las propiedades psicométricas de las escalas de afecto positivo y negativo (PANAS).
([Study on the spanish translation and the psychometric properties of the Positive and Negative Affect Scales (PANAS)] Salud Mental, 26, 69–75.1980). A Circumplex Model of Affect. Journal of Personality and Social Psychology, 39, 1161–1178.
(1989). A cross-cultural study of a circumplex model of affect. Journal of Personality and Social Psychology, 57, 848–856.
(2002). The relationship between positive and negative affect in the Positive and Negative Affect Schedule (PANAS). Journal of Research in Personality, 36, 463–475.
(2001). Assessment of implicit motives with a research version of the TAT: Picture profiles, gender differences, and relations to other personality measures. Journal of Personality Assessment, 77, 71–86.
(2012). Mental representations of attachment figures facilitate recovery following upsetting autobiographical memory recall. Journal of Personality and Social Psychology, 103, 362–378.
(2002). Speaking from the Heart: Gender and the Social Meaning of Emotion. Cambridge, UK: Cambridge University Press.
(2014). An attempt to construct a Japanese version of the Implicit Positive and Negative Affect Test (IPANAT). Japanese Journal of Psychology, 85, 294–303.
(2014). Parent-child proximity: Automatic cognitions matter. Social Indicators Research, 119, 967–978.
(2004). Reflective and Impulsive Determinants of Social Behavior. Personality and Social Psychology Review, 8, 220–247.
(2003). Factorial and construct validity of the Italian Positive and Negative Affect Schedule (PANAS). European Journal of Psychological Assessment, 19, 131–141.
(1996). The origin of everyday moods: managing energy, tension, and stress. New York, NY: Oxford University Press.
(2001). Calm energy. New York, NY: Oxford University Press.
(2007). Development and validation of an internationally reliable Short-Form of the Positive and Negative Affect Schedule (PANAS). Journal of Cross-Cultural Psychology, 32, 519–542.
(2004). Response styles in rating scales: Evidence of method bias in data from six EU countries. Journal of Cross-Cultural Psychology, 35, 346–350.
(2015). Careless responding on internet-based surveys. Observer, 28 Retrieved from http://www.psychologicalscience.org/index.php/publications/observer/2015/february-15/careless-responding-on-internet-based-surveys.html
(2013). Using virtual presence and survey instructions to minimize careless responding on Internet-based surveys. Computers in Human Behavior, 48, 554–568.
(2000). Mood and Temperament. New York, NY: Guilford.
(1994). The PANAS-X: Manual for the Positive and Negative Affect Schedule – Expanded Form. Retrieved from: http://ir.uiowa.edu/cgi/viewcontent.cgi?article=1011&context=psychology_pubs
(1988). Development and validation of brief measures of positive and negative affect: The PANAS scales. Journal of Personality and Social Psychology, 54, 1063–1070.
(1997). The effects of subliminal symbiotic stimulation on free-response and self-report mood. Journal of Nervous and Mental Disease, 185, 599–605.
(1997). Evidence for racial prejudice at the implicit level and its relationship to questionnaire measures. Journal of Personality and Social Psychology, 72, 262–274.
(2011). A 12-Point circumplex structure of core affect. Emotion, 11, 705–731.
(2013). Lost in translation: Thoughts regarding the translation of existing psychological measures into other languages. European Journal of Psychological Assessment, 29, 81–83.
(