On the Structure of Affect
A Meta-Analytic Investigation of the Dimensionality and the Cross-National Applicability of the Positive and Negative Affect Schedule (PANAS)
Abstract
Abstract. The Positive and Negative Affect Schedule (PANAS; Watson et al., 1988) is a popular self-report questionnaire that is administered all over the world. Though originally developed to measure two independent factors, different models have been proposed in the literature. Comparisons among alternative models as well as analyses concerning their robustness in cross-national research have left an inconclusive picture. Therefore, the present study evaluates the dimensionality of the PANAS and differences between English and translated versions of the PANAS using a meta-analytic structural equation modeling approach. Correlation matrices from 57 independent samples (N = 54,043) were pooled across subsamples. For both English and non-English samples, a correlated two-factor model including correlated uniquenesses provided the best fit. However, measurement invariance analyses indicated differences in factor loadings between subsamples. Thus, cross-national application of the PANAS might only be justified if measurement equivalence was explicitly tested for the countries at hand.
References References marked with an asterisk are included in the meta-analysis
2017). Urdu translation and validation of shorter version of Positive Affect and Negative Affect Schedule (PANAS) on Pakistani bank employees. The Journal of the Pakistan Medical Association, 67(10), 1517–1523.
(2019). Using Anchor-Based Methods to Determine the Smallest Effect Size of Interest, https://doi.org/10.31234/osf.io/syp5a
(1999). The role of culture and gender in the relationship between positive and negative affect. Cognition and Emotion, 13(6), 641–672. https://doi.org/10.1080/026999399379023
(2012). Altern und Lebenserfahrung im Erwachsenenalter (ALLEE): Forschungsdaten [Data file]
([Aging and life experience in adulthood (ALLEE): Research data] . https://doi.org/10.5160/PSYCHDATA.LGFR97AL012019). Orthorexia nervosa and healthy orthorexia as new eating styles. PLoS One, 14(7), e0219609. https://doi.org/10.1371/journal.pone.0219609
(2014). Pain as social glue: Shared pain increases cooperation. Psychological Science, 25(11), 2079–2085. https://doi.org/10.1177/0956797614545886
(2003). Differentiating anxiety and depression in older adults with generalized anxiety disorder. Psychological Assessment, 15(2), 184–192. https://doi.org/10.1037/1040-3590.15.2.184
(1990). Comparative fit indexes in structural models. Psychological Bulletin, 107(2), 238–246. https://doi.org/10.1037/0033-2909.107.2.238
(2019). The role of lay beliefs about group transgressions in acceptance of responsibility for ingroup harm-doing. European Journal of Social Psychology, 49(5), 992–1006. https://doi.org/10.1002/ejsp.2583
(2018). Further considerations regarding PANAS: Contributions from four studies with different Argentinean samples. Suma Psicológica, 25(2), 133–145. https://doi.org/10.14349/sumapsi.2018.v25.n2.5
(2020a). LISS immigrant sample data: Wave 1 – Wave 2 [Data file]. https://www.lissdata.nl
. (2020b). LISS panel data: Wave 1 – Wave 9 [Data file]. https://www.lissdata.nl
. (2014). Metasem: An R package for meta-analysis using structural equation modeling. Frontiers in Psychology, 5, Article 1521. https://doi.org/10.3389/fpsyg.2014.01521
(2005). Meta-analytic structural equation modeling: A two-stage approach. Psychological Methods, 10(1), 40–64. https://doi.org/10.1037/1082-989X.10.1.40
(2002). Big things have small beginnings: An assortment of “minor” methodological misunderstandings. Journal of Management, 28(3), 339–362. https://doi.org/10.1177/01490630202800305
(2004). The Positive And Negative Affect Schedule (PANAS): Construct validity, measurement properties and normative data in a large non-clinical sample. The British Journal of Clinical Psychology, 43(3), 245–265. https://doi.org/10.1348/0144665031752934
(2018). Positive and Negative Affect Schedule (PANAS): Psychometric properties for the online version in a clinical sample with emotional disorders [Data file], https://doi.org/10.5281/ZENODO.1477084
(2017). The viability of an ecologically valid chronic sleep restriction and circadian timing protocol: An examination of sample attrition, compliance, and effectiveness at impacting sleepiness and mood. PLoS One, 12(3), e0174367. https://doi.org/10.1371/journal.pone.0174367
(1984). The independence of positive and negative affect. Journal of Personality and Social Psychology, 47, 1105–1117. https://doi.org/10.1037/0022-3514.47.5.1105
(Diener, E.Oishi, S.Tay, L. (Eds.) (2018). Handbook of well-being, DEF.
2003). Facets of dynamic positive affect: Differentiating joy, interest, and activation in the Positive and Negative Affect Schedule (PANAS). Journal of Personality and Social Psychology, 85(3), 528–540. https://doi.org/10.1037/0022-3514.85.3.528
(2017). Anomalous results in G-factor models: Explanations and alternatives. Psychological Methods, 22(3), 541–562. https://doi.org/10.1037/met0000083
(2006). Further validation of the Positive and Negative Affect Schedule (PANAS) and comparision of two Dutch versions. Gedrag & Gezondheid, 34, 61–70. https://doi.org/10.1007/BF03087979
(2016). Factor structure of the Positive and Negative Affect Schedule (PANAS) in adult women with fibromyalgia from Southern Spain: The al-Ándalus project. PeerJ, 4, e1822. https://doi.org/10.7717/peerj.1822
(2006). Positive and negative affective states in a performance-related setting. European Journal of Psychological Assessment, 22(4), 240–249. https://doi.org/10.1027/1015-5759.22.4.240
(2000). Positive and Negative Affect Schedule: A study of validity and reliability. Türk Psikoloji Dergisi, 15(46), 19–28.
(2020). GESIS panel – standard edition, https://doi.org/10.4232/1.13436
. (1984). On the meaning of within-factor correlated measurement errors. Journal of Consumer Research, 11(1), 572–580. https://doi.org/10.1086/208993
(2016). Psychometric properties of the Greek TCI-R and its clinical correlates: Schizotypy and the self-regulation of affective and cognitive functioning. PeerJ, 4, e1830. https://doi.org/10.7717/peerj.1830
(2010). The role of physiological arousal and intergroup anxiety in prejudice [Data file], https://doi.org/10.5255/UKDA-SN-850413
(2019). Scientific use file Deutscher Freiwilligensurvey (SUF FWS) 2014, Version 1.3 [Data file]. https://doi.org/10.5156/FWS.2014.M.004
(2019). Scientific use file Deutscher Freiwilligensurvey (SUF FWS) 1999, Version 3.2 [Data File]. https://doi.org/10.5156/FWS.1999.M.003
(2019). Scientific use file Deutscher Freiwilligensurvey (SUF FWS) 2009, Version 3.2 [Data file]. https://doi.org/10.5156/FWS.2009.M.003
(2015). The problem of allowing correlated errors in structural equation modeling: Concerns and considerations. Computational Methods in Social Sciences, 3(1), 5–17.
(2019). Is all fit that glitters gold? Comparisons of two, three and bi-factor models for Watson, Clark & Tellegen’s 20-item state and trait PANAS. Personality and Individual Differences, 144, 132–140. https://doi.org/10.1016/j.paid.2019.03.002
(2019). Problematic smartphone usage and subjective and psychological well-being. Computers in Human Behavior, 97, 44–50. https://doi.org/10.1016/j.chb.2019.02.028
(1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling, 6(1), 1–55. https://doi.org/10.1080/10705519909540118
(2017). The wisdom in virtue: Pursuit of virtue predicts wise reasoning about personal conflicts. Psychological Science, 28(12), 1848–1856. https://doi.org/10.1177/0956797617722621
(2008). Predicting changes in eating disorder symptoms among Chinese adolescents: A 9-month prospective study. Journal of Psychosomatic Research, 64(1), 87–95. https://doi.org/10.1016/j.jpsychores.2007.08.015
(2015). Meta-analytic structural equation modelling (1st ed.). Springer. https://doi.org/10.1007/978-3-319-27174-3
(2018a). Testing moderator hypotheses in meta-analytic structural equation modeling using subgroup analysis. Behavior Research Methods, 50(4), 1359–1373. https://doi.org/10.3758/s13428-018-1046-3
(2018b). Accounting for missing correlation coefficients in fixed-effects MASEM. Multivariate Behavioral Research, 53(1), 1–4. https://doi.org/10.1080/00273171.2017.1375886
(2020). Meta-analytic structural equation modeling with moderating effects on SEM parameters. Psychological Methods, 25(4), 430–455. https://doi.org/10.1037/met0000245
(1997). Development and factor analytic validation of the SPANAS among women in Spain: (More) Cross-cultural convergence in the structure of mood. Journal of Personality Assessment, 68(3), 600–615. https://doi.org/10.1207/s15327752jpa6803_8
(2016). Cultural differences in survey responding: Issues and insights in the study of response biases. International Journal of Psychology, 51(6), 439–444. https://doi.org/10.1002/ijop.12386
(1992). Assessing subjective well-being in the old-old. Research on Aging, 14(2), 131–168. https://doi.org/10.1177/0164027592142001
(2000). Evidence for a third factor on the Positive and Negative Affect Schedule in a college student sample. Perceptual and Motor Skills, 90(1), 147–152. https://doi.org/10.2466/PMS.90.1.147-152
(2000). Culture, emotion, and well-being: Good feelings in Japan and the United States. Cognition and Emotion, 14(1), 93–124. https://doi.org/10.1080/026999300379003
(1996). Investigations with a German version of the Positive and Negative Affect Schedule. Diagnostica, 42(2), 139–156.
(2016a). Common cold project: British cold study [Data file]. https://www.commoncoldproject.com
. (2016b) Common cold project: Pittsburgh cold study 3 [Data file]. https://www.commoncoldproject.com
. (1999). A measure of positive and negative affect for children: Scale development and preliminary validation. Psychological Assessment, 11(3), 326–338. https://doi.org/10.1037/1040-3590.11.3.326
(2016). Altered states of consciousness during an extreme ritual. PLoS One, 11(5), e0153126. https://doi.org/10.1371/journal.pone.0153126
(2020). Examining the cross-cultural validity of the Positive Affect and Negative Affect Schedule between an Asian (Singaporean) sample and a Western (American) sample. Asian Journal of Social Psychology, 23(1), 109–116. https://doi.org/10.1111/ajsp.12390
(2011). Are positive emotions just as “positive” across cultures? Emotion, 11(4), 994–999. https://doi.org/10.1037/a0021332
(2011). The PANAS structure revisited: On the validity of a bifactor model in community and forensic samples. Psychological Assessment, 23(1), 215–225. https://doi.org/10.1037/a0021400
(2011). Reliability generalization: An examination of the Positive Affect and Negative Affect Schedule. Assessment, 18(4), 487–501. https://doi.org/10.1177/1073191110374917
(2016). Cultural differences in emotion: Differences in emotional arousal level between the East and the West. Integrative Medicine Research, 5(2), 105–109. https://doi.org/10.1016/j.imr.2016.03.004
(1999). A short form of the Positive and Negative Affect Schedule: Evaluation of factorial validity and invariance across demographic variables in a community sample. Personality and Individual Differences, 27(3), 405–416. https://doi.org/10.1016/S0191-8869(98)00251-7
(2008). Power and sensitivity of alternative fit indices in tests of measurement invariance. The Journal of Applied Psychology, 93(3), 568–592. https://doi.org/10.1037/0021-9010.93.3.568
(2018). Exploring constructs of well-being, happiness and quality of life. PeerJ, 6, e4903. https://doi.org/10.7717/peerj.4903
(1997). Comparison of the PAD and PANAS as models for describing emotions and for differentiating anxiety from depression. Journal of Psychopathology and Behavioral Assessment, 19, 331–357. https://doi.org/10.1007/BF02229025
(2013). Psychometric properties of Positive and Negative Affect Schedule (PANAS) original and short forms in an African American community sample. Journal of Affective Disorders, 151(3), 942–949. https://doi.org/10.1016/j.jad.2013.08.011
(2011). Modeling trait and state variation using multilevel factor analysis with PANAS daily diary data. Journal of Research in Personality, 45(1), 2–9. https://doi.org/10.1016/j.jrp.2010.11.003
(2014). Serbian adaptation of the Positive and Negative Affect Schedule (PANAS): Its facets and second-order structure. Psihologija, 47(4), 393–414. https://doi.org/10.2298/PSI1404393 M
(2010). Testing measurement invariance across groups: Applications in cross-cultural research. International Journal of Psychological Research, 3(1), 111–130. https://doi.org/10.21500/20112084.857
(2019). Scientific use file Deutscher Freiwilligensurvey (SUF FWS) 2004, Version 3.2 [Data file], https://doi.org/10.5156/FWS.2004.M.003
(2017). Decentering attenuates the associations of negative affect and positive affect with psychopathology. Clinical Psychological Science, 5(6), 1027–1047. https://doi.org/10.1177/2167702617719758
(2008). Testing the measurement equivalence of personality adjective items across cultures. Journal of Research in Personality, 42(6), 1524–1536. https://doi.org/10.1016/j.jrp.2008.07.004
(2017). Positive and negative affect fluctuations during the menstrual cycle [Data file]. https://doi.org/10.5255/UKDA-SN-852672
(2017). Measuring the frequency of emotions-validation of the Scale of Positive and Negative Experience (SPANE) in Germany. PLoS One, 12(2), e0171288. https://doi.org/10.1371/journal.pone.0171288
(2016). Evaluating bifactor models: Calculating and interpreting statistical indices. Psychological Methods, 21(2), 137–150. https://doi.org/10.1037/met0000045
(2014). Differences in within- and between-person factor structure of positive and negative affect: Analysis of two intensive measurement studies using multilevel structural equation modeling. Psychological Assessment, 26(2), 462–473. https://doi.org/10.1037/a0035666
(2010). Midlife in the United States (MIDUS 2): Neuroscience Project, 2004–2009 [Data file]. https://doi.org/10.3886/ICPSR28683.V4
(2014). A happier and less sinister past, a more hedonistic and less fatalistic present and a more structured future: Time perspective and well-being. PeerJ, 2, e303. https://doi.org/10.7717/peerj.303
(2002). Cultural influences on the relation between pleasant emotions and unpleasant emotions: Asian dialectic philosophies or individualism-collectivism? Cognition and Emotion, 16(6), 705–719. https://doi.org/10.1080/02699930143000590
(2019). Potential negative consequences of mindfulness in the moral domain. European Journal of Social Psychology, 49(5), 1055–1069. https://doi.org/10.1002/ejsp.2570
(2002). The relationship between positive and negative affect in the Positive and Negative Affect Schedule. Journal of Research in Personality, 36, 463–475. https://doi.org/10.1016/S0092-6566(02)00007-7
(2009).
(Emotions across cultures and methods . In E. DienerEd., Social indicators research series: Vol. 38. Culture and well-being (Vol. 38, pp. 203–228). Springer. https://doi.org/10.1007/978-90-481-2352-0_102017). On the replication of factor structures of the Positive and Negative Affect Schedule (PANAS). Personality and Individual Differences, 107, 201–207. https://doi.org/10.1016/j.paid.2016.11.053
(2006). Evaluating guidelines for test adaptations. Journal of Cross-Cultural Psychology, 37(5), 557–567. https://doi.org/10.1177/0022022106290478
(2014). Study of Women’s Health Across the Nation (SWAN), 2006–2008: Visit 10 Dataset [Data file]. https://doi.org/10.3886/ICPSR32961.V2
(2003). Factorial and construct validity of the Italian Positive and Negative Affect Schedule (PANAS). European Journal of Psychological Assessment, 19(2), 131–141. https://doi.org/10.1027/1015-5759.19.2.131
(2007). Development and validation of an internationally reliable short-form of the Positive and Negative Affect Schedule (PANAS). Journal of Cross-Cultural Psychology, 38(2), 227–242. https://doi.org/10.1177/0022022106297301
(2016). Effects of personal relevance and simulated darkness on the affective appraisal of a virtual environment. PeerJ, 4, e1743. https://doi.org/10.7717/peerj.1743
(2003). Potential problems with “well fitting” models. Journal of Abnormal Psychology, 112(4), 578–598. https://doi.org/10.1037/0021-843X.112.4.578
(2019). Modulating pain thresholds through classical conditioning. PeerJ, 7, e6486. https://doi.org/10.7717/peerj.6486
(2016). The relationship between cannabis use and measures of anxiety and depression in a sample of college campus cannabis users and non-users post state legalization in Colorado. PeerJ, 4, e2782. https://doi.org/10.7717/peerj.2782
(2010). The internal structure of positive and negative affect: A confirmatory factor analysis of the PANAS. Educational and Psychological Measurement, 70(1), 125–141. https://doi.org/10.1177/0013164409344522
(2009). Happiness and unhappiness in east and west: Themes and variations. Emotion, 9(4), 441–456. https://doi.org/10.1037/a0015634
(2015). Football fan aggression: The importance of low basal cortisol and a fair referee. PLoS One, 10(4), e0120103. https://doi.org/10.1371/journal.pone.0120103
(2019). Positive and Negative Affect Schedule (PANAS): Psychometric properties and discriminative capacity in several Chilean samples. Evaluation & the Health Professions, 42(4), 473–497. https://doi.org/10.1177/0163278717745344
(2011). Examining the factor structure of the Positive and Negative Affect Schedule (PANAS) in a multiethnic sample of adolescents. Measurement and Evaluation in Counseling and Development, 44(4), 193–203. https://doi.org/10.1177/0748175611414721
(1994). The PANAS-X: Manual for the Positive and Negative Affect Schedule, University of Iowa.
(1997). Measurement and mismeasurement of mood: Recurrent and emergent issues. Journal of Personality Assessment, 68(2), 267–296. https://doi.org/10.1207/s15327752jpa6802_4
(1988). Development and validation of brief measures of positive and negative affect: The PANAS scales. Journal of Personality and Social Psychology, 54(6), 1063–1070. https://doi.org/10.1037/0022-3514.54.6.1063
(1985). Toward a consensual structure of mood. Psychological Bulletin, 98(2), 219–235. https://doi.org/10.1037/0033-2909.98.2.219
(1999). The two general activation systems of affect: Structural findings, evolutionary considerations, and psychobiological evidence. Journal of Personality and Social Psychology, 76(5), 820–838. https://doi.org/10.1037/0022-3514.76.5.820
(2019). Don’t tell me what to think: How perceived and suggested risk affect selective exposure to health information [Data file]. Leibniz Institute for Psychology Information (ZPID). https://doi.org/10.23668/PSYCHARCHIVES.2435
(2015). Using item response theory to investigate the structure of anticipated affect: Do self-reports about future affective reactions conform to typical or maximal models? Frontiers in Psychology, 6, 1438. https://doi.org/10.3389/fpsyg.2015.01438
(1982). The structure of mood change: An idiographic/nomothetic analysis. Journal of Personality and Social Psychology, 43(1), 111–122. https://doi.org/10.1037/0022-3514.43.1.111
(