Skip to main content
Research Report

Factorial Validity and Measurement Invariance of the Appreciation, Fun, and Suspense Scales Across US-American and German Samples

Published Online:https://doi.org/10.1027/1864-1105/a000236

Abstract. Recent approaches in entertainment research have extended the scope from hedonic gratifications (fun, suspense) to meaningful and thought-provoking entertainment experiences (appreciation). The present research examines the cross-national measurement validity of these theoretical constructs by testing the factorial structure of the German version of the Appreciation, Fun, and Suspense scales developed by Oliver and Bartsch (2010). Measurement invariance of the scales across US-American (N = 262) and German (N = 274) samples is examined by reanalyzing data sets from two published studies. Findings support the theoretically assumed three-factorial model of the German scale and partial scalar invariance across samples. In addition, exploratory analyses of a third data set (N = 200) revealed that an alternative wording for an item of the Suspense scale may be superior.

References

  • Bartsch, A. (2012). Emotional gratification in entertainment experience. Why viewers of movies and television series find it rewarding to experience emotions. Media Psychology, 15, 267–302. https://doi.org/10.1080/15213269.2012.693811 First citation in articleCrossrefGoogle Scholar

  • Bartsch, A. & Hartmann, T. (2015). The role of cognitive and affective challenge in entertainment experience. Communication Research. Advance online publication. https://doi.org/10.1177/0093650214565921 First citation in articleGoogle Scholar

  • Bartsch, A. & Mares, M.-L. (2014). Making sense of violence: Perceived meaningfulness as a predictor of audience interest in violent media content. Journal of Communication, 64, 956–976. https://doi.org/10.1111/jcom.12112 First citation in articleCrossrefGoogle Scholar

  • Bartsch, A. & Oliver, M. B. (2010, June). Media enjoyment and appreciation. The role of perceived cognitive and emotional challenge in entertainment experience. Paper presented at the 60th Annual Conference of the International Communication Association, Singapore. First citation in articleGoogle Scholar

  • Bartsch, A., Oliver, M. B., Nitsch, C. & Scherr, S. (2016). Inspired by the Paralympics: Effects of empathy on audience interest in para-sports and on the destigmatization of persons with disabilities. Communication Research, Advance online publication. https://doi.org/10.1177/0093650215626984 First citation in articleCrossrefGoogle Scholar

  • Bartsch, A. & Schneider, F. M. (2014). Entertainment and politics revisited: How non-escapist forms of entertainment can stimulate political interest and information seeking. Journal of Communication, 64, 369–396. https://doi.org/10.1111/jcom.12095 First citation in articleCrossrefGoogle Scholar

  • Bentler, P. M. & Wu, E. J. C. (2005). EQS 6 structural equation modeling software. Encino, CA: Multivariate Software [Computer software]. Retrieved from www.mvsoft.com First citation in articleGoogle Scholar

  • Brown, T. A. (2015). Confirmatory factor analysis for applied research (2nd ed.). New York, NY: Guilford Press. First citation in articleGoogle Scholar

  • Chen, F. F. (2007). Sensitivity of goodness of fit indexes to lack of measurement invariance. Structural Equation Modeling, 14, 464–504. https://doi.org/10.1080/10705510701301834 First citation in articleCrossrefGoogle Scholar

  • Chen, F. F. (2008). What happens if we compare chopsticks with forks? The impact of making inappropriate comparisons in cross-cultural research. Journal of Personality and Social Psychology, 95, 1005–1018. https://doi.org/10.1037/a0013193 First citation in articleCrossrefGoogle Scholar

  • Cheung, G. W. & Rensvold, R. B. (2002). Evaluating goodness-of-fit indexes for testing measurement invariance. Structural Equation Modeling, 9, 233–255. https://doi.org/10.1207/S15328007SEM0902_5 First citation in articleCrossrefGoogle Scholar

  • Hall, A. E. (2015). Entertainment-oriented gratifications of sports media: Contributors to suspense, hedonic enjoyment, and appreciation. Journal of Broadcasting & Electronic Media, 59, 259–277. https://doi.org/10.1080/08838151.2015.1029124 First citation in articleCrossrefGoogle Scholar

  • Hofer, M. (2013). Appreciation and enjoyment of meaningful entertainment: The role of mortality salience and search for meaning in life. Journal of Media Psychology, 25, 109–117. https://doi.org/10.1027/1864-1105/a000089 First citation in articleLinkGoogle Scholar

  • Hofer, M. (2016). Effects of light-hearted and serious entertainment on enjoyment of the first and third person. Journal of Media Psychology, 28, 42–48. https://doi.org/10.1027/1864-1105/a000150 First citation in articleLinkGoogle Scholar

  • Johnson, B. K., Ewoldsen, D. R. & Slater, M. D. (2015). Self-control depletion and narrative: Testing a prediction of the TEBOTS model. Media Psychology, 18, 196–220. https://doi.org/10.1080/15213269.2014.978872 First citation in articleCrossrefGoogle Scholar

  • Johnson, B. K. & Rosenbaum, J. E. (2015). Spoiler alert: Consequences of narrative spoilers for dimensions of enjoyment, appreciation, and transportation. Communication Research, 42, 1068–1088. https://doi.org/10.1177/0093650214564051 First citation in articleCrossrefGoogle Scholar

  • Khoo, G. S. (2016). Contemplating tragedy raises gratifications and fosters self-acceptance. Human Communication Research, 42, 269–291. https://doi.org/10.1111/hcre.12074 First citation in articleCrossrefGoogle Scholar

  • Krakowiak, K. M. & Tsay‐Vogel, M. (2015). The dual role of morally ambiguous characters: Examining the effect of morality salience on narrative responses. Human Communication Research, 41, 390–411. https://doi.org/10.1111/hcre.12050 First citation in articleCrossrefGoogle Scholar

  • Kühne, R. (2013). Testing measurement invariance in media psychological research. Journal of Media Psychology, 25, 153–159. https://doi.org/10.1027/1864-1105/a000096 First citation in articleLinkGoogle Scholar

  • Lewis, R. J., Tamborini, R. & Weber, R. (2014). Testing a dual-process model of media enjoyment and appreciation. Journal of Communication, 64, 397–416. https://doi.org/10.1111/jcom.12101 First citation in articleCrossrefGoogle Scholar

  • Meade, A. W., Johnson, E. C. & Braddy, P. W. (2008). Power and sensitivity of alternative fit indices in tests of measurement invariance. Journal of Applied Psychology, 93, 568–592. https://doi.org/10.1037/0021-9010.93.3.568 First citation in articleCrossrefGoogle Scholar

  • Odağ, Ö., Hofer, M., Schneider, F. M. & Knop, K. (2016). Testing measurement equivalence of eudaimonic and hedonic entertainment motivations in a cross-cultural comparison. Journal of Intercultural Communication Research, 45, 108–125. https://doi.org/10.1080/17475759.2015.1108216 First citation in articleCrossrefGoogle Scholar

  • Oliver, M. B. & Bartsch, A. (2010). Appreciation as audience response: Exploring entertainment gratifications beyond hedonism. Human Communication Research, 36, 53–81. https://doi.org/10.1111/j.1468-2958.2009.01368.x First citation in articleCrossrefGoogle Scholar

  • Oliver, M. B. & Bartsch, A. (2011). Appreciation of entertainment: The importance of meaningfulness via virtue and wisdom. Journal of Media Psychology, 23, 29–33. https://doi.org/10.1027/1864-1105/a000029 First citation in articleLinkGoogle Scholar

  • Oliver, M. B. & Raney, A. A. (2011). Entertainment as pleasurable and meaningful: Identifying hedonic and eudaimonic motivations for entertainment consumption. Journal of Communication, 61, 984–1004. https://doi.org/10.1111/j.1460-2466.2011.01585.x First citation in articleCrossrefGoogle Scholar

  • Raykov, T. (1997). Estimation of composite reliability for congeneric measures. Applied Psychological Measurement, 21, 173–184. https://doi.org/10.1177/01466216970212006 First citation in articleCrossrefGoogle Scholar

  • Rieger, D., Frischlich, L., Högden, F., Kauf, R., Schramm, K. & Tappe, E. (2015). Appreciation in the face of death: Meaningful films buffer against death-related anxiety. Journal of Communication, 65, 351–372. https://doi.org/10.1111/jcom.12152 First citation in articleCrossrefGoogle Scholar

  • Rieger, D. & Hofer, M. (2017). How movies can ease the fear of death: The survival or death of the protagonists in meaningful movies. Mass Communication and Society, Advance online publication. https://doi.org/10.1080/15205436.2017.1300666 First citation in articleCrossrefGoogle Scholar

  • Roth, F. S., Weinmann, C., Schneider, F. M., Hopp, F. R., Bindl, M. J. & Vorderer, P. (2017). Curving entertainment: The curvilinear relationship between hedonic and eudaimonic entertainment experiences while watching a political talk show and its implications for information processing. Psychology of Popular Media Culture, Advance online publication. https://doi.org/1037/ppm0000147 First citation in articleCrossrefGoogle Scholar

  • Roth, F. S., Weinmann, C., Schneider, F. M., Hopp, F. & Vorderer, P. (2014). Seriously entertained: Antecedents and consequences of hedonic and eudaimonic entertainment experiences with political talk shows on TV. Mass Communication and Society, 17, 379–399. https://doi.org/10.1080/15205436.2014.891135 First citation in articleCrossrefGoogle Scholar

  • Satorra, A. & Bentler, P. M. (1994). Corrections to test statistics and standard errors in covariance structure analysis. In A. von EyeC. C. CloggEds., Latent variables analysis: Applications for developmental research (pp. 399–419). Thousand Oaks, CA: Sage. First citation in articleGoogle Scholar

  • Schneider, F. M. (2017). Measuring subjective movie evaluation criteria: Conceptual foundation, construction, and validation of the SMEC scales. Communication Methods and Measures, 11, 49–75. https://doi.org/10.1080/19312458.2016.1271115 First citation in articleCrossrefGoogle Scholar

  • Schneider, F. M., Bartsch, A. & Gleich, U. (2015). Spaß, Spannung…Denkanstöße? Hedonische und eudaimonische Gratifikationen, Bewertungen und Folgen der Rezeption von Stefan Raabs Sendung „Absolute Mehrheit” [“Fun, suspense…food for thought? Hedonic and eudaimonic gratifications, evaluations, and outcomes of watching Stefan Raab’s talk show “Absolute Mehrheit”]. SC|M: Studies in Communication | Media, 4, 53–68. https://doi.org/10.5771/2192-4007-2015-1-53 First citation in articleCrossrefGoogle Scholar

  • Schneider, F. M., Weinmann, C., Roth, F. S., Knop, K. & Vorderer, P. (2016). Learning from entertaining online video clips? Enjoyment and appreciation and their differential relationships with knowledge and behavioral intentions. Computers in Human Behavior, 54, 475–482. https://doi.org/10.1016/j.chb.2015.08.028 First citation in articleCrossrefGoogle Scholar

  • Slater, M. D., Oliver, M. B. & Appel, M. (2016). Poignancy and mediated wisdom of experience: Narrative impacts on willingness to accept delayed rewards. Communication Research. Advance online publication. https://doi.org/10.1177/0093650215623838 First citation in articleCrossrefGoogle Scholar

  • Vandenberg, R. J. & Lance, C. E. (2000). A review and synthesis of the measurement invariance literature: Suggestions, practices, and recommendations for organizational research. Organizational Research Methods, 3, 4–69. https://doi.org/10.1177/109442810031002 First citation in articleCrossrefGoogle Scholar

  • Vorderer, P., Klimmt, C. & Ritterfeld, U. (2004). Enjoyment: At the heart of media entertainment. Communication Theory, 14, 388–408. https://doi.org/10.1111/j.1468-2885.2004.tb00321.x First citation in articleCrossrefGoogle Scholar

  • Weinmann, C. (2017). Feeling political interest while being entertained? Explaining the emotional experience of interest in politics in the context of political entertainment programs. Psychology of Popular Media Culture, 6, 123–141. https://doi.org/10.1037/ppm0000091 First citation in articleCrossrefGoogle Scholar

  • Weinmann, C., Löb, C., Mattheiß, T. & Vorderer, P. (2013). Approaching science by watching TV: What do entertainment programs contribute to viewers’ competence in genetic engineering? Educational Media International, 50, 1–13. https://doi.org/10.1080/09523987.2013.839152 First citation in articleCrossrefGoogle Scholar

  • Weinmann, C., Schneider, F. M., Roth, F. S., Bindl, M. J. & Vorderer, P. (2016). Testing measurement invariance of hedonic and eudaimonic entertainment experiences across media formats. Communication Methods and Measures, 10, 248–257. https://doi.org/10.1080/19312458.2016.1227773 First citation in articleCrossrefGoogle Scholar

  • Wirth, W., Hofer, M. & Schramm, H. (2012). Beyond pleasure: Exploring the eudaimonic entertainment experience. Human Communication Research, 38, 406–428. https://doi.org/10.1111/j.1468-2958.2012.01434.x First citation in articleCrossrefGoogle Scholar

  • Zillmann, D. (1996). The psychology of suspense in dramatic exposition. In P. VordererH. J. WulffM. FriedrichsenEds., Suspense. Conceptualizations, theoretical analyses and empirical explorations (pp. 199–231). Mahwah, NJ: Erlbaum. First citation in articleGoogle Scholar