Skip to main content
Search
Search
    Quick Search anywhere
    Quick search in Citations
Advanced Search
Skip main navigationClose Drawer MenuOpen Drawer Menu
Previous article
Next article
Brief Report

Sociodemographic Effects on the Test-Retest Reliability of the Big Five Inventory

Published Online:June 26, 2015https://doi.org/10.1027/1015-5759/a000259

Abstract

Abstract. Psychometric properties of self-report scales can be affected by sociodemographic differences among respondents. For example, factor structures of established personality scales tend to be distorted in samples with less formal education. Whether test-retest reliabilities are comparably affected is of yet not well known. Therefore, this study examined the measurement precision of a short Big Five instrument in a diverse sample of the German population. A sample of 1,696 (50% women) participants reported on their personality twice within an interval of 10 weeks. The median test-retest reliability for the five traits, rtt = .66, was notably smaller than previously reported coefficients from college students, median rtt = .78. Moderator analyses identified modest effects of age and educational attainment on these reliability estimates, whereas sex showed no differential impact. These results highlight that test-retest reliabilities derived from student samples should not be generalized to sociodemographically diverse groups of respondents.

References

  • Bosnjak, M., Haas, I., Galesic, M., Kaczmirek, L., Bandilla, W. & Couper, M. P. (2013). Sample composition discrepancies in different stages of a probability-based online panel. Field Methods, 25, 339–360. doi: 10.1177/1525822X12472951 First citation in articleCrossref, Google Scholar

  • Federal Statistical Office (2010). Statistisches Jahrbuch 2010 für die Bundesrepublik Deutschland [Statistical yearbook 2010 for the Federal Republic of Germany]. Wiesbaden, Germany: Federal Statistical Office. First citation in articleGoogle Scholar

  • Gnambs, T. (2014a). Facets of measurement error for scores of the Big Five: Three reliability generalizations. Personality and Individual Differences. Advance online publication. doi: 10.1016/j.paid.2014.08.019 First citation in articleCrossref, Google Scholar

  • Gnambs, T. (2014b). A meta-analysis of dependability coefficients (test-retest reliabilities) for measures of the Big Five. Journal of Research in Personality, 52, 20–28. doi: 10.1016/j.jrp.2014.06.003 First citation in articleCrossref, Google Scholar

  • Lang, F. R., John, D., Lüdtke, O., Schupp, J. & Wagner, G. G. (2011). Short assessment of the Big Five: Robust across survey methods except telephone interviewing. Behavior Research Methods, 43, 548–567. doi: 10.3758/s13428-011-0066-z First citation in articleCrossref, Google Scholar

  • Löckenhoff, C. E., Terracciano, A., Bienvenu, O. J., Patriciu, N. S., Nestadt, G., McCrae, R. R., … Costa, P. T. Jr. (2008). Ethnicity, education, and the temporal stability of personality traits in the East Baltimore Epidemiologic Catchment Area study. Journal of Research in Personality, 42, 577–598. doi: 10.1016/j.jrp.2007.09.004 First citation in articleCrossref, Google Scholar

  • Lucas, R. E. & Donnellan, M. B. (2011). Personality development across the life span: Longitudinal analyses with a national sample from Germany. Journal of Personality and Social Psychology, 101, 847–861. doi: 10.1037/a0024298 First citation in articleCrossref, Google Scholar

  • McCrae, R. R., Kurtz, J. E., Yamagata, S. & Terracciano, A. (2011). Internal consistency, retest reliability, and their implications for personality scale validity. Personality and Social Psychology Review, 15, 28–50. doi: 10.1177/1088868310366253 First citation in articleCrossref, Google Scholar

  • Rammstedt, B. (2007). The 10-Item Big Five Inventory: Norm values and investigation of sociodemographic effects based on a German population representative sample. European Journal of Psychological Assessment, 23, 193–201. doi: 10.1027/1015-5759.23.3.193 First citation in articleLink, Google Scholar

  • Rammstedt, B. & John, O. P. (2007). Measuring personality in one minute or less: A 10-item short version of the Big Five Inventory in English and German. Journal of Research in Personality, 41, 203–212. doi: 10.1016/j.jrp.2006.02.001 First citation in articleCrossref, Google Scholar

  • Rammstedt, B., Kemper, C. J. & Borg, I. (2013). Correcting Big Five personality measurements for acquiescence: An 18-country cross-cultural study. European Journal of Personality, 27, 71–81. doi: 10.1002/per.1894 First citation in articleCrossref, Google Scholar

  • Rattinger, H., Roßteutscher, S., Schmitt-Beck, R. & Weßels, B. (2013). Short-term campaign panel (GLES 2009). GESIS Data Archive, Cologne. ZA5305 Data file Version 4.0.0. doi: 10.4232/1.11766 First citation in articleCrossref, Google Scholar

  • Schmidt, F. L., Le, H. & Ilies, R. (2003). Beyond alpha: An empirical examination of the effects of different sources of measurement error on reliability estimates for measures of individual differences constructs. Psychological Methods, 8, 206–224. doi: 10.1037/1082-989X.8.2.206 First citation in articleCrossref, Google Scholar

  • Schneider, S. L. (2008). Applying the ISCED‐97 to the German educational qualifications. In S. L. SchneiderEd., The International Standard Classification of Education (pp. 77–102). Mannheim, Germany: MZES. First citation in articleGoogle Scholar

  • Sutin, A. R., Costa, P. T. Jr., Evans, M. K. & Zonderman, A. B. (2013). Personality assessment in a diverse urban sample. Psychological Assessment, 25, 1007–1012. doi: 10.1037/a0032396 First citation in articleCrossref, Google Scholar