Skip to main content
Search
Search
    Quick Search anywhere
    Quick search in Citations
Advanced Search
Skip main navigation
Previous article
Next article
Brief Report

Sociodemographic Effects on the Test-Retest Reliability of the Big Five Inventory

Published Online:June 26, 2015https://doi.org/10.1027/1015-5759/a000259

Abstract

Abstract. Psychometric properties of self-report scales can be affected by sociodemographic differences among respondents. For example, factor structures of established personality scales tend to be distorted in samples with less formal education. Whether test-retest reliabilities are comparably affected is of yet not well known. Therefore, this study examined the measurement precision of a short Big Five instrument in a diverse sample of the German population. A sample of 1,696 (50% women) participants reported on their personality twice within an interval of 10 weeks. The median test-retest reliability for the five traits, rtt = .66, was notably smaller than previously reported coefficients from college students, median rtt = .78. Moderator analyses identified modest effects of age and educational attainment on these reliability estimates, whereas sex showed no differential impact. These results highlight that test-retest reliabilities derived from student samples should not be generalized to sociodemographically diverse groups of respondents.

References

  • Bosnjak, M., Haas, I., Galesic, M., Kaczmirek, L., Bandilla, W. & Couper, M. P. (2013). Sample composition discrepancies in different stages of a probability-based online panel. Field Methods, 25, 339–360. doi: 10.1177/1525822X12472951 First citation in articleCrossref, Google Scholar

  • Federal Statistical Office (2010). Statistisches Jahrbuch 2010 für die Bundesrepublik Deutschland [Statistical yearbook 2010 for the Federal Republic of Germany]. Wiesbaden, Germany: Federal Statistical Office. First citation in articleGoogle Scholar

  • Gnambs, T. (2014a). Facets of measurement error for scores of the Big Five: Three reliability generalizations. Personality and Individual Differences. Advance online publication. doi: 10.1016/j.paid.2014.08.019 First citation in articleCrossref, Google Scholar

  • Gnambs, T. (2014b). A meta-analysis of dependability coefficients (test-retest reliabilities) for measures of the Big Five. Journal of Research in Personality, 52, 20–28. doi: 10.1016/j.jrp.2014.06.003 First citation in articleCrossref, Google Scholar

  • Lang, F. R., John, D., Lüdtke, O., Schupp, J. & Wagner, G. G. (2011). Short assessment of the Big Five: Robust across survey methods except telephone interviewing. Behavior Research Methods, 43, 548–567. doi: 10.3758/s13428-011-0066-z First citation in articleCrossref, Google Scholar

  • Löckenhoff, C. E., Terracciano, A., Bienvenu, O. J., Patriciu, N. S., Nestadt, G., McCrae, R. R., … Costa, P. T. Jr. (2008). Ethnicity, education, and the temporal stability of personality traits in the East Baltimore Epidemiologic Catchment Area study. Journal of Research in Personality, 42, 577–598. doi: 10.1016/j.jrp.2007.09.004 First citation in articleCrossref, Google Scholar

  • Lucas, R. E. & Donnellan, M. B. (2011). Personality development across the life span: Longitudinal analyses with a national sample from Germany. Journal of Personality and Social Psychology, 101, 847–861. doi: 10.1037/a0024298 First citation in articleCrossref, Google Scholar

  • McCrae, R. R., Kurtz, J. E., Yamagata, S. & Terracciano, A. (2011). Internal consistency, retest reliability, and their implications for personality scale validity. Personality and Social Psychology Review, 15, 28–50. doi: 10.1177/1088868310366253 First citation in articleCrossref, Google Scholar

  • Rammstedt, B. (2007). The 10-Item Big Five Inventory: Norm values and investigation of sociodemographic effects based on a German population representative sample. European Journal of Psychological Assessment, 23, 193–201. doi: 10.1027/1015-5759.23.3.193 First citation in articleLink, Google Scholar

  • Rammstedt, B. & John, O. P. (2007). Measuring personality in one minute or less: A 10-item short version of the Big Five Inventory in English and German. Journal of Research in Personality, 41, 203–212. doi: 10.1016/j.jrp.2006.02.001 First citation in articleCrossref, Google Scholar

  • Rammstedt, B., Kemper, C. J. & Borg, I. (2013). Correcting Big Five personality measurements for acquiescence: An 18-country cross-cultural study. European Journal of Personality, 27, 71–81. doi: 10.1002/per.1894 First citation in articleCrossref, Google Scholar

  • Rattinger, H., Roßteutscher, S., Schmitt-Beck, R. & Weßels, B. (2013). Short-term campaign panel (GLES 2009). GESIS Data Archive, Cologne. ZA5305 Data file Version 4.0.0. doi: 10.4232/1.11766 First citation in articleCrossref, Google Scholar

  • Schmidt, F. L., Le, H. & Ilies, R. (2003). Beyond alpha: An empirical examination of the effects of different sources of measurement error on reliability estimates for measures of individual differences constructs. Psychological Methods, 8, 206–224. doi: 10.1037/1082-989X.8.2.206 First citation in articleCrossref, Google Scholar

  • Schneider, S. L. (2008). Applying the ISCED‐97 to the German educational qualifications. In S. L. SchneiderEd., The International Standard Classification of Education (pp. 77–102). Mannheim, Germany: MZES. First citation in articleGoogle Scholar

  • Sutin, A. R., Costa, P. T. Jr., Evans, M. K. & Zonderman, A. B. (2013). Personality assessment in a diverse urban sample. Psychological Assessment, 25, 1007–1012. doi: 10.1037/a0032396 First citation in articleCrossref, Google Scholar