Skip to main content
Original Article

Test-Taking Motivation and Personality Test Validity

Published Online:https://doi.org/10.1027/1866-5888/a000012

In this study we assessed whether the predictive validity of personality scores is stronger when respondent test-taking motivation (TTM) is higher rather than lower. Results from a field sample comprising 269 employees provided evidence for this moderation effect for one trait, Steadfastness. However, for Conscientiousness, valid criterion prediction was only obtained at low levels of TTM. Thus, it appears that TTM relates to the criterion validity of personality testing differently depending on the personality trait assessed. Overall, these and additional findings regarding the nomological net of TTM suggest that it is a unique construct that may have significant implications when personality assessment is used in personnel selection.

References

  • Aguinis, H. , & Henle, C. A. (2004). Ethics in research. In S. G. Rogelberg (Ed.), Handbook of research methods in industrial and organizational psychology (pp. 34–56). Malden, MA: Blackwell. First citation in articleCrossrefGoogle Scholar

  • Aiken, L. S. , & West, S. G. (1991). Multiple regression: Testing and interpreting interactions. Newbury Park: Sage. First citation in articleGoogle Scholar

  • American Educational Research Association, the American Psychological Association, and the National Council on Measurement in Education . (1999). Standards for educational and psychological testing. Washington DC: American Educational Research Association. First citation in articleGoogle Scholar

  • Arvey, R. D. , Strickland, W. , Drauden, G. , Martin, C. (1990). Motivational components of test taking. Personnel Psychology, 43, 695–716. First citation in articleCrossrefGoogle Scholar

  • Bedeian, A. G. , & Mossholder, K. W. (1994). Simple question, not so simple answer: Interpreting interaction terms in moderated multiple regression. Journal of Management, 20, 159–165. First citation in articleCrossrefGoogle Scholar

  • Barrick, M. R. , & Mount, M. K. (1991). The Big Five personality dimensions and job performance: A meta-analysis. Personnel Psychology, 44, 1–26. First citation in articleCrossrefGoogle Scholar

  • Barrick, M. R. , & Mount, M. K. (1996). Effects of impression management and self-deception on the predictive validity of personality constructs. Journal of Applied Psychology, 81, 261–272. First citation in articleCrossrefGoogle Scholar

  • Burns, G. N. , & Christiansen, N. D. (2006). Sensitive or senseless: On the use of social desirability measures in selection and assessment. In R. L. Griffith, M. H. Peterson (Eds.), A closer examination of applicant faking behavior (pp. 115–150). Greenwich, CT: Information Age Publishing. First citation in articleGoogle Scholar

  • Chan, D. , Schmitt, N. , DeShon, R. P. , Clause, C. S. , Delbridge, K. (1997). Reactions to cognitive ability tests: The relationships between race, test performance, face validity perceptions, and Test-Taking Motivation. Journal of Applied Psychology, 82, 300–310. First citation in articleCrossrefGoogle Scholar

  • Cohen, J. (1988). Statistical power analysis for the behavioral sciences (2nd ed.). Hillsdale, NJ: Erlbaum. First citation in articleGoogle Scholar

  • Dwight, S. A. , & Donovan, J. J. (2003). Do warnings not to fake reduce faking? Human Performance, 16, 1–23. First citation in articleCrossrefGoogle Scholar

  • Gilliland, S. W. (1994). Effects of procedural and distributive justice on reactions to a selection system. Journal of Applied Psychology, 79, 691–701. First citation in articleCrossrefGoogle Scholar

  • Goffin, R. D. , & Boyd, A. C. (2009). Faking and personality assessment in personnel selection: Advancing models of faking. Canadian Psychology, 50, 151–160. First citation in articleCrossrefGoogle Scholar

  • Goffin, R. D. , Jelley, R. B. , Powell, D. M. , Johnston, N. G. (2009). Taking advantage of social comparisons in performance appraisal: The Relative Percentile Method. Human Resource Management, 48, 251–268. First citation in articleCrossrefGoogle Scholar

  • Goldberg, L. R. (1999). A broad-bandwidth, public-domain, personality inventory measuring the lower-level facets of several Five-Factor Models. In I. Mervielde, I. Deary, F. De Fruyt, F. Ostendorf (Eds.), Personality psychology in Europe, Vol. 7, (pp. 7–28). Tilburg, The Netherlands: Tilburg University Press. First citation in articleGoogle Scholar

  • Griffin, B. , & Hesketh, B. (2004). Why openness to experience is not a good predictor of job performance. International Journal of Selection and Assessment, 12, 243–251. First citation in articleCrossrefGoogle Scholar

  • Griffith, R. L. , & Peterson, M. H. (2008). The failure of social desirability measures to capture applicant faking behavior. Industrial and Organizational Psychology, 1, 308–311. First citation in articleCrossrefGoogle Scholar

  • Guion, R. M. , & Gottier, R. F. (1965). Validity of personality measures in personnel selection. Personnel Psychology, 18, 135–164. First citation in articleCrossrefGoogle Scholar

  • Harvey, R. J. (1993). Research monograph: The development of the CMQ. Monograph describing the development and field-testing of the Common Metric Questionnaire. First citation in articleGoogle Scholar

  • Jackson, D. N. (1999a). Personality Research Form, Form L. Port Huron, MI: Sigma Assessment Systems. First citation in articleGoogle Scholar

  • Jackson, D. N. (1999b). Jackson Personality Inventory, Form L. Port Huron, MI: Sigma Assessment Systems. First citation in articleGoogle Scholar

  • Jackson, D. N. , Paunonen, S. V. , Tremblay, P. F. (2000). Six Factor Personality Questionnaire Manual. Port Huron, MI: Sigma Assessment Systems. First citation in articleGoogle Scholar

  • Lautenschlager, G. J. (1994). Accuracy and faking of background data. In G. S. Stokes, D. Mumford, W. A. Owens (Eds.), Biodata handbook (pp. 391–419). Palo Alto, CA: Consulting Psychologists Press. First citation in articleGoogle Scholar

  • Li, A. , Baggar, J. (2006). Using the BIDR to distinguish the effects of impression management and self-deception on the criterion validity of personality measures: A meta-analysis. International Journal of Selection and Assessment, 14, 131–141. First citation in articleCrossrefGoogle Scholar

  • McCarthy, J. M. , & Goffin, R. D. (2003). Is the Test Attitude Survey psychometrically sound?. Educational and Psychological Measurement, 63, 446–464. First citation in articleCrossrefGoogle Scholar

  • Morgeson, F. P. , Campion, M. A. , Dipboye, R. L. , Hollenbeck, J. R. , Murphy, K. , & Schmitt, N. (2007). Reconsidering the use of personality tests in personnel selection contexts. Personnel Psychology, 60, 683–729. First citation in articleCrossrefGoogle Scholar

  • Murphy, K. R. , & Davidshofer, C. O. (2005). Psychological testing: Principles and applications (6th ed.). Upper Saddle River, NJ: Prentice Hall. First citation in articleGoogle Scholar

  • Paulhus, D. L. (1991). Measurement and control of response bias. In J. P. Robinson, P. R. Shaver, L. S. Wrightsman (Eds.), Measures of personality and social psychology attitudes (pp. 17–59). New York: Academic Press. First citation in articleCrossrefGoogle Scholar

  • Paulhus, D. L. , Bruce, M. N. , Trapnell, P. D. (1995). Effects of self-presentation strategies on personality profiles and their structure. Personality and Social Psychology Bulletin, 21, 100–108. First citation in articleCrossrefGoogle Scholar

  • Reid-Seiser, H. L. , & Fritzsche, B. A. (2001). The usefulness of the NEO PI-R positive presentation management scale for detecting response distortion in employment contexts. Personality and Individual Differences, 31, 639–650. First citation in articleCrossrefGoogle Scholar

  • Robie, C. , Brown, D. J. , Beaty, J. C. (2007). Do people fake on personality inventories? A verbal protocol analysis. Journal of Business Psychology, 21, 489–509. First citation in articleCrossrefGoogle Scholar

  • Rosse, J. G. , Stecher, M. D. , Miller, J. L. , Levin, R. A. (1998). The impact of response distortion on pre-employment personality testing and hiring decisions. Journal of Applied Psychology, 83, 634–644. First citation in articleCrossrefGoogle Scholar

  • Rothstein, M. G. , & Goffin, R. D. (2006). The use of personality measures in personnel selection: What does current research support?. Human Resource Management Review, 16, 155–180. First citation in articleCrossrefGoogle Scholar

  • Ryan, A. M. , & Ployhart, R. E. (2000). Applicants’ perceptions of selection procedures and decisions: A critical review and agenda for the future. Journal of Management, 26, 565–606. First citation in articleCrossrefGoogle Scholar

  • Schmit, M. J. , & Ryan, A. M. (1992). Test-taking dispositions: A missing link?. Journal of Applied Psychology, 77, 629–637. First citation in articleCrossrefGoogle Scholar

  • Schmitt, N. , Chan, D. , Sacco, J. M. , McFarland, L. A. , Jennings, D. (1999). Correlates of person fit and effect of person fit on test validity. Applied Psychological Measurement, 23, 41–53. First citation in articleCrossrefGoogle Scholar

  • Wagner, S. H. , & Goffin, R. D. (1997). Differences in accuracy of individual and comparative performance appraisal methods. Organizational Behavior and Human Decision Processes, 70, 95–103. First citation in articleCrossrefGoogle Scholar