Skip to main content
Search
Search
    Quick Search anywhere
    Quick search in Citations
Advanced Search
Skip main navigationClose Drawer MenuOpen Drawer Menu
Previous article
Next article
Original Articles and Reviews

Construct-Driven Development of a Video-Based Situational Judgment Test for Integrity

A Study in a Multi-Ethnic Police Setting

Published Online:January 01, 2010https://doi.org/10.1027/1016-9040/a000027

Abstract

In a field study conducted in a multi-ethnic selection setting at the Dutch police, we examined the construct validity of a video-based situational judgment test (SJT) aimed to measure the construct of integrity. Integrity is of central importance to productive work performance of police officers. We used a sample of police applicants, which consisted of a Dutch ethnic majority group and an ethnic minority group. The ethnic minority applicants came from one of the four largest ethnic minority groups in The Netherlands, namely groups with a Dutch Antillean, a Moroccan, a Surinamese, or a Turkish background. A critical issue is the often-found construct-heterogeneity of SJTs. However, we found that a construct-driven approach may be fruitful in the development of SJTs aiming to measure one single construct. Confirming our expectations, we found support for the construct validity of the SJT intended to measure the construct of integrity. These results held across ethnic majority and ethnic minority applicants. Therefore, the SJT is a promising test for personnel selection in a multi-ethnic setting.

References

  • Arbuckle, J. L. (2005). Amos 6.0 [Computer software]. Chicago: Smallwaters. First citation in articleGoogle Scholar

  • Barriga, A. Q., Gibbs, J. C. (1996). Measuring cognitive distortions in antisocial youth: Development and preliminary validation of the “How-I-Think” questionnaire. Aggressive Behavior, 22(3), 333–343. First citation in articleCrossref, Google Scholar

  • Barriga, A. Q., Gibbs, J. C., Potter, G. B., Liau, A. K. (2001). The “How-I-Think” questionnaire: Manual. Champaign, IL: Research Press. First citation in articleGoogle Scholar

  • Becker, T. E. (2005). Development and validation of a situational judgment test of employment integrity. International Journal of Selection and Assessment, 13(3), 225–232. First citation in articleCrossref, Google Scholar

  • Chan, D., Schmitt, N. (1997). Video-based versus paper-and-pencil method of assessment in situational judgment tests: Subgroup differences in test performance and face validity perception. Journal of Applied Psychology, 82(1), 143–159. First citation in articleCrossref, Google Scholar

  • Chan, D., Schmitt, N. (2005). Situational judgment tests. In A. Evers, N. Anderson, O. Voskuijl (Eds.), Handbook of personnel selection (pp. 219–246). Oxford: Blackwell. First citation in articleGoogle Scholar

  • Clevenger, J., Pereira, G. M., Wiechmann, D., Schmitt, N., Harvey, V. S. (2001). Incremental validity of situational judgment tests. Journal of Applied Psychology, 86(3), 410–417. First citation in articleCrossref, Google Scholar

  • Cohen, J. (1988). Standard power analysis for the behavioral sciences (2nd ed.). Hillsdale, NJ: Erlbaum. First citation in articleGoogle Scholar

  • Dalessio, A. T. (1994). Predicting insurance agent turnover using a video-based situational judgment test. Journal of Business and Psychology, 9(1), 23–32. First citation in articleCrossref, Google Scholar

  • De Meijer, L. A. L., Born, M. Ph., Terlouw, G., Van der Molen, H. T. (2006). Applicant and method factors related to ethnic score differences in personnel selection: A study at the Dutch police. Human Performance, 19(3), 219–251. First citation in articleCrossref, Google Scholar

  • Fortmann, K., Leslie, C., Cunningham, M. (2002). Cross-cultural comparisons of the Reid Integrity Scale in Latin America and South Africa. International Journal of Selection and Assessment, 10(1/2), 98–108. First citation in articleCrossref, Google Scholar

  • Jones, J. W., Brasher, E. E., Huff, J. W. (2002). Innovations in integrity-based personnel selection: Building a technology-friendly assessment. International Journal of Selection and Assessment, 10(1/2), 87–97. First citation in articleCrossref, Google Scholar

  • Lee, K., Ashton, M. C. (2004). Psychometric properties of the HEXACO personality inventory. Multivariate Behavioral Research, 39(2), 329–358. First citation in articleCrossref, Google Scholar

  • Lee, K., Ashton, M. C., De Vries, R. E. (2005). Predicting workplace delinquency and integrity with the HEXACO and five-factor models of personality structure. Human Performance, 18(2), 179–197. First citation in articleCrossref, Google Scholar

  • Lee, K., Ashton, M. C., Morrison, D. L., Cordery, J., Dunlop, P. D. (2008). Predicting integrity with the HEXACO personality model: Use of self- and observer reports. Journal of Occupational and Organizational Psychology, 81(1), 147–167. First citation in articleCrossref, Google Scholar

  • Lem, J., Van Doorn, E. (2000). Voortgangsrapportage. Onderzoek “kenmerkende voorspellers” politie [Progress report. Study “noticeable predictors” police]. Culemborg, The Netherlands: Meurs Personeelsadvies. First citation in articleGoogle Scholar

  • Lievens, F., Sackett, P. R. (2006). Video-based versus written situational judgment tests: A comparison in terms of predictive validity. Journal of Applied Psychology, 91(5), 1181–1188. First citation in articleCrossref, Google Scholar

  • Marcus, B., Lee, K., Ashton, M. C. (2007). Personality dimensions explaining relationships between integrity tests and counterproductive behavior: Big Five, or one in addition? Personnel Psychology, 60(1), 1–34. First citation in articleCrossref, Google Scholar

  • McDaniel, M. A., Hartman, N. S., Whetzel, D. L., Grubb, III, W. L. (2007). Situational judgment tests, response instructions, and validity: A meta-analysis. Personnel Psychology, 60(1), 63–91. First citation in articleCrossref, Google Scholar

  • McDaniel, M. A., Morgeson, F. P., Bruhn Finnegan, E., Campion, M. A., Braverman, E. P. (2001). Use of situational judgment tests to predict job performance: A clarification of the literature. Journal of Applied Psychology, 86(4), 730–740. First citation in articleCrossref, Google Scholar

  • McDaniel, M. A., Nguyen, N. T. (2001). Situational judgment tests: A review of practice and constructs assessed. International Journal of Selection and Assessment, 9(1/2), 103–113. First citation in articleGoogle Scholar

  • Motowidlo, S. J., Dunnette, M. D., Carter, G. W. (1990). An alternative selection procedure: The low-fidelity simulation. Journal of Applied Psychology, 75(6), 640–647. First citation in articleCrossref, Google Scholar

  • Naeyé, J., Huberts, L., Van Zweden, C., Busato, V., Berger, B. (2004). Integriteit in het dagelijkse politiework [Integrity during daily police work]. Amsterdam: Vrije Universiteit. First citation in articleGoogle Scholar

  • Nguyen, N. T., McDaniel, M. A. (2003). Response instructions and racial differences in a situational judgment test. Applied H.R.M. Research, 8(1), 33–44. First citation in articleGoogle Scholar

  • Occupational Information Network (O*NET) . (2009, May 6). OnLine developed for the US Department of Labor by the National O*NET Consortium. Retrieved May 6, 2009, from www.online.onetcenter.org. First citation in articleGoogle Scholar

  • O’Connell, M. S., Hartman, N. S., McDaniel, M. A., Grubb, W. L., Lawrence, A. III (2007). Incremental validity of situational judgment tests for task and contextual performance. International Journal of Selection and Assessment, 15(1), 19–29. First citation in articleCrossref, Google Scholar

  • Olson-Buchanan, J. B., Drasgow, F., Moberg, P. J., Mead, A. D., Keenan, P. A., Donovan, M. A. (1998). An interactive video assessment of conflict resolution skills. Personnel Psychology, 51(1), 1–24. First citation in articleCrossref, Google Scholar

  • Ones, D. S. (1993). The construct validity evidence for integrity tests. University of Iowa. Iowa City: Unpublished doctoral dissertation. First citation in articleGoogle Scholar

  • Ones, D. S., Viswesvaran, C. (1998). Gender, age, and race differences on overt integrity tests: Results across four large-scale job applicant data sets. Journal of Applied Psychology, 83(1), 35–42. First citation in articleCrossref, Google Scholar

  • Ones, D. S., Viswesvaran, C., Schmidt, F. L. (1993). Comprehensive meta-analysis of integrity test validities: Findings and implications for personnel selection and theories of job performance [Monograph]. Journal of Applied Psychology, 78(4), 679–703. First citation in articleCrossref, Google Scholar

  • Richman-Hirsch, W. L., Olson-Buchanan, J. B., Drasgow, F. (2000). Examining the impact of administration medium on examinee perceptions and attitudes. Journal of Applied Psychology, 85(6), 880–887. First citation in articleCrossref, Google Scholar

  • Rijks Psychologische Dienst . (1975). Politie intelligentie test [Police intelligence test]. The Hague, The Netherlands: RPD. First citation in articleGoogle Scholar

  • Schmidt, F. L., Hunter, J. E. (1998). The validity and utility of selection methods in personnel selection: Practical and theoretical implications of 85 years of research findings. Psychological Bulletin, 124(2), 262–274. First citation in articleCrossref, Google Scholar

  • Van der Maesen, P. E. A. M. (1992). Het rendement van personeelsselectie [The efficiency of personnel selection]. The Netherlands: Rijksuniversiteit Groningen, Unpublished doctoral dissertation. First citation in articleGoogle Scholar

  • Van de Vijver, A. J. R., Leung, K. (1997). Methods and data analysis for cross-cultural research. Thousand Oaks, CA: Sage. First citation in articleGoogle Scholar

  • Van Iddekinge, C. H., Taylor, M. A., Eidson, C. E., Jr. (2005). Broad versus narrow facets of integrity: Predictive validity and subgroup differences. Human Performance, 18(2), 151–177. First citation in articleCrossref, Google Scholar

  • Wanek, J. E. (1999). Integrity and honesty testing: What do we know? How do we use it?. International Journal of Selection and Assessment, 7(4), 183–195. First citation in articleCrossref, Google Scholar

  • Weekley, J. A., Jones, C. (1997). Video-based situational judgment testing. Personnel Psychology, 50(1), 25–49. First citation in articleCrossref, Google Scholar

  • Weekley, J. A., Jones, C. (1999). Further studies of situational tests. Personnel Psychology, 52(3), 679–700. First citation in articleCrossref, Google Scholar