Skip to main content
Search
Search
    Quick Search anywhere
    Quick search in Citations
Advanced Search
Skip main navigationClose Drawer MenuOpen Drawer Menu
Previous article
Research Note

AI Evaluation in Selection

Effects on Application and Pursuit Intentions

Published Online:August 19, 2020https://doi.org/10.1027/1866-5888/a000258

Abstract

Abstract. This study investigates how information provided prior to the application stage of the selection process affects application intentions toward the job and organization. Existing research has focused on applicants who have already entered into the selection process; however, information revealed prior to application may cause candidates to self-select themselves out of the process. Utilizing a randomized experimental design, participants read a job ad specifying that their prerecorded interviews would be reviewed by a human or an artificial intelligence-based evaluator. The results show increased intentions to apply and pursue the job in the human evaluation condition.

References

  • Ashforth, B. E., & Mael, F. (1989). Social identity theory and the organization. Academy of Management Review, 14, 20–39. 10.5465/AMR.1989.4278999 First citation in articleCrossref, Google Scholar

  • Azjen, I. (1991). The theory of planned behavior. Organizational Behavior and Human Decision Processes, 50, 179–211. 10.1016/0749-5978(91)90020-T First citation in articleCrossref, Google Scholar

  • Bangerter, A., Roulin, N., & König, C. J. (2012). Personnel selection as a signaling game. Journal of Applied Psychology, 97, 719–738. 10.1037/a0026078 First citation in articleCrossref, Google Scholar

  • Biran, O., & Cotton, C. (2017). Explanation and justification in machine learning: A survey. IJCAI-17 Workshop on Explainable AI (XAI), 8, 8–13. First citation in articleGoogle Scholar

  • Bonaccio, S., O’Reilly, J., O’Sullivan, S. L., & Chiocchio, F. (2016). Nonverbal behavior and communication in the workplace: A review and an agenda for research. Journal of Management, 42, 1044–1074. 10.1177/0149206315621146 First citation in articleCrossref, Google Scholar

  • Born, M. Ph., Hiemstra, A. M. F., & Oostrom, J. K. (2018). Applicants’ role as (pro-)active agents in the recruitment and selection process: A frequently overlooked perspective. Journal of Personnel Psychology, 17, 103–106. 10.1027/1866-5888/a000215 First citation in articleLink, Google Scholar

  • Born, M. Ph., & Taris, T. W. (2010). The impact of the wording of employment advertisements on students’ inclination to apply for a job. The Journal of Social Psychology, 150, 485–502. 10.1080/00224540903365422 First citation in articleCrossref, Google Scholar

  • Bowen, D. E., & Ostroff, C. (2004). Understanding HRM-firm performance linkages: The role of the “strength” of the HRM system. The Academy of Management Review, 29, 203–221. 10.2307/20159029 First citation in articleCrossref, Google Scholar

  • Brooks, M. E., Highhouse, S., Russell, S. S., & Mohr, D. C. (2003). Familiarity, ambivalence, and firm reputation: Is corporate fame a double-edged sword? Journal of Applied Psychology, 88, 904–914. 10.1037/0021-9010.88.5.904 First citation in articleCrossref, Google Scholar

  • Buehl, A.-K., & Melchers, K. G. (2018). Do attractiveness and competition influence faking intentions in selection interviews? Journal of Personnel Psychology, 17, 204–208. 10.1027/1866-5888/a000208 First citation in articleLink, Google Scholar

  • Cable, D. M., & Turban, D. B. (2001). Establishing the dimensions, sources and value of job seekers’ employer knowledge during recruitment. In G. Ferris (Ed.), Research in personnel and human resources management (Vol. 20, pp. 115–163). Bingley, UK: Emerald Group Publishing Limited. First citation in articleCrossref, Google Scholar

  • Cable, D. M., & Turban, D. B. (2003). The value of organizational reputation in the recruitment context: A brand-equity perspective. Journal of Applied Social Psychology, 33, 2244–2266. 10.1111/j.1559-1816.2003.tb01883.x First citation in articleCrossref, Google Scholar

  • Carter, N. T., & Highhouse, S. (2014). You will be known by the company you keep: Understanding the social-identity concerns of job seekers. In D. M. CableK. Y. T. Yu (Eds.), The Oxford handbook of recruitment (pp. 454–462). New York, NY: Oxford University Press. First citation in articleGoogle Scholar

  • Chamorro-Premuzic, T., Akhtar, R., Winsborough, D., & Sherman, R. A. (2017). The datafication of talent: How technology is advancing the science of human potential at work. Current Opinion in Behavioral Sciences, 18, 13–16. 10.1016/j.cobeha.2017.04.007 First citation in articleCrossref, Google Scholar

  • Chapman, D. S., Uggerslev, K. L., Carroll, S. A., Piasentin, K. A., & Jones, D. A. (2005). Applicant attraction to organizations and job choice: A meta-analytic review of the correlates of recruiting outcomes. Journal of Applied Psychology, 90, 928–944. 10.1037/0021-9010.90.5.928 First citation in articleCrossref, Google Scholar

  • Cheung, G. W., & Lau, R. S. (2008). Testing mediation and suppression effects of latent variables: Bootstrapping with structural equation models. Organizational Research Methods, 11, 296–325. 10.1177/1094428107300343 First citation in articleCrossref, Google Scholar

  • Collins, C. J., & Kanar, A. M. (2014). Employer brand equity and recruitment research. In D. M. CableK. Y. T. Yu (Eds.), The Oxford handbook of recruitment (pp. 284–297). New York, NY: Oxford University Press. First citation in articleGoogle Scholar

  • Dineen, B. R., & Allen, D. G. (2016). Third party employment branding: Human capital inflows and outflows following “Best Places to Work” certifications. Academy of Management Journal, 59, 90–112. 10.5465/amj.2013.1091 First citation in articleCrossref, Google Scholar

  • Drover, W., Wood, M. S., & Corbett, A. C. (2018). Toward a cognitive view of signalling theory: Individual attention and signal set interpretation. Journal of Management Studies, 55, 209–231. 10.1111/joms.12282 First citation in articleCrossref, Google Scholar

  • Dürr, D., & Klehe, U.-C. (2018). Using the theory of planned behavior to predict faking in selection exercises varying in fidelity. Journal of Personnel Psychology, 17, 155–160. 10.1027/1866-5888/a000211 First citation in articleLink, Google Scholar

  • Ehrhart, K. H., & Ziegert, J. C. (2005). Why are individuals attracted to organizations? Journal of Management, 31, 901–919. 10.1177/0149206305279759 First citation in articleCrossref, Google Scholar

  • Fox, G., & Connolly, R. (2018). Mobile health technology adoption across generations: Narrowing the digital divide. Information Systems Journal, 28, 995–1019. 10.1111/isj.12179 First citation in articleCrossref, Google Scholar

  • Gilliland, S. W. (1993). The perceived fairness of selection systems: An organizational justice perspective. Academy of Management Review, 18, 694–734. 10.5465/amr.1993.9402210155 First citation in articleCrossref, Google Scholar

  • Harrison, T., & Stone, D. L. (2018). Effects of organizational values and employee contact on e-recruiting. Journal of Managerial Psychology, 33, 311–324. 10.1108/JMP-03-2017-0118 First citation in articleCrossref, Google Scholar

  • Highhouse, S., Lievens, F., & Sinar, E. F. (2003). Measuring attraction to organizations. Educational and Psychological Measurement, 63, 986–1001. 10.1177/0013164403258403 First citation in articleCrossref, Google Scholar

  • Langer, M., König, C. J., & Fitili, A. (2019). Information as a double-edged sword: The role of computer experience and information on applicant reactions towards novel technologies for personnel selection. Computers in Human Behavior, 81, 19–30. 10.1016/j.chb.2017.11.036 First citation in articleCrossref, Google Scholar

  • Langer, M., König, C. J., & Krause, K. (2017). Examining digital interviews for personnel selection: Applicant reactions and interviewer ratings. International Journal of Selection and Assessment, 25, 371–382. 10.1111/ijsa.12191 First citation in articleCrossref, Google Scholar

  • Levashina, J., & Campion, M. A. (2006). A model of faking likelihood in the employment interview. International Journal of Selection and Assessment, 14, 299–316. 10.1111/j.1468-2389.2006.00353.x First citation in articleCrossref, Google Scholar

  • Lievens, F., & Sackett, P. R. (2017). The effects of predictor method factors on selection outcomes: A modular approach to personnel selection procedures. Journal of Applied Psychology, 102(1), 43–66. 10.1037/apl0000160 First citation in articleCrossref, Google Scholar

  • McCarthy, J. M., Bauer, T. N., Truxillo, D. M., Anderson, N. R., Costa, A. C., & Ahmed, S. M. (2017). Applicant perspectives during selection: A review addressing “so what?,” “what’s new?,” and “where to next?”. Journal of Management, 43, 1693–1725. 10.1177/0149206316681846 First citation in articleCrossref, Google Scholar

  • Parasuraman, R., Sheridan, T. B., & Wickens, C. D. (2000). A model for types and levels of human interaction with automation. IEEE Transactions on Systems, Man, and Cybernetics – Part A: Systems and Humans, 30, 286–297. 10.1109/3468.844354 First citation in articleCrossref, Google Scholar

  • Potosky, D. (2008). A conceptual framework for the role of the administration medium in the personnel assessment process. Academy of Management Review, 33, 629–648. 10.5465/amr.2008.32465704 First citation in articleCrossref, Google Scholar

  • Reeve, C. L., & Schultz, L. (2004). Job-seeker reactions to selection process information in job ads. International Journal of Selection and Assessment, 12, 343–355. 10.1111/j.0965-075X.2004.00289.x First citation in articleCrossref, Google Scholar

  • Salmerón, R., García, J., García, C. B., & Martín, M. M. L. (2017). A note about the corrected VIF. Statistical Papers, 58, 929–945. 10.1007/s00362-015-0732-9 First citation in articleCrossref, Google Scholar

  • Selya, A. S., Rose, J. S., Dierker, L. C., Hedeker, D., & Mermelstein, R. J. (2012). A practical guide to calculating Cohen’s f2, a measure of local effect size, from PROC MIXED. Frontiers in Psychology, 3, 111. 10.3389/fpsyg.2012.00111 First citation in articleCrossref, Google Scholar

  • Spence, M. (1973). Job market signaling. The Quarterly Journal of Economics, 87, 355–374. 10.2307/1882010 First citation in articleCrossref, Google Scholar

  • Tonidandel, S., LeBreton, J. M., & Johnson, J. W. (2009). Determining the statistical significance of relative weights. Psychological Methods, 14, 387–399. 10.1037/a0017735 First citation in articleCrossref, Google Scholar

  • Tonidandel, S., & LeBreton, J. M. (2015). RWA web: A free, comprehensive, web-based, and user-friendly tool for relative weight analyses. Journal of Business and Psychology, 30, 207–216. 10.1007/s10869-014-9351-z First citation in articleCrossref, Google Scholar

  • Truxillo, D. M., Bodner, T. E., Bertolino, M., Bauer, T. N., & Yonce, C. A. (2009). Effects of explanations on applicant reactions: A meta-analytic review. International Journal of Selection and Assessment, 17, 346–361. 10.1111/j.1468-2389.2009.00478.x First citation in articleCrossref, Google Scholar

  • Uggerslev, K. L., Fassina, N. E., & Kraichy, D. (2012). Recruiting through the stages: A meta-analytic test of predictors of applicant attraction at different stages of the recruiting process. Personnel Psychology, 65, 597–660. 10.1111/j.1744-6570.2012.01254.x First citation in articleCrossref, Google Scholar

  • Venkatesh, V., & Bala, H. (2008). Technology acceptance model 3 and a research agenda on interventions. Decision Sciences, 39, 273–315. 10.1111/j.1540-5915.2008.00192.x First citation in articleCrossref, Google Scholar

  • Walker, H. J., Feild, H. S., Giles, W. F., & Bernerth, J. B. (2008). The interactive effects of job advertisement characteristics and applicant experience on reactions to recruitment messages. Journal of Occupational and Organizational Psychology, 81, 619–638. 10.1348/096317907X252487 First citation in articleCrossref, Google Scholar

  • Watson, D., Clark, L. A., Chmielewski, M., & Kotov, R. (2013). The value of suppressor effects in explicating the construct validity of symptom measures. Psychological Assessment, 25, 929–941. 10.1037/a0032781 First citation in articleCrossref, Google Scholar