Abstract
We used a quasi-experiment to examine the relationship between interview structure and racial bias in simulated employment interviews. Although recent meta-analytic findings suggest that high-structure interviews (as compared with low-structure interviews) reduce same-race bias in interview ratings, this claim has not been tested using research designs that allow for stronger inference about the potential links between interview structure and bias. We showed videotaped interviews to 386 business students and, within both high- and low-structure conditions, determined levels of racial similarity bias using multilevel analysis. Our study used a fully crossed design within each condition, where all raters evaluated all applicants. As we expected, findings indicated that interviewers favored racially similar applicants less in high-structure interviews than in low-structure interviews. Our findings provide quasi-experimental evidence that increased interview structure may be effective to suppress racial similarity bias in employment interview ratings.
Impact and Implications
Our findings illustrate the benefits of imposing structure in personnel selection interviews to reduce racial bias in interview ratings. Organizations that rely on high-structured interviews, rather than the more commonplace low-structure interview type, are likely to observe lower levels of racial similarity bias in ratings. The persistent and widespread use of unstructured interviews in organizations exposes applicants to unfair selection practices and increases the risk to organizations of employment discrimination litigation. Furthermore, these interviews withhold the benefits to organizations (e.g., better selection decisions) and applicants (e.g., fair employment practice) that accrue from interview ratings undistorted by bias. Given the focus of our research on fairness issues in employment and organizations, our findings may be important to help meet the following 2016–2030 United Nations Sustainable Development Goals: help organizations to promote inclusive, productive, and decent work for all (number 8); reduce inequality within countries (number 10); and promote peaceful and inclusive societies, provide access to justice for all, and build effective, accountable, and inclusive institutions at all levels (number 16).
References
(2014). Best practice recommendations for designing and implementing experimental vignette methodology studies. Organizational Research Methods, 17, 351–371. 10.1177/1094428114547952
(2013). Best-practice recommendations for estimating cross-level interaction effects using multilevel modeling. Journal of Management, 39, 1490–1528. 10.1177/0149206313478188
(1979). Unfair discrimination in the employment interview: Legal and psychological aspects. Psychological Bulletin, 86, 736–765. 10.1037/0033-2909.86.4.736
(2013). Reviewing, categorizing, and analyzing the literature on Black–White mean differences for predictors of job performance: Verifying some perceptions and updating/correcting others. Personnel Psychology, 66, 91–126. 10.1111/peps.12007
(2007). The influence of relational demography on panel interview ratings: A field experiment. Personnel Psychology, 60, 627–646. 10.1111/j.1744-6570.2007.00086.x
(1997). An overview (and underview) of research and theory within the attraction paradigm. Journal of Social and Personal Relationships, 14, 417–431. 10.1177/0265407597143008
(1997). A review of structure in the selection interview. Personnel Psychology, 50, 655–702. 10.1111/j.1744-6570.1997.tb00709.x
(1998). Structuring employment interviews to improve reliability, validity, and users’ reactions. Current Directions in Psychological Science, 7, 77–82. 10.1111/1467-8721.ep10773001
(1988). Statistical power analysis for the behavioral sciences (2nd ed.). Hillsdale, NJ: Erlbaum.
(2015). An in-depth look at dispositional reasoning and interviewer accuracy. Human Performance, 28, 199–221. 10.1080/08959285.2015.1021046
(2007). Analyzing judgments of ethnically diverse applicants during personnel selection: A study at the Dutch police. International Journal of Selection and Assessment, 15, 139–152. 10.1111/j.1468-2389.2007.00376.x
(2016). Why your stigma isn’t hired: A dual-process framework of interview bias. Human Resource Management Review, 26, 90–111. 10.1016/j.hrmr.2015.09.006
(2011). Social perception as induction and inference: An integrative model of intergroup differentiation, ingroup favoritism, and differential accuracy. Journal of Personality and Social Psychology, 100, 66–83. 10.1037/a0021051
(2005). Discrimination at work: The psychological and organizational bases. New York, NY: Taylor & Francis.
(1988).
A process view of the selection/recruitment interview . In R. S. SchulerS. A. YoungbloodV. L. Huber (Eds.), Readings in personnel and human resource management (pp. 253–269). St Paul, MN: West Publishing Co.(2012).
The selection interview from the interviewer and applicant perspectives: Can’t have one without the other . In N. Schmitt (Ed.), The Oxford handbook of personnel assessment and selection (pp. 323–352). New York, NY: Oxford University Press. 10.1093/oxfordhb/9780199732579.013.0015(1990). A continuum of impression formation, from category-based to individuating processes: Influences of information and motivation on attention and interpretation. Advances in Experimental Social Psychology, 23, 1–74. 10.1016/S0065-2601(08)60317-2
(2008). Social cognition: From brains to culture. New York, NY: McGraw-Hill.
(2005). Relational demography and similarity-attraction in interview assessments and subsequent offer decisions: Are we missing something? Group and Organization Management, 30, 597–624. 10.1177/1059601104267661
(2006). Employment discrimination in organizations: Antecedents and consequences. Journal of Management, 32, 786–830. 10.1177/0149206306293544
(1978). Can we learn anything about interviewing real people from “interviews” of paper people? Two studies of the external validity of a paradigm. Organizational Behavior and Human Performance, 22, 165–192. 10.1016/0030-5073(78)90011-9
(2009). The neglected science and art of quasi-experimentation: Why-to, when-to, and how-to advice for organizational researchers. Organizational Research Methods, 12, 653–686. 10.1177/1094428108320737
(1996). The employee selection interview: A fresh look at an old problem. Human Resource Management, 35, 163–180. 10.1002/(SICI)1099-050X(199622)35:2<163::AID-HRM2>3.0.CO;2-W
(2011). Essentials of personnel assessment and selection. Mahwah, NJ: Routledge.
(2008). Stereotypes about stereotype research. Industrial and Organizational Psychology: Perspectives on Science and Practice, 1, 436–438. 10.1111/j.1754-9434.2008.00083.x
(2002). Intergroup bias. Annual Review of Psychology, 53, 575–604. 10.1146/annurev.psych.53.100901.135109
(2008). Stubborn reliance on intuition and subjectivity in employee selection. Industrial and Organizational Psychology: Perspectives on Science and Practice, 1, 333–342. 10.1111/j.1754-9434.2008.00058.x
(2010). Multilevel analysis: Techniques and applications (2nd ed.). New York, NY: Routledge.
(2000). Rater bias in psychological research: When is it a problem and what can we do about it? Psychological Methods, 5, 64–86. 10.1037/1082-989X.5.1.64
(2010).
Interrater reliability and agreement . In G. R. HancockR. O. Mueller (Eds.), The reviewer’s guide to quantitative methods in the social sciences (pp. 193–210). New York, NY: Taylor & Francis.(2001). Identification and meta-analytic assessment of psychological constructs measured in employment interviews. Journal of Applied Psychology, 86, 897–913. 10.1037/0021-9010.86.5.897
(1998). Racial group differences in employment interview evaluations. Journal of Applied Psychology, 83, 179–189. 10.1037/0021-9010.83.2.179
(2002). Assessment center procedures: Cognitive load during the observation phase. International Journal of Selection and Assessment, 10, 271–278. 10.1111/1468-2389.00217
(2003). When do stereotypes come to mind and when do they color judgment? A goal-based theoretical framework for stereotype activation and application. Psychological Bulletin, 129, 522–544. 10.1037/0033-2909.129.4.522
(2008). Stereotypes, bias, and personnel decisions: Strange and stranger. Industrial and Organizational Psychology: Perspectives on Science and Practice, 1, 379–392. 10.1111/j.1754-9434.2008.00071.x
(1980). The situational interview. Journal of Applied Psychology, 65, 422–427. 10.1037/0021-9010.65.4.422
(2008). Triangulation across methodologies: All signs point to persistent stereotyping and discrimination in organizations. Industrial and Organizational Psychology: Perspectives on Science and Practice, 1, 399–404. 10.1111/j.1754-9434.2008.00073.x
(2014). The structured employment interview: Narrative and quantitative review of the research literature. Personnel Psychology, 67, 241–293. 10.1111/peps.12052
(2004). An empirical investigation of interviewer-related factors that discourage the use of high structure interviews. Journal of Organizational Behavior, 25, 29–46. 10.1002/job.246
(1992). A field study of race and age similarity effects on interview ratings in conventional and situational interviews. Journal of Applied Psychology, 77, 363–371. 10.1037/0021-9010.77.3.363
(2009). The employment interview: A review of current studies and directions for future research. Human Resource Management Review, 19, 203–218. 10.1016/j.hrmr.2009.03.006
(2010). Are highly structured job interviews resistant to demographic similarity effects? Personnel Psychology, 63, 325–359. 10.1111/j.1744-6570.2010.01172.x
(2004). Examination of structured interview ratings across time: The effects of applicant race, rater race, and panel composition. Journal of Management, 30, 435–452. 10.1016/j.jm.2003.09.004
(2011). Is more structure really better? A comparison of frame-of-reference training and descriptively anchored rating scales to improve interviewers’ rating quality. Personnel Psychology, 64, 53–87. 10.1111/j.1744-6570.2010.01202.x
(1986). Evaluating the performance of paper people. Journal of Applied Psychology, 71, 654–661. 10.1037/0021-9010.71.4.654
(2011). Liking is not the opposite of disliking: The functional separability of positive and negative attitudes toward minority groups. Cultural Diversity and Ethnic Minority Psychology, 17, 134–143. 10.1037/a0023806
(2014). Comparing employment interviews in Latin America with other countries. Journal of Business Research, 67, 943–951. 10.1016/j.jbusres.2013.07.014
(2002). Beyond employment interview validity: A comprehensive narrative review of recent research and trends over time. Personnel Psychology, 55, 1–81. 10.1111/j.1744-6570.2002.tb00103.x
(1996). Effects of race on interview ratings in a situational panel interview. Journal of Applied Psychology, 81, 178–186. 10.1037/0021-9010.81.2.178
(1995). Experience-based and situational interview questions: Studies of validity. Personnel Psychology, 48, 289–308. 10.1111/j.1744-6570.1995.tb01758.x
(1975). Demonstration of the effect, “similar to me”, in simulated employment interviews. Psychological Reports, 36, 535–544. 10.2466/pr0.1975.36.2.535
(2002). Hierarchical linear models: Applications and data analysis methods (2nd ed.). Thousand Oaks, CA: SAGE Publications.
(2001).
Relational demography within groups: Past developments, contradictions, and new directions . In G. R. Ferris (Ed.), Research in personnel and human resources management (Vol. 19, pp. 131–173). Bingley, United Kingdom: Emerald Group Publishing Limited. Retrieved from https://www.emeraldinsight.com/doi/pdfplus/10.1016/S0742-7301%2800%2919001-2(2013). Beginning behavioral research: A conceptual primer (7th ed.). Upper Saddle River, NJ: Pearson.
(2008). Main effects do not discrimination make. Industrial and Organizational Psychology: Perspectives on Science and Practice, 1, 415–416. 10.1111/j.1754-9434.2008.00077.x
(1999). An international look at selection practices: Nation and culture as explanations for variability in practice. Personnel Psychology, 52, 359–392. 10.1111/j.1744-6570.1999.tb00165.x
(2003). An investigation of race and sex similarity effects in interviews: A multilevel approach to relational demography. Journal of Applied Psychology, 88, 852–865. 10.1037/0021-9010.88.5.852
(1997). The effects of forming multi-predictor composites on group differences and adverse impact. Personnel Psychology, 50, 707–721. 10.1111/j.1744-6570.1997.tb00711.x
(2011). How accurate are recruiters’ first impressions of applicants in employment interviews? International Journal of Selection and Assessment, 19, 198–208. 10.1111/j.1468-2389.2011.00547.x
(2015). Research methods in psychology (10th ed.). New York, NY: McGraw-Hill Higher Education.
(1986).
The social identity theory of inter-group behavior . In S. WorchelL. W. Austin (Eds.), Psychology of intergroup relations (pp. 7–24). Chicago, IL: Nelson-Hall.(1999). Demographic differences in organizations: Current research and future directions. Lanham, MD: Lexington Books.
(1989). Beyond simple demographic effects: The importance of relational demography in superior-subordinate dyads. Academy of Management Journal, 32, 402–423.
(2002). When both similarities and dissimilarities matter: Extending the concept of relational demography. Human Relations, 55, 899–929. 10.1177/0018726702055008176
(1972). Importance of contrast effects in employment interviews. Journal of Applied Psychology, 56, 45–48. 10.1037/h0032132
(2003). Understanding the determinants of employer use of selection methods. Personnel Psychology, 56, 103–124. 10.1111/j.1744-6570.2003.tb00145.x
(1998). Demography and diversity in organizations: A review of 40 years of research. Research in Organizational Behavior, 20, 77–140.
(1997). Employment interview on trial: Linking interview structure with litigation outcomes. Journal of Applied Psychology, 82, 900–912. 10.1037/0021-9010.82.6.900
