Skip to main content
Original Article

Reducing the Halo Effect by Stimulating Analytic Thinking

Published Online:https://doi.org/10.1027/1864-9335/a000418

Abstract. The halo effect is one of the most common threats to interpersonal evaluation. In the present study, we examined the role of an alternative approach to reducing the halo effect, namely by stimulating analytic thinking. In Study 1, we established the validity of the current paradigm in inducing the halo effect. In Study 2 and Study 3, we investigated whether the halo effect could be reduced when analytic thinking was activated either with Raven’s Standard Progressive Matrices or with a writing task. Results of both studies showed that participants were less biased by the irrelevant central trait when analytic thinking was activated compared to the control group, suggesting that priming analytic thinking ahead of a judgmental task can reduce the halo effect.

References

  • Anastasi, A. (1988). Psychological testing (6th ed.). New York, NY: Macmillan. First citation in articleGoogle Scholar

  • Basow, S. A., Phelan, J. E., & Capotosto, L. (2006). Gender Patterns in college students’ choices of their best and worst professors. Psychology of Women Quarterly, 30, 25–35. https://doi.org/10.1111/j.1471-6402.2006.00259.x First citation in articleCrossrefGoogle Scholar

  • Baumeister, R. F., Bratslavsky, E., Finkenauer, C., & Vohs, K. D. (2001). Bad is stronger than good. Review of General Psychology, 5, 323–370. https://doi.org/10.1037/1089-2680.5.4.323 First citation in articleCrossrefGoogle Scholar

  • Bernardin, H. J., & Pence, E. C. (1980). Effects of rater training: Creating new response sets and decreasing accuracy. Journal of Applied Psychology, 65, 60–66. https://doi.org/10.1037/0021-9010.65.1.60 First citation in articleCrossrefGoogle Scholar

  • Bless, H., & Fiedler, K. (2006). Mood and the regulation of information processing and behavior. In J. P. ForgasEd., Hearts and mind: Affect in social thinking and behavior (pp. 65–84). New York, NY: Psychology Press. First citation in articleGoogle Scholar

  • Centra, J. A., & Gaubatz, N. B. (2000). Is there gender bias in student evaluations of teaching? Journal of Higher Education, 71, 17–33. https://doi.org/10.2307/2649280 First citation in articleCrossrefGoogle Scholar

  • Chaiken, S.Trope, Y. (Eds.). (1999). Dual-process theories in social psychology. New York, NY: Guilford Press. First citation in articleGoogle Scholar

  • Cohen, J. (1969). Statistical power analysis for the behavioural sciences. New York, NY: Academic Press. First citation in articleGoogle Scholar

  • Cooper, W. H. (1981). Ubiquitous halo. Psychological Bulletin, 90, 218–244. https://doi.org/10.1037/0033-2909.90.2.218 First citation in articleCrossrefGoogle Scholar

  • Cooper, H., & Findley, M. (1982). Expected effect sizes: Estimates for statistical power analysis in Social Psychology. Personality and Social Psychology Bulletin, 8, 168–173. https://doi.org/10.1177/014616728281026 First citation in articleCrossrefGoogle Scholar

  • Dillon, W. R., Mulani, N., & Frederick, D. G. (1984). Removing perceptual distortions in product space analysis. Journal of Marketing Research, 21, 184–193. https://doi.org/10.2307/3151700 First citation in articleCrossrefGoogle Scholar

  • Dion, K., Berscheid, E., & Walster, E. (1972). What is beautiful is good. Journal of Personality and Social Psychology, 24, 207–213. https://doi.org/10.1037/h0033731 First citation in articleCrossrefGoogle Scholar

  • Evans, J. S. B. (2003). In two minds: Dual-process accounts of reasoning. Trends in Cognitive Sciences, 7, 454–459. https://doi.org/10.1016/j.tics.2003.08.012 First citation in articleCrossrefGoogle Scholar

  • Evans, J. S. B. (2008). Dual-processing accounts of reasoning, judgment, and social cognition. Annual Review of Psychology, 59, 255–278. https://doi.org/10.1146/annurev.psych.59.103006.093629 First citation in articleCrossrefGoogle Scholar

  • Evans, J. S. B., & Stanovich, K. E. (2013). Dual-process theories of higher cognition advancing the debate. Perspectives on Psychological Science, 8, 223–241. https://doi.org/10.1177/1745691612460685 First citation in articleCrossrefGoogle Scholar

  • Faul, F., Erdfelder, E., Lang, A. G., & Buchner, A. (2007). G*Power 3: A flexible statistical power analysis program for the social, behavioral, and biomedical sciences. Behavior Research Methods, 39, 175–191. https://doi.org/10.3758/BF03193146 First citation in articleCrossrefGoogle Scholar

  • Feeley, T. H. (2002). Comment on halo effects in rating and evaluation research. Human Communication Research, 28, 578–586. https://doi.org/10.1111/j.1468-2958.2002.tb00825.x First citation in articleCrossrefGoogle Scholar

  • Fisicaro, S. A., & Lance, C. E. (1990). Implications of three causal models for the measurement of Halo error. Applied Psychological Measurement, 14, 419–429. https://doi.org/10.1177/014662169001400407 First citation in articleCrossrefGoogle Scholar

  • Forgas, J. P. (2008). Happy and close, but sad and effective? Affective influences on relationship judgments and behaviors. In J. P. ForgasJ. FitnessEds., Social relationships: Cognitive, affective and motivational processes (pp. 203–218). New York, NY: Psychology Press. First citation in articleGoogle Scholar

  • Forgas, J. P. (2013). Don’t worry, be sad! On the cognitive, motivational, and interpersonal benefits of negative mood. Current Directions in Psychological Science, 22, 225–232. https://doi.org/10.1177/0963721412474458 First citation in articleCrossrefGoogle Scholar

  • Forgas, J. P., & Laham, S. (2009). Halo effects. In R. BaumeisterK. D. VohsEds., Encyclopedia of social psychology (pp. 499–502). Thousand Oaks, CA: Sage Publications. First citation in articleGoogle Scholar

  • Forgas, J. P., & Laham, S. M. (2016). Halo effects. In R. F. PohlEd., Cognitive illusions: Intriguing phenomena in judgment, thinking and memory (pp. 276–290). New York, NY: Psychology Press. First citation in articleGoogle Scholar

  • Gervais, W. M., & Norenzayan, A. (2012). Analytic thinking promotes religious disbelief. Science, 336, 493–496. https://doi.org/10.1126/science.1215647 First citation in articleCrossrefGoogle Scholar

  • Goodman-Delahunty, J., & Sporer, S. L. (2010). Unconscious influences in sentencing decisions: A research review of psychological sources of disparity. Australian Journal of Forensic Sciences, 42, 19–36. https://doi.org/10.1080/00450610903391440 First citation in articleCrossrefGoogle Scholar

  • Gräf, M., & Unkelbach, C. (2016). Halo effects in trait assessment depend on information valence: Why being honest makes you industrious, but lying does not make you lazy. Personality and Social Psychology Bulletin, 42, 290–310. https://doi.org/10.1177/0146167215627137 First citation in articleCrossrefGoogle Scholar

  • Holbrook, M. B. (1983). Using a structural model of halo effect to assess perceptual distortion due to affective overtones. Journal of Consumer Research, 10, 247–252. https://doi.org/10.1086/208963 First citation in articleCrossrefGoogle Scholar

  • Jae, H., & Cowling, J. (2009). Objectivity in grading: the promise of bar codes. College Teaching, 57, 51–55. https://doi.org/10.3200/CTCH.57.1.51-55 First citation in articleCrossrefGoogle Scholar

  • Kahneman, D. (2011). Thinking, fast and slow. New York, NY: Macmillan. First citation in articleGoogle Scholar

  • Kail, R. V. (2007). Longitudinal evidence that increases in processing speed and working memory enhance children’s reasoning. Psychological Science, 18, 312–313. https://doi.org/10.1111/j.1467-9280.2007.01895.x First citation in articleCrossrefGoogle Scholar

  • Kelley, H. H. (1950). The warm‐cold variable in first impressions of persons. Journal of Personality, 18, 431–439. https://doi.org/10.1111/j.1467-6494.1950.tb01260 First citation in articleCrossrefGoogle Scholar

  • Kohn, J., & Hatfield, L. (2006). The role of gender in teaching effectiveness ratings of faculty. Academy of Educational Leadership Journal, 10, 121–137. First citation in articleGoogle Scholar

  • Kozlowski, S. W., & Kirsch, M. P. (1987). The systematic distortion hypothesis, halo, and accuracy: An individual-level analysis. Journal of Applied Psychology, 72, 252–261. https://doi.org/10.1037/0021-9010.72.2.252 First citation in articleCrossrefGoogle Scholar

  • Lai, E. R., Wolfe, E. W., & Vickers, D. (2015). Differentiation of illusory and true halo in writing scores. Educational and Psychological Measurement, 75, 102–125. https://doi.org/10.1177/0013164414530990 First citation in articleCrossrefGoogle Scholar

  • Landy, F. J., & Farr, J. L. (1980). Performance rating. Psychological Bulletin, 87, 70–107. https://doi.org/10.1037/0033-2909.87.1.72 First citation in articleCrossrefGoogle Scholar

  • Landy, F. J., Vance, R. J., Barnes-Farrell, J. L., & Steele, J. W. (1980). Statistical control of halo in performance ratings. Journal of Applied Psychology, 65, 501–506. https://doi.org/10.1037/0021-9010.65.5.501 First citation in articleCrossrefGoogle Scholar

  • Ma-Kellams, C., & Lerner, J. (2016). Trust your gut or think carefully? Examining whether an intuitive, versus a systematic, mode of thought produces greater empathic accuracy. Journal of Personality and Social Psychology, 111, 674–685. https://doi.org/10.1037/pspi0000063 First citation in articleCrossrefGoogle Scholar

  • Malouff, J. M., Emmerton, A. J., & Schutte, N. S. (2013). The risk of a halo bias as a reason to keep students anonymous during grading. Teaching of Psychology, 40, 233–237. https://doi.org/10.1177/0098628313487425 First citation in articleCrossrefGoogle Scholar

  • Malouff, J. M., Stein, S. J., Bothma, L. N., Coulter, K., & Emmerton, A. J. (2014). Preventing halo bias in grading the work of university students. Cogent Psychology, 1, 988937. https://doi.org/10.1080/23311908.2014.988937 First citation in articleCrossrefGoogle Scholar

  • Matovic, D., Koch, A. S., & Forgas, J. P. (2014). Can negative mood improve language understanding? Affective influences on the ability to detect ambiguous communication. Journal of Experimental Social Psychology, 52, 44–49. https://doi.org/10.1016/j.jesp.2013.12.003 First citation in articleCrossrefGoogle Scholar

  • Morewedge, C. K., & Kahneman, D. (2010). Associative processes in intuitive judgment. Trends in Cognitive Sciences, 14, 435–440. https://doi.org/10.1016/j.tics.2010.07.004 First citation in articleCrossrefGoogle Scholar

  • Murphy, K. R., Jako, R. A., & Anhalt, R. L. (1993). Nature and consequences of halo error: A critical analysis. Journal of Applied psychology, 78, 218–255. https://doi.org/10.1037/0021-9010.78.2.218 First citation in articleCrossrefGoogle Scholar

  • Nisbett, R. E., & Wilson, T. D. (1977). The halo effect: Evidence for unconscious alteration of judgments. Journal of Personality and Social Psychology, 35, 250–256. https://doi.org/10.1037/0022-3514.35.4.250 First citation in articleCrossrefGoogle Scholar

  • Pennycook, G., Fugelsang, J. A., & Koehler, D. J. (2015a). What makes us think? A three-stage dual-process model of analytic engagement. Cognitive Psychology, 80, 34–72. https://doi.org/10.1016/j.cogpsych.2015.05.001 First citation in articleCrossrefGoogle Scholar

  • Pennycook, G., Fugelsang, J. A., & Koehler, D. J. (2015b). Everyday consequences of analytic thinking. Current Directions in Psychological Science, 24, 425–432. https://doi.org/10.1177/0963721415604610 First citation in articleCrossrefGoogle Scholar

  • Prabhakaran, V., Smith, J. A., Desmond, J. E., Glover, G. H., & Gabrieli, J. D. (1997). Neural substrates of fluid reasoning: An fMRI study of neocortical activation during performance of the Raven’s Progressive Matrices Test. Cognitive Psychology, 33, 43–63. https://doi.org/10.1006/cogp.1997.0659 First citation in articleCrossrefGoogle Scholar

  • Rand, D. G., Greene, J. D., & Nowak, M. A. (2012). Spontaneous giving and calculated greed. Nature, 489, 427–430. https://doi.org/10.1038/nature11467 First citation in articleCrossrefGoogle Scholar

  • Rand, D. G., Peysakhovich, A., Kraft-Todd, G. T., Newman, G. E., Wurzbacher, O., Nowak, M. A., & Greene, J. D. (2014). Social heuristics shape intuitive cooperation. Nature Communications, 5, 1–12. https://doi.org/10.1038/ncomms4677 First citation in articleCrossrefGoogle Scholar

  • Raven, J. C. (1960). Guide to the standard progressive matrices: Sets A, B, C, D and E. London, UK: HK Lewis. First citation in articleGoogle Scholar

  • Raven, J. C. (2000). The Raven’s progressive matrices: Change and stability over culture and time. Cognitive Psychology, 41, 1–48. https://doi.org/10.1006/cogp.1999.0735 First citation in articleCrossrefGoogle Scholar

  • Rosenzweig, P. (2014). The halo effect and the eight other business delusions that deceive managers. New York, NY: Free Press. First citation in articleGoogle Scholar

  • Shenhav, A., Rand, D. G., & Greene, J. D. (2012). Divine intuition: Cognitive style influences belief in god. Journal of Experimental Psychology: General, 141, 423–428. https://doi.org/10.1037/a0025391 First citation in articleCrossrefGoogle Scholar

  • Sigall, H., & Ostrove, N. (1975). Beautiful but dangerous: Effects of offender attractiveness and nature of the crime on juridic judgment. Journal of Personality and Social Psychology, 31, 410–414. https://doi.org/10.1037/h0076472 First citation in articleCrossrefGoogle Scholar

  • Sloman, S. A. (1996). The empirical case for two systems of reasoning. Psychological Bulletin, 119, 3–22. https://doi.org/10.1037/0033-2909.119.1.3 First citation in articleCrossrefGoogle Scholar

  • Steiger, J. H. (2004). Beyond the F test: Effect size confidence intervals and tests of close fit in the analysis of variance and contrast analysis. Psychological Methods, 9, 164–182. https://doi.org/10.1037/1082-989X.9.2.164 First citation in articleCrossrefGoogle Scholar

  • Strack, F., & Deutsch, R. (2004). Reflective and impulsive determinants of social behavior. Personality and Social Psychology Review, 8, 220–247. https://doi.org/10.1207/s15327957pspr0803_1 First citation in articleCrossrefGoogle Scholar

  • Strack, F., & Deutsch, R. (2015). The duality of everyday life: Dual-process and dual system models in social psychology. In M. MikulincerP. R. ShaverE. BorgidaJ. A. BarghEds., APA handbooks in psychology®. APA handbook of personality and social psychology, Vol. 1. Attitudes and social cognition (pp. 891–927). American Psychological Association. https://doi.org/10.1037/14341-028 First citation in articleGoogle Scholar

  • Swami, V., Voracek, M., Stieger, S., Tran, U. S., & Furnham, A. (2014). Analytic thinking reduces belief in conspiracy theories. Cognition, 133, 572–585. https://doi.org/10.1016/j.cognition.2014.08.006 First citation in articleCrossrefGoogle Scholar

  • Thomas, M. R., Beckman, T. J., Mauck, K. F., Cha, S. S., & Thomas, K. G. (2011). Group assessments of resident physicians improve reliability and decrease halo error. Journal of General Internal Medicine, 2, 759–764. https://doi.org/10.1007/s11606-011-1670-4 First citation in articleCrossrefGoogle Scholar

  • Wuensch, K. L. (2012). Using SPSS to obtain a confidence interval for Cohen’s d. Retrieved from http://core.ecu.edu/psyc/wuenschk/SPSS/CI-d-SPSS.pdf First citation in articleGoogle Scholar

  • Wuensch, K. L. (2016). Construct confidence interval for R2 from regression analysis. Retrieved from http://core.ecu.edu/psyc/wuenschk/SPSS/CI-R2-SPSS.zip First citation in articleGoogle Scholar

  • Zhang, Y., Kong, F., Zhong, Y., & Kou, H. (2014). Personality manipulations: Do they modulate facial attractiveness ratings? Personality and Individual Differences, 70, 80–84. https://doi.org/10.1016/j.paid.2014.06.033 First citation in articleCrossrefGoogle Scholar