Skip to main content
Research Article

Biased Processing of Ambiguous Symptoms Favors the Initially Leading Hypothesis in Sequential Diagnostic Reasoning

Published Online:https://doi.org/10.1027/1618-3169/a000298

Abstract. In sequential diagnostic reasoning, observed pieces of evidence activate hypotheses in memory and are integrated to reach a final diagnosis. The order of evidence can influence diagnostic reasoning. This article examines the processing of ambiguous evidence underlying order effects if multiple hypotheses are activated. In five experiments with a quasi-medical scenario, participants dealt with symptom sequences supporting multiple diagnoses. The symptom order, the response mode (end-of-sequence, step-by-step), and the consistency of evidence were manipulated. A primacy order effect occurred with both response modes suggesting that ambiguous pieces of evidence were distorted toward the hypothesis that strongly corresponded with the first piece. The primacy effect was partially counteracted by stepwise belief ratings, which strengthened the weight of recent evidence and promoted switching to an alternative diagnosis. We conclude that once hypotheses are generated, the interplay of coherence-oriented information distortion and memory-dependent analytic processes propagates into distinct order effects in diagnoses.

References

  • Anderson, C. A. & Sechler, E. S. (1986). Effects of explanation and counterexplanation on the development and use of social theories. Journal of Personality and Social Psychology, 50, 24–34. doi: 10.1037/0022-3514.50.1.24 First citation in articleCrossrefGoogle Scholar

  • Anderson, N. H. (1981). Foundations of information integration theory. New York, NY: Academic Press. First citation in articleGoogle Scholar

  • Anderson, N. H. & Hubert, S. (1963). Effects of concomitant verbal recall on order effects in personality impression formation. Journal of Verbal Learning and Behavior, 2, 379–391. doi: 10.1016/S0022-5371(63)80039-0 First citation in articleCrossrefGoogle Scholar

  • Arocha, J. F. & Patel, V. L. (1995). Construction-integration theory and clinical reasoning. In C. A. Weaver IIIS. MannesC. R. FletcherEds., Discourse comprehension: Essays in honor of Walter Kintsch (pp. 359–381). Hillsdale, NJ: Erlbaum. First citation in articleGoogle Scholar

  • Asch, S. E. (1946). Forming impressions of personality. The Journal of Abnormal and Social Psychology, 41, 258–290. doi: 10.1037/h0055756 First citation in articleCrossrefGoogle Scholar

  • Barbey, A. K. & Barsalou, L. W. (2009). Reasoning and problem solving: Models. In L. SquireEd., Encyclopedia of Neuroscience (Vol. 8, pp. 35–43). Oxford, UK: Academic Press. First citation in articleGoogle Scholar

  • Baumann, M., Krems, J. & Ritter, F. (2010). Learning from examples does not prevent order effects in belief revision. Thinking & Reasoning, 16, 98–130. doi: 10.1080/13546783.2010.484211 First citation in articleCrossrefGoogle Scholar

  • Baumann, M., Mehlhorn, K. & Bocklisch, F. (2007). The activation of hypotheses during abductive reasoning. In D. S. McNamaraJ. G. TraftonEds., Proceedings of the 29th Annual Cognitive Science Society (pp. 803–808). Austin, TX: Cognitive Science Society. First citation in articleGoogle Scholar

  • Bergus, G. R., Chapman, G. B., Levy, B. T., Ely, J. W. & Oppliger, R. A. (1998). Clinical diagnosis and the order of information. Medical Decision Making, 18, 412–417. doi: 10.1177/0272989X9801800409 First citation in articleCrossref MedlineGoogle Scholar

  • Bodenhausen, G. V. & Lichtenstein, M. (1987). Social stereotypes and information-processing strategies: The impact of task complexity. Journal of Personality and Social Psychology, 52, 871–880. doi: 10.1037/0022-3514.52.5.871 First citation in articleCrossref MedlineGoogle Scholar

  • Bond, S. D., Carlson, K. A., Meloy, M. G., Russo, J. E. & Tanner, R. J. (2007). Information distortion in the evaluation of a single option. Organizational Behavior and Human Decision Processes, 102, 240–254. doi: 10.1016/j.obhdp.2006.04.009 First citation in articleCrossrefGoogle Scholar

  • Brownstein, A. (2003). Biased predecision processing. Psychological Bulletin, 129, 545–568. doi: 10.1037/0033-2909.129.4.545 First citation in articleCrossref MedlineGoogle Scholar

  • Bylander, T., Allemang, D., Tanner, M. & Josephson, J. R. (1991). The computational complexity of abduction. Artificial Intelligence, 49, 25–60. doi: 10.1016/0004-3702(91)90005-5 First citation in articleCrossrefGoogle Scholar

  • Carlson, K. A., Meloy, M. G. & Russo, J. E. (2006). Leader-driven primacy: Using attribute order to affect consumer choice. Journal of Consumer Research, 32, 513–518. doi: 10.1086/500481 First citation in articleCrossrefGoogle Scholar

  • Carlson, K. A. & Pearo, L. K. (2004). Limiting predecisional distortion by prior valuation of attribute components. Organizational Behavior and Human Decision Processes, 94, 48–59. doi: 10.1016/j.obhdp.2004.02.001 First citation in articleCrossrefGoogle Scholar

  • Chapman, G. P., Bergus, G. R. & Elstein, A. S. (1996). Order of information affects clinical judgment. Journal of Behavioral Decision Making, 9, 201–211. doi: 10.1002/(SICI)1099-0771(199609)9:3<201::AID-BDM229>3.0.CO;2-J First citation in articleCrossrefGoogle Scholar

  • Chinn, C. A. & Brewer, W. F. (1993). The role of anomalous data in knowledge acquisition: A theoretical framework and implications for science instruction. Review of Educational Research, 63, 1–49. doi: 10.3102/00346543063001001 First citation in articleCrossrefGoogle Scholar

  • Croskerry, P. (2003). The importance of cognitive errors in diagnosis and strategies to minimize them. Academic Medicine, 78, 775–780. doi: 10.1097/00001888-200308000-00003 First citation in articleCrossref MedlineGoogle Scholar

  • Cunnington, J. P. W., Turnbull, J., Regehr, G., Marriott, G. & Norman, G. R. (1997). The effect of presentation order in clinical decision making. Academic Medicine, 72, S40–S42. doi: 10.1097/00001888-199710001-00014 First citation in articleCrossrefGoogle Scholar

  • Curley, S. P., Young, M. J., Kingry, M. J. & Yates, J. F. (1988). Primacy effects in clinical judgments of contingency. Medical Decision Making, 8, 216–222. doi: 10.1177/0272989X8800800310 First citation in articleCrossref MedlineGoogle Scholar

  • Davelaar, E. J., Goshen-Gottstein, Y., Ashkenazi, A., Haarmann, H. J. & Usher, M. (2005). The demise of short-term memory revisited: Empirical and computational investigations of recency effects. Psychological Review, 112, 3–42. doi: 10.1037/0033-295X.112.1.3 First citation in articleCrossref MedlineGoogle Scholar

  • Doherty, M. E., Mynatt, C. R., Tweney, R. D. & Schiavo, M. D. (1979). Pseudodiagnosticity. Acta Psychologica, 43, 111–121. doi: 10.1016/0001-6918(79)90017-9 First citation in articleCrossrefGoogle Scholar

  • Gade, E.-M. (2014). The effect of the way how knowledge is acquired on sequential diagnostic reasoning, [Der Effekt der Form des Wissenserwerbs auf sequenzielles diagnostisches Schließen] (Unpublished diploma thesis, master’s level). University of Greifswald, Germany First citation in articleGoogle Scholar

  • Hagmayer, Y. & Kostopoulou, O. (2013). A probabilistic constraint satisfaction model of information distortion in diagnostic reasoning. In M. KnauffM. PauenN. SebanzI. WachsmuthEds., Proceedings of the 35th Annual Conference of the Cognitive Science Society (pp. 531–536). Austin, TX: Cognitive Science Society. First citation in articleGoogle Scholar

  • Hastie, R. & Kumar, P. A. (1979). Person memory: Personality traits as organizing principles in memory for behaviors. Journal of Personality and Social Psychology, 37, 25–38. doi: 10.1037/0022-3514.37.1.25 First citation in articleCrossrefGoogle Scholar

  • Hendrick, C. & Constantini, A. F. (1970). Effects of varying trait inconsistency and response requirements on the primacy effect in impression formation. Journal of Personality and Social Psychology, 15, 158–164. doi: 10.1037/h0029203 First citation in articleCrossrefGoogle Scholar

  • Hirt, E. R. & Markman, K. D. (1995). Multiple explanation: A consider-an-alternative strategy for debiasing judgments. Journal of Personality and Social Psychology, 69, 1069–1086. doi: 10.1037/0022-3514.69.6.1069 First citation in articleCrossrefGoogle Scholar

  • Hogarth, R. M. & Einhorn, H. J. (1992). Order effects in belief updating: The belief-adjustment model. Cognitive Psychology, 24, 1–55. doi: 10.1016/0010-0285(92)90002-J First citation in articleCrossrefGoogle Scholar

  • Holyoak, K. J. & Simon, D. (1999). Bidirectional reasoning in decision making by constraint satisfaction. Journal of Experimental Psychology: General, 128, 3–31. doi: 10.1037/0096-3445.128.1.3 First citation in articleCrossrefGoogle Scholar

  • Jahn, G. & Braatz, J. (2014). Memory indexing of sequential symptom processing in diagnostic reasoning. Cognitive Psychology, 68, 59–97. doi: 10.1016/j.cogpsych.2013.11.002 First citation in articleCrossref MedlineGoogle Scholar

  • Jarosz, A. F. & Wiley, J. (2014). What are the odds? A practical guide to computing and reporting Bayes factors. The Journal of Problem Solving, 7, 2–9. doi: 10.7771/1932-6246.1167 First citation in articleCrossrefGoogle Scholar

  • Johnson, J. G. & Raab, M. (2003). Take the first: Option-generation and resulting choices. Organizational Behavior and Human Decision Processes, 91, 215–229. doi: 10.1016/S0749-5978(03)00027-X First citation in articleCrossrefGoogle Scholar

  • Johnson, T. & Krems, J. F. (2001). Use of current explanations in multicausal abductive reasoning. Cognitive Science, 25, 903–939. doi: 10.1207/s15516709cog2506_2 First citation in articleCrossrefGoogle Scholar

  • Jonas, E., Schulz-Hardt, S., Frey, D. & Thelen, N. (2001). Confirmation bias in sequential information search after preliminary decisions: An expansion of dissonance theoretical research on selective exposure to information. Journal of Personality and Social Psychology, 80, 557–571. doi: 10.1037/0022-3514.80.4.557 First citation in articleCrossref MedlineGoogle Scholar

  • Kintsch, W. (1998). Comprehension: A paradigm for cognition. Cambridge, UK: Cambridge University Press. First citation in articleGoogle Scholar

  • Klaczynski, P. A. (2000). Motivated scientific reasoning biases, epistemological beliefs, and theory polarization: A two-process approach to adolescent cognition. Child Development, 71, 1347–1366. doi: 10.1111/1467-8624.00232 First citation in articleCrossref MedlineGoogle Scholar

  • Klayman, J. & Ha, Y. W. (1987). Confirmation, disconfirmation, and information in hypothesis testing. Psychological Review, 94, 211–228. doi: 10.1037/0033-295X.94.2.211 First citation in articleCrossrefGoogle Scholar

  • Koehler, D. J., White, C. M. & Grondin, R. (2003). An evidential support accumulation model of subjective probability. Cognitive Psychology, 46, 152–197. doi: 10.1016/S0010-0285(02)00515-7 First citation in articleCrossref MedlineGoogle Scholar

  • Koriat, A., Lichtenstein, S. & Fischhoff, B. (1980). Reasons for confidence. Journal of Experimental Psychology: Human Learning and Memory, 6, 107–118. doi: 10.1037/0278-7393.6.2.107 First citation in articleCrossrefGoogle Scholar

  • Kostopoulou, O., Mousoulis, C. & Delaney, B. C. (2009). Information search and information distortion in the diagnosis of an ambiguous presentation. Judgment and Decision Making, 4, 408–418. First citation in articleGoogle Scholar

  • Kostopoulou, O., Russo, J. E., Keenan, G., Delaney, B. C. & Douiri, A. (2012). Information distortion in physicians’ diagnostic judgments. Medical Decision Making, 32, 831–839. doi: 10.1177/0272989X12447241 First citation in articleCrossref MedlineGoogle Scholar

  • Kunda, Z. & Thagard, P. (1996). Forming impressions from stereotypes, traits, and behaviors: A parallel constraint satisfaction theory. Psychological Review, 103, 284–308. doi: 10.1037/0033-295X.103.2.284 First citation in articleCrossrefGoogle Scholar

  • Lange, N. D., Thomas, R. P., Buttaccio, D. R., Illingworth, D. A. & Davelaar, E. J. (2013). Working memory dynamics bias the generation of beliefs: The influence of data presentation rate on hypothesis generation. Psychonomic Bulletin & Review, 20, 171–176. doi: 10.3758/s13423-012-0316-9 First citation in articleCrossref MedlineGoogle Scholar

  • Lange, N. D., Thomas, R. P. & Davelaar, E. J. (2012). Temporal dynamics of hypothesis generation: Influences of data serial order, data consistency, and elicitation timing. Frontiers in Psychology: Cognitive Science, 3, 215. doi: 10.3389/fpsyg.2012.00215 First citation in articleCrossrefGoogle Scholar

  • Lilienfeld, S. O., Ammirati, R. & Landfield, K. (2009). Giving debiasing away: Can psychological research on correcting cognitive errors promote human welfare? Perspectives on Psychological Science, 4, 390–398. doi: 10.1111/j.1745-6924.2009.01144.x First citation in articleCrossrefGoogle Scholar

  • Lord, C., Lepper, M. & Preston, E. (1984). Considering the opposite: A corrective strategy for social judgment. Journal of Personality and Social Psychology, 47, 1231–1243. doi: 10.1037/0022-3514.47.6.1231 First citation in articleCrossref MedlineGoogle Scholar

  • Love, J., Selker, R., Verhagen, A. J., Marsman, M., Gronau, Q. F., Jamil, T., … Wagenmakers, E.-J. (2015). JASP (Version 0.6) [Computer Software]. The JASP Project, Retrieved from https://jasp-stats.org/download First citation in articleGoogle Scholar

  • Maheswaran, D. & Chaiken, S. (1991). Promoting systematic processing in low-motivation settings: Effect of incongruent information on processing and judgment. Journal of Personality and Social Psychology, 61, 13–25. doi: 10.1037/0022-3514.61.1.13 First citation in articleCrossref MedlineGoogle Scholar

  • McKenzie, C. R. M. (1998). Taking into account the strength of an alternative hypothesis. Journal of Experimental Psychology: Learning, Memory, and Cognition, 24, 771–792. doi: 10.1037/0278-7393.24.3.771 First citation in articleCrossrefGoogle Scholar

  • Mehlhorn, K. & Jahn, G. (2009). Modeling sequential information integration with parallel constraint satisfaction. In N. A. TaatgenH. Van RijnEds., Proceedings of the 31st Annual Conference of the Cognitive Science Society (pp. 1391–1411). Austin, TX: Cognitive Science Society. First citation in articleGoogle Scholar

  • Mehlhorn, K., Taatgen, N. A., Lebiere, C. & Krems, J. F. (2011). Memory activation and the availability of explanations in sequential diagnostic reasoning. Journal of Experimental Psychology: Learning, Memory, and Cognition, 37, 1391–1411. doi: 10.1037/a0023920 First citation in articleCrossref MedlineGoogle Scholar

  • Morey, R. D., Romeijn, J.-W. & Rouder, J. N. (2015). The philosophy of Bayes factors and the quantification of statistical evidence, Manuscript submitted for publication. Retrieved from http://pcl.missouri.edu/sites/default/files/paper.pdf First citation in articleGoogle Scholar

  • Morey, R. D. & Rouder, J. N. (2014). BayesFactor 0.9.6, Comprehensive R Archive Network Retrieved from http://cran.r-project.org/web/packages/BayesFactor/index.html First citation in articleGoogle Scholar

  • Mumma, G. T. & Wilson, S. B. (1995). Procedural debiasing of primacy/anchoring effects in clinical-like judgments. Journal of Clinical Psychology, 51, 841–853. doi: 10.1002/1097-4679(199511)51:6%3C841::AID-JCLP2270510617%3E3.0.CO;2-K First citation in articleCrossref MedlineGoogle Scholar

  • Mussweiler, T. & Strack, F. (1999). Hypothesis-consistent testing and semantic priming in the anchoring paradigm: A selective accessibility model. Journal of Experimental Social Psychology, 35, 136–164. doi: 10.1006/jesp.1998.1364 First citation in articleCrossrefGoogle Scholar

  • Neuberg, S. L. & Fiske, S. T. (1987). Motivational influences on impression formation: Outcome dependency, accuracy-driven attention, and individuating processes. Journal of Personality and Social Psychology, 53, 431–444. doi: 10.1037/0022-3514.53.3.431 First citation in articleCrossref MedlineGoogle Scholar

  • Patel, V. L., Arocha, J. F. & Zhang, J. (2005). Thinking and reasoning in medicine. In K. J. HolyoakEd., Cambridge handbook of thinking and reasoning (pp. 727–750). Cambridge, UK: Cambridge University Press. First citation in articleGoogle Scholar

  • Peterson, C. R. & DuCharme, W. M. (1967). A primacy effect in subjective probability revision. Journal of Experimental Psychology, 73, 61–65. doi: 10.1037/h0024139 First citation in articleCrossref MedlineGoogle Scholar

  • Priester, J. R. & Petty, R. E. (1996). The gradual threshold model of ambivalence: Relating the positive and negative bases of attitudes to subjective ambivalence. Journal of Personality and Social Psychology, 71, 431–449. doi: 10.1037/0022-3514.71.3.431 First citation in articleCrossref MedlineGoogle Scholar

  • Rebitschek, F. G., Krems, J. F. & Jahn, G. (2015). Memory activation of multiple hypotheses in sequential diagnostic reasoning. Journal of Cognitive Psychology, 1–17. (ahead-of-print). First citation in articleGoogle Scholar

  • Russo, J. E., Carlson, K. A., Meloy, M. G. & Yong, K. (2008). The goal of consistency as a cause of information distortion. Journal of Experimental Psychology: General, 137, 456–470. doi: 10.1037/a0012786 First citation in articleCrossref MedlineGoogle Scholar

  • Russo, J. E., Medvec, V. H. & Meloy, M. G. (1996). The distortion of information during decisions. Organizational Behavior and Human Decision Processes, 66, 102–110. doi: 10.1006/obhd.1996.0041 First citation in articleCrossrefGoogle Scholar

  • Russo, J. E., Meloy, M. G. & Medvec, V. H. (1998). Predecisional distortion of product information. Journal of Marketing Research, 35, 438–452. doi: 10.2307/3152163 First citation in articleCrossrefGoogle Scholar

  • Shanteau, J. C. (1972). Descriptive versus normative models of sequential inference judgment. Journal of Experimental Psychology, 93, 63–83. doi: 10.1037/h0032509 First citation in articleCrossrefGoogle Scholar

  • Simon, D., Snow, C. J. & Read, S. J. (2004). The redux of cognitive consistency theories: Evidence judgments by constraint satisfaction. Journal of Personality and Social Psychology, 86, 814–837. doi: 10.1037/0022-3514.86.6.814 First citation in articleCrossref MedlineGoogle Scholar

  • Sprenger, A. & Dougherty, M. R. P. (2012). Generating and evaluating options for decision making: The impact of sequentially presented evidence. Journal of Experimental Psychology: Learning, Memory, and Cognition, 38, 550–575. doi: 10.1037/a0026036 First citation in articleCrossref MedlineGoogle Scholar

  • Thomas, R. P., Dougherty, M. R. P., Sprenger, A. & Harbison, J. I. (2008). Diagnostic hypothesis generation and human judgment. Psychological Review, 115, 155–185. doi: 10.1037/0033-295X.115.1.155 First citation in articleCrossref MedlineGoogle Scholar

  • Tulving, E. (2007). On the law of primacy. In M. A. GluckJ. R. AndersonS. M. KosslynEds., Memory and Mind: A Festschrift for Gordon H. Bower (pp. 31–48). Hillsdale, NJ: Erlbaum. First citation in articleGoogle Scholar

  • Tyszka, T. (1998). Two pairs of conflicting motives in decision making. Organizational Behavior and Human Decision Processes, 74, 189–211. doi: 10.1006/obhd.1998.2775 First citation in articleCrossref MedlineGoogle Scholar

  • Wang, H., Johnson, T. R. & Zhang, J. (2006). The order effect in human abductive reasoning: An empirical and computational study. Journal of Experimental and Theoretical Artificial Intelligence, 18, 215–247. doi: 10.1080/09528130600558141 First citation in articleCrossrefGoogle Scholar

  • Weber, E. U., Böckenholt, U., Hilton, D. J. & Wallace, B. (1993). Determinants of diagnostic hypothesis generation: Effects of information, base rates, and experience. Journal of Experimental Psychology: Learning, Memory, and Cognition, 19, 1151–1164. doi: 10.1037/0278-7393.19.5.1151 First citation in articleCrossref MedlineGoogle Scholar

  • Wyer, R. S. & Gordon, S. E. (1982). The recall of information about persons and groups. Journal of Experimental Social Psychology, 18, 128–164. doi: 10.1016/0022-1031(82)90047-6 First citation in articleCrossrefGoogle Scholar

  • Wyer, R. S. & Srull, T. K. (1986). Human cognition in its social context. Psychological Review, 93, 322–359. doi: 10.1037/0033-295X.93.3.322 First citation in articleCrossref MedlineGoogle Scholar

  • Wyer, R. S. & Srull, T. K. (1989). Memory and cognition in its social context. Hillsdale, NJ: Erlbaum. First citation in articleGoogle Scholar

  • Yates, J. F. & Curley, S. P. (1986). Contingency judgment: Primacy effects and attention decrement. Acta Psychologica, 62, 293–302. doi: 10.1016/0001-6918(86)90092-2 First citation in articleCrossref MedlineGoogle Scholar