Biased Processing of Ambiguous Symptoms Favors the Initially Leading Hypothesis in Sequential Diagnostic Reasoning
Abstract
Abstract. In sequential diagnostic reasoning, observed pieces of evidence activate hypotheses in memory and are integrated to reach a final diagnosis. The order of evidence can influence diagnostic reasoning. This article examines the processing of ambiguous evidence underlying order effects if multiple hypotheses are activated. In five experiments with a quasi-medical scenario, participants dealt with symptom sequences supporting multiple diagnoses. The symptom order, the response mode (end-of-sequence, step-by-step), and the consistency of evidence were manipulated. A primacy order effect occurred with both response modes suggesting that ambiguous pieces of evidence were distorted toward the hypothesis that strongly corresponded with the first piece. The primacy effect was partially counteracted by stepwise belief ratings, which strengthened the weight of recent evidence and promoted switching to an alternative diagnosis. We conclude that once hypotheses are generated, the interplay of coherence-oriented information distortion and memory-dependent analytic processes propagates into distinct order effects in diagnoses.
References
1986). Effects of explanation and counterexplanation on the development and use of social theories. Journal of Personality and Social Psychology, 50, 24–34. doi: 10.1037/0022-3514.50.1.24
(1981). Foundations of information integration theory. New York, NY: Academic Press.
(1963). Effects of concomitant verbal recall on order effects in personality impression formation. Journal of Verbal Learning and Behavior, 2, 379–391. doi: 10.1016/S0022-5371(63)80039-0
(1995).
(Construction-integration theory and clinical reasoning . In C. A. Weaver IIIS. MannesC. R. FletcherEds., Discourse comprehension: Essays in honor of Walter Kintsch (pp. 359–381). Hillsdale, NJ: Erlbaum.1946). Forming impressions of personality. The Journal of Abnormal and Social Psychology, 41, 258–290. doi: 10.1037/h0055756
(2009).
(Reasoning and problem solving: Models . In L. SquireEd., Encyclopedia of Neuroscience (Vol. 8, pp. 35–43). Oxford, UK: Academic Press.2010). Learning from examples does not prevent order effects in belief revision. Thinking & Reasoning, 16, 98–130. doi: 10.1080/13546783.2010.484211
(2007).
(The activation of hypotheses during abductive reasoning . In D. S. McNamaraJ. G. TraftonEds., Proceedings of the 29th Annual Cognitive Science Society (pp. 803–808). Austin, TX: Cognitive Science Society.1998). Clinical diagnosis and the order of information. Medical Decision Making, 18, 412–417. doi: 10.1177/0272989X9801800409
(1987). Social stereotypes and information-processing strategies: The impact of task complexity. Journal of Personality and Social Psychology, 52, 871–880. doi: 10.1037/0022-3514.52.5.871
(2007). Information distortion in the evaluation of a single option. Organizational Behavior and Human Decision Processes, 102, 240–254. doi: 10.1016/j.obhdp.2006.04.009
(2003). Biased predecision processing. Psychological Bulletin, 129, 545–568. doi: 10.1037/0033-2909.129.4.545
(1991). The computational complexity of abduction. Artificial Intelligence, 49, 25–60. doi: 10.1016/0004-3702(91)90005-5
(2006). Leader-driven primacy: Using attribute order to affect consumer choice. Journal of Consumer Research, 32, 513–518. doi: 10.1086/500481
(2004). Limiting predecisional distortion by prior valuation of attribute components. Organizational Behavior and Human Decision Processes, 94, 48–59. doi: 10.1016/j.obhdp.2004.02.001
(1996). Order of information affects clinical judgment. Journal of Behavioral Decision Making, 9, 201–211. doi: 10.1002/(SICI)1099-0771(199609)9:3<201::AID-BDM229>3.0.CO;2-J
(1993). The role of anomalous data in knowledge acquisition: A theoretical framework and implications for science instruction. Review of Educational Research, 63, 1–49. doi: 10.3102/00346543063001001
(2003). The importance of cognitive errors in diagnosis and strategies to minimize them. Academic Medicine, 78, 775–780. doi: 10.1097/00001888-200308000-00003
(1997). The effect of presentation order in clinical decision making. Academic Medicine, 72, S40–S42. doi: 10.1097/00001888-199710001-00014
(1988). Primacy effects in clinical judgments of contingency. Medical Decision Making, 8, 216–222. doi: 10.1177/0272989X8800800310
(2005). The demise of short-term memory revisited: Empirical and computational investigations of recency effects. Psychological Review, 112, 3–42. doi: 10.1037/0033-295X.112.1.3
(1979). Pseudodiagnosticity. Acta Psychologica, 43, 111–121. doi: 10.1016/0001-6918(79)90017-9
(2014). The effect of the way how knowledge is acquired on sequential diagnostic reasoning,
([Der Effekt der Form des Wissenserwerbs auf sequenzielles diagnostisches Schließen] (Unpublished diploma thesis, master’s level). University of Greifswald, Germany2013).
(A probabilistic constraint satisfaction model of information distortion in diagnostic reasoning . In M. KnauffM. PauenN. SebanzI. WachsmuthEds., Proceedings of the 35th Annual Conference of the Cognitive Science Society (pp. 531–536). Austin, TX: Cognitive Science Society.1979). Person memory: Personality traits as organizing principles in memory for behaviors. Journal of Personality and Social Psychology, 37, 25–38. doi: 10.1037/0022-3514.37.1.25
(1970). Effects of varying trait inconsistency and response requirements on the primacy effect in impression formation. Journal of Personality and Social Psychology, 15, 158–164. doi: 10.1037/h0029203
(1995). Multiple explanation: A consider-an-alternative strategy for debiasing judgments. Journal of Personality and Social Psychology, 69, 1069–1086. doi: 10.1037/0022-3514.69.6.1069
(1992). Order effects in belief updating: The belief-adjustment model. Cognitive Psychology, 24, 1–55. doi: 10.1016/0010-0285(92)90002-J
(1999). Bidirectional reasoning in decision making by constraint satisfaction. Journal of Experimental Psychology: General, 128, 3–31. doi: 10.1037/0096-3445.128.1.3
(2014). Memory indexing of sequential symptom processing in diagnostic reasoning. Cognitive Psychology, 68, 59–97. doi: 10.1016/j.cogpsych.2013.11.002
(2014). What are the odds? A practical guide to computing and reporting Bayes factors. The Journal of Problem Solving, 7, 2–9. doi: 10.7771/1932-6246.1167
(2003). Take the first: Option-generation and resulting choices. Organizational Behavior and Human Decision Processes, 91, 215–229. doi: 10.1016/S0749-5978(03)00027-X
(2001). Use of current explanations in multicausal abductive reasoning. Cognitive Science, 25, 903–939. doi: 10.1207/s15516709cog2506_2
(2001). Confirmation bias in sequential information search after preliminary decisions: An expansion of dissonance theoretical research on selective exposure to information. Journal of Personality and Social Psychology, 80, 557–571. doi: 10.1037/0022-3514.80.4.557
(1998). Comprehension: A paradigm for cognition. Cambridge, UK: Cambridge University Press.
(2000). Motivated scientific reasoning biases, epistemological beliefs, and theory polarization: A two-process approach to adolescent cognition. Child Development, 71, 1347–1366. doi: 10.1111/1467-8624.00232
(1987). Confirmation, disconfirmation, and information in hypothesis testing. Psychological Review, 94, 211–228. doi: 10.1037/0033-295X.94.2.211
(2003). An evidential support accumulation model of subjective probability. Cognitive Psychology, 46, 152–197. doi: 10.1016/S0010-0285(02)00515-7
(1980). Reasons for confidence. Journal of Experimental Psychology: Human Learning and Memory, 6, 107–118. doi: 10.1037/0278-7393.6.2.107
(2009). Information search and information distortion in the diagnosis of an ambiguous presentation. Judgment and Decision Making, 4, 408–418.
(2012). Information distortion in physicians’ diagnostic judgments. Medical Decision Making, 32, 831–839. doi: 10.1177/0272989X12447241
(1996). Forming impressions from stereotypes, traits, and behaviors: A parallel constraint satisfaction theory. Psychological Review, 103, 284–308. doi: 10.1037/0033-295X.103.2.284
(2013). Working memory dynamics bias the generation of beliefs: The influence of data presentation rate on hypothesis generation. Psychonomic Bulletin & Review, 20, 171–176. doi: 10.3758/s13423-012-0316-9
(2012). Temporal dynamics of hypothesis generation: Influences of data serial order, data consistency, and elicitation timing. Frontiers in Psychology: Cognitive Science, 3, 215. doi: 10.3389/fpsyg.2012.00215
(2009). Giving debiasing away: Can psychological research on correcting cognitive errors promote human welfare? Perspectives on Psychological Science, 4, 390–398. doi: 10.1111/j.1745-6924.2009.01144.x
(1984). Considering the opposite: A corrective strategy for social judgment. Journal of Personality and Social Psychology, 47, 1231–1243. doi: 10.1037/0022-3514.47.6.1231
(2015). JASP (Version 0.6) [Computer Software]. The JASP Project, Retrieved from https://jasp-stats.org/download
(1991). Promoting systematic processing in low-motivation settings: Effect of incongruent information on processing and judgment. Journal of Personality and Social Psychology, 61, 13–25. doi: 10.1037/0022-3514.61.1.13
(1998). Taking into account the strength of an alternative hypothesis. Journal of Experimental Psychology: Learning, Memory, and Cognition, 24, 771–792. doi: 10.1037/0278-7393.24.3.771
(2009).
(Modeling sequential information integration with parallel constraint satisfaction . In N. A. TaatgenH. Van RijnEds., Proceedings of the 31st Annual Conference of the Cognitive Science Society (pp. 1391–1411). Austin, TX: Cognitive Science Society.2011). Memory activation and the availability of explanations in sequential diagnostic reasoning. Journal of Experimental Psychology: Learning, Memory, and Cognition, 37, 1391–1411. doi: 10.1037/a0023920
(2015). The philosophy of Bayes factors and the quantification of statistical evidence, Manuscript submitted for publication. Retrieved from http://pcl.missouri.edu/sites/default/files/paper.pdf
(2014). BayesFactor 0.9.6, Comprehensive R Archive Network Retrieved from http://cran.r-project.org/web/packages/BayesFactor/index.html
(1995). Procedural debiasing of primacy/anchoring effects in clinical-like judgments. Journal of Clinical Psychology, 51, 841–853. doi: 10.1002/1097-4679(199511)51:6%3C841::AID-JCLP2270510617%3E3.0.CO;2-K
(1999). Hypothesis-consistent testing and semantic priming in the anchoring paradigm: A selective accessibility model. Journal of Experimental Social Psychology, 35, 136–164. doi: 10.1006/jesp.1998.1364
(1987). Motivational influences on impression formation: Outcome dependency, accuracy-driven attention, and individuating processes. Journal of Personality and Social Psychology, 53, 431–444. doi: 10.1037/0022-3514.53.3.431
(2005).
(Thinking and reasoning in medicine . In K. J. HolyoakEd., Cambridge handbook of thinking and reasoning (pp. 727–750). Cambridge, UK: Cambridge University Press.1967). A primacy effect in subjective probability revision. Journal of Experimental Psychology, 73, 61–65. doi: 10.1037/h0024139
(1996). The gradual threshold model of ambivalence: Relating the positive and negative bases of attitudes to subjective ambivalence. Journal of Personality and Social Psychology, 71, 431–449. doi: 10.1037/0022-3514.71.3.431
(2015). Memory activation of multiple hypotheses in sequential diagnostic reasoning. Journal of Cognitive Psychology, 1–17. (ahead-of-print).
(2008). The goal of consistency as a cause of information distortion. Journal of Experimental Psychology: General, 137, 456–470. doi: 10.1037/a0012786
(1996). The distortion of information during decisions. Organizational Behavior and Human Decision Processes, 66, 102–110. doi: 10.1006/obhd.1996.0041
(1998). Predecisional distortion of product information. Journal of Marketing Research, 35, 438–452. doi: 10.2307/3152163
(1972). Descriptive versus normative models of sequential inference judgment. Journal of Experimental Psychology, 93, 63–83. doi: 10.1037/h0032509
(2004). The redux of cognitive consistency theories: Evidence judgments by constraint satisfaction. Journal of Personality and Social Psychology, 86, 814–837. doi: 10.1037/0022-3514.86.6.814
(2012). Generating and evaluating options for decision making: The impact of sequentially presented evidence. Journal of Experimental Psychology: Learning, Memory, and Cognition, 38, 550–575. doi: 10.1037/a0026036
(2008). Diagnostic hypothesis generation and human judgment. Psychological Review, 115, 155–185. doi: 10.1037/0033-295X.115.1.155
(2007).
(On the law of primacy . In M. A. GluckJ. R. AndersonS. M. KosslynEds., Memory and Mind: A Festschrift for Gordon H. Bower (pp. 31–48). Hillsdale, NJ: Erlbaum.1998). Two pairs of conflicting motives in decision making. Organizational Behavior and Human Decision Processes, 74, 189–211. doi: 10.1006/obhd.1998.2775
(2006). The order effect in human abductive reasoning: An empirical and computational study. Journal of Experimental and Theoretical Artificial Intelligence, 18, 215–247. doi: 10.1080/09528130600558141
(1993). Determinants of diagnostic hypothesis generation: Effects of information, base rates, and experience. Journal of Experimental Psychology: Learning, Memory, and Cognition, 19, 1151–1164. doi: 10.1037/0278-7393.19.5.1151
(1982). The recall of information about persons and groups. Journal of Experimental Social Psychology, 18, 128–164. doi: 10.1016/0022-1031(82)90047-6
(1986). Human cognition in its social context. Psychological Review, 93, 322–359. doi: 10.1037/0033-295X.93.3.322
(1989). Memory and cognition in its social context. Hillsdale, NJ: Erlbaum.
(1986). Contingency judgment: Primacy effects and attention decrement. Acta Psychologica, 62, 293–302. doi: 10.1016/0001-6918(86)90092-2
(