Change Detection in Visual Short-Term Memory
The Relative Impact of Pairwise Switches and Identity Substitutions
Abstract
Abstract. Numerous kinds of visual event challenge our ability to keep track of the objects that populate our visual environment from moment to moment. These include blinks, occlusion, shifting visual attention, and changes to object’s visual and spatial properties over time. These visual events may lead to objects falling out of our visual awareness, but can also lead to unnoticed changes, such as undetected object replacements and positional exchanges. Current visual memory models do not predict which visual changes are likely to be the most difficult to detect. We examine the accuracy with which switches (where two objects exchange locations) and substitutions (where one or two objects are replaced) are detected. Inferior performance for one-object substitutions versus two-objects switches, along with superior performance for two-object substitutions versus two-object switches was found. Our results are interpreted in terms of object file theory, trade-offs between diffused and localized attention, and net visual change.
References
(2004). The capacity of visual short-term memory is set both by visual information load and by number of objects. Psychological Science, 15, 106–111. doi: 10.1111/j.0963-7214.2004.01502006.x
(1986). Working memory. Oxford, UK: Oxford University Press.
(1997). The psychophysics toolbox. Spatial Vision, 10, 433–436. doi: 10.1163/156856897X00357
(2005). The anatomy of object processing: The role of antero-medial temporal cortex. The Quarterly Journal of Experimental Psychology, 58, 361–377. doi: 10.1080/02724990544000013
(2001). The magical number 4 in short-term memory: A reconsideration of mental storage capacity. Behavioral and Brain Sciences, 24, 87–114. doi: 10.1017/S0140525X01003922
(1963). Visual resolution and contour interaction. Journal of the Optical Society of America, 53, 1026–1032. doi: 10.1364/JOSA.53.001026
(2003). Failures of retrieval and comparison constrain change detection in natural scenes. Journal of Experimental Psychology: Human Perception and Performance, 29, 388–403. doi: 10.1037/0096-1523.29.2.388
(2006). Scene and position specificity in visual memory for objects. Journal of Experimental Psychology: Learning, Memory, and Cognition, 32, 58–69. doi: 10.1037/0278-7393.32.1.58
(2007). Object-position binding in visual memory for natural scenes and object arrays. Journal of Experimental Psychology: Human Perception and Performance, 33, 31–47. doi: 10.1037/0096-1523.33.1.31
(2002). Accurate visual memory for previously attended objects in natural scenes. Journal of Experimental Psychology: Human Perception and Performance, 28, 113–136. doi: 10.1037/0096-1523.28.1.113
(1991). Information integration across saccadic eye movements. Cognitive Psychology, 23, 420–456. doi: 10.1016/0010-0285(91)90015-G
(1996).
Integration and accumulation of information across saccadic eye movements . In T. InuiJ. L. McClellandEds., Attention and performance XVI: Information integration in perception and communication (pp. 125–155). Cambridge, MA: MIT Press.(2002). Eye movements and scene perception: Memory for things observed. Perception & Psychophysics, 64, 882–895. doi: 10.3758/BF03196793
(1988). Uniqueness of abrupt visual onset in capturing attention. Perception & Psychophysics, 43, 346–354. doi: 10.3758/BF03208805
(1992). The reviewing of object files: Object specific integration of information. Cognitive Psychology, 24, 175–219. doi: 10.1016/0010-0285(92)90007-O
(2002). Memory for centrally attended changing objects in an incidental real-world change detection paradigm. British Journal of Psychology, 93, 289–302. doi: 10.1348/000712602760146224
(1997). Capacity of visual working memory for features and conjunctions. Nature, 390, 279–281. doi: 10.1038/36846
(2005). Capacity limits of information processing in the brain. Trends in Cognitive Sciences, 6, 296–305. doi: 10.1016/j.tics.2005.04.010
(2005). Visual memory needs categories. Proceedings of the National Academy of Sciences, 102, 8776–8780. doi: 10.1073/pnas.0500810102
(1988). Familiarity and visual change detection. Perception & Psychophysics, 44, 369–378. doi: 10.3758/BF03210419
(1997). The VideoToolbox software for visual psychophysics: Transforming numbers into movies. Spatial Vision, 10, 437–442. doi: 10.1163/156856897X00366
(1974). On the distinction between sensory storage and short-term visual memory. Perception & Psychophysics, 16, 283–290. doi: 10.3758/BF03203943
(1993). Lateral interactions between spatial channels: Suppression and facilitation revealed by lateral masking experiments. Vision Research, 33, 993–999. doi: 10.1016/0042-6989(93)90081-7
(1996). Change detection. Annual Review of Psychology, 53, 245–277. doi: 10.1146/annurev.psych.53.100901.135125
(2000). Seeing, sensing and scrutinizing. Vision Research, 40, 1469–1487. doi: 10.1016/S0042-6989(00)00003-1
(2011). Object-position binding in visual short-term memory for sequentially presented unfamiliar stimuli. Perception, 40, 538–548. doi: 10.1068/p6899
(1996). In sight, out of mind: When object representations fail. Psychological Science, 7, 301–305. doi: 10.1111/j.1467-9280.1996.tb00378.x
(1980). A standardised set of 260 pictures: Norms for name agreement, image agreement, familiarity, and visual complexity. Journal of Experimental Psychology: Human Learning and Memory, 6, 174–215. doi: 10.1037/0278-7393.6.2.174
(1999). Calculation of signal detection theory measures. Behavior Research Methods, Instruments, & Computers, 31, 137–149. doi: 10.3758/BF03207704
(2004). Capacity limit of visual short-term memory in human posterior parietal cortex. Nature, 428, 751–754. doi: 10.1038/nature02466
(2002). Binding in short-term visual memory. Journal of Experimental Psychology: General, 131, 48–64. doi: 10.1037/0096-3445.131.1.48
(2004). A detection theory account of change detection. Journal of Vision, 4, 1120–1135. doi: 10.1167/4.12.11
(2006). Why don’t we see changes? The role of attentional bottlenecks and limited visual memory. Visual Cognition, 14, 749–780. doi: 10.1080/13506280500195292
