Listening to the Picture-Superiority Effect
Evidence for the Conceptual-Distinctiveness Account of Picture Superiority in Recognition
Abstract
Abstract. The picture-superiority effect (PSE) refers to the finding that, all else being equal, pictures are remembered better than words (Paivio & Csapo, 1973). Dual-coding theory (DCT; Paivio, 1991) is often used to explain the PSE. According to DCT, pictures are more likely to be encoded imaginally and verbally than words. In contrast, distinctiveness accounts attribute the PSE to pictures’ greater distinctiveness compared to words. Some distinctiveness accounts emphasize physical distinctiveness (Mintzer & Snodgrass, 1999) while others emphasize conceptual distinctiveness (Hamilton & Geraci, 2006). We attempt to distinguish among these accounts by testing for an auditory analog of picture superiority. Although this phenomenon, termed the auditory PSE, occurs in free recall (Crutcher & Beer, 2011), we were unable to extend it to recognition across four experiments. We propose a new framework for understanding the PSE, wherein dual coding underpins the free-recall PSE, but conceptual distinctiveness underpins the recognition PSE.
References
(2012). Using pictures and words to understand recognition memory deterioration in amnestic mild cognitive impairment and Alzheimer’s disease: A review. Current Neurology and Neuroscience Reports, 12, 687–694. https://doi.org/10.1007/s11910-012-0310-7
(2009). The picture superiority effect in patients with Alzheimer’s disease and mild cognitive impairment. Neuropsychologia, 47, 595–598. https://doi.org/10.1016/j.neuropsychologia.2008.10.010
(1996). Effects of visual and verbal interference tasks on olfactory memory: The role of task complexity. British Journal of Psychology, 87, 447–460. https://doi.org/10.1111/j.2044-8295.1996.tb02601.x
(1975). Word length and the structure of short-term memory. Journal of Verbal Learning & Verbal Behavior, 14, 575–589. https://doi.org/10.1016/S0022-5371(75)80045-4
(2013). The longer we have to forget the more remember: The ironic effect of postcue duration in item-based directed forgetting. Journal of Experimental Psychology: Learning, Memory, and Cognition, 39, 691–699. https://doi.org/10.1037/a0029523
(1977). Remembering environmental sounds: The role of verbalization at input. Memory & Cognition, 5, 404–414. https://doi.org/10.3758/BF03197379
(1998).
Directed forgetting: A contrast of methods and interpretations . In J. M. GoldingC. M. MacLeodEds., Intentional forgetting: Interdisciplinary approaches (pp. 139–172). Mahwah, NJ: Erlbaum.(1993). Directed forgetting in implicit and explicit memory tests: A comparison of methods. Journal of Experimental Psychology: Learning, Memory, and Cognition, 19, 603–616. https://doi.org/10.1037/0278-7393.19.3.603
(2018). Generating lies produces lower memory predictions and higher memory performance than telling the truth: Evidence for a metacognitive illusion. Journal of Experimental Psychology: Learning, Memory, and Cognition, 44, 465–484. https://doi.org/10.1037/xlm0000459
(2009). Response bias for picture recognition in patients with Alzheimer’s disease. Cognitive and Behavioral Neurology, 22, 229–235. https://doi.org/10.1097/WNN.0b013e3181b7f3b1
(1972).
Theoretical implications of directed forgetting . In A. W. MeltonE. MartinEds., Coding processes in human memory (pp. 217–235). Washington, DC: Winston.(1998).
Intentional forgetting in perspective: Comments, conjectures, and some directed remembering . In J. M. GoldingC. M. MacLeodEds., Intentional forgetting: Interdisciplinary approaches (pp. 453–481). Hillsdale, NJ: Erlbaum.(1968). The modification of short-term memory through instructions to forget. Psychonomic Science, 10, 55–56. https://doi.org/10.3758/BF03331404
(1989). Investigating dissociations among memory measures: Support for a transfer-appropriate processing framework. Journal of Experimental Psychology: Learning, Memory, and Cognition, 15, 657–668. https://doi.org/10.1037/0278-7393.15.4.657
(2007). Reversing the picture superiority effect: A speed-accuracy trade-off study of recognition memory. Memory & Cognition, 35, 113–123. https://doi.org/10.3758/BF03195948
(1977). Recall and recognition of words and pictures by adults and children. Bulletin of the Psychonomic Society, 9, 113–114. https://doi.org/10.3758/BF03336946
(1957). The effects of concomitant colored and uncolored pictorial representations on the learning of stimulus words. Journal of Applied Psychology, 41, 165–168. https://doi.org/10.1037/h0047473
(1973). Encoding and recognition memory for naturalistic sounds. Journal of Experimental Psychology, 101, 360–366. https://doi.org/10.1037/h0035240
(2008). Visual long-term memory has a massive storage capacity for object details. Proceedings of the National Academy of Sciences of the United States of America, 105, 14325–14329. https://doi.org/10.1073/pnas.0803390105
(1974). Encoding of auditory stimuli in recognition memory tasks. Bulletin of the Psychonomic Society, 3, 177–178. https://doi.org/10.3758/BF03333434
(1979). Report on blind subjects’ tactile and auditory recognition for environmental stimuli. Perceptual and Motor Skills, 48, 363–366. https://doi.org/10.2466/pms.1979.48.2.363
(1992). A power primer. Psychological Bulletin, 112, 155–159. https://doi.org/10.1037/0033-2909.112.1.155
(2009). Auditory recognition memory is inferior to visual recognition memory. Proceedings of the National Academy of Sciences of the United States of America, 106, 6008–6010. https://doi.org/10.1073/pnas.0811884106
(1972). Levels of processing: A framework for memory research. Journal of Verbal Learning & Verbal Behavior, 11, 671–684. https://doi.org/10.1016/S0022-5371(72)80001-X
(2011). An auditory analog of the picture superiority effect. Memory & Cognition, 39, 63–74. https://doi.org/10.3758/s13421-010-0015-6
(2011). Picture superiority doubly dissociates the ERP correlates of recollection and familiarity. Journal of Cognitive Neuroscience, 23, 1247–1262. https://doi.org/10.1037/t10652-000
(1977). Memory for pictures and words as a function of level of processing: Depth or dual coding? Memory & Cognition, 5, 252–256. https://doi.org/10.3758/BF03197370
(2015). Preserved conceptual implicit memory for pictures in patients with Alzheimer’s disease. Brain and Cognition, 99, 112–117. https://doi.org/10.1016/j.bandc.2015.07.008
(2017). The use of metacognitive strategies to decrease false memories in source monitoring in patients with mild cognitive impairment. Cortex, 91, 287–296. https://doi.org/10.1016/j.cortex.2017.01.022
(2017). The effect of lexical factors on recall from working memory: Generalizing the neighborhood size effect. Canadian Journal of Experimental Psychology, 71, 23–31. https://doi.org/10.1037/cep0000098
(1994). Pictures, images, and recollective experience. Journal of Experimental Psychology: Learning, Memory, and Cognition, 20, 1088–1098. https://doi.org/10.1037/0278-7393.20.5.1088
(1983). Naming and remembering proper and common nouns and pictures. Journal of Experimental Psychology: Learning, Memory, and Cognition, 9, 497–510. https://doi.org/10.1037/0278-7393.9.3.497
(2000). Adult age differences in memory for verbs and nouns. Aging, Neuropsychology, and Cognition, 7, 130–139. https://doi.org/10.1076/1382-5585(200006)7:2;1-U;FT130
(2017). Why are verbs so hard to remember? Effects of semantic context on memory for verbs and nouns. Cognitive Science, 41, 780–807. https://doi.org/10.1111/cogs.12374
(1973). Long-term memory of odors with and without verbal descriptions. Journal of Experimental Psychology, 100, 221–227. https://doi.org/10.1037/h0035492
(2019). Increasing word distinctiveness eliminates the picture superiority effect in recognition: Evidence for the physical-distinctiveness account. Memory & Cognition, 47, 182–193. https://doi.org/10.3758/s13421-018-0858-9
(2012). Interplay of the production and picture superiority effects: A signal detection analysis. Memory, 20, 655–666. https://doi.org/10.1080/09658211.2012.693510
(2008). Presentation format effects in a levels-of-processing task. Experimental Psychology, 55, 215–227. https://doi.org/10.1027/1618-3169.55.4.215
(1969). Why is naming longer than reading? Acta Psychologica, 30, 96–103. https://doi.org/10.1016/0001-6918(69)90043-2
(2011). Odor recognition memory as a function of odor-naming performance. Chemical Senses, 36, 29–41. https://doi.org/10.1093/chemse/bjq095
(1982). The Toronto Word Pool: Norms for imagery, concreteness, orthographic variables, and grammatical usage for 1,080 words. Behavior Research Methods & Instrumentation, 14, 375–399. https://doi.org/10.3758/BF03203275
(1976). Recognition memory for words and pictures at short and long retention intervals. Memory & Cognition, 4, 256–260. https://doi.org/10.3758/BF03213172
(1984). A retrieval model for both recognition and recall. Psychological Review, 91, 1–67. https://doi.org/10.1037/0033-295X.91.1.1
(1985). The mirror effect in recognition memory. Memory & Cognition, 13, 8–20. https://doi.org/10.3758/BF03198438
(2017). Experience and information loss in auditory and visual memory. The Quarterly Journal of Experimental Psychology, 70, 1344–1352. https://doi.org/10.1080/17470218.2016.1183686
(1961). Recognition memory for nouns as a function of abstractness and frequency. Journal of Experimental Psychology, 61, 23–29. https://doi.org/10.1037/h0040561
(2004). Recognition memory for pseudowords. Journal of Memory and Language, 53, 259–267. https://doi.org/10.1016/j.jml.2003.12.001
(1976). Predicting recognition during storage: The capacity of the memory system to evaluate itself. Bulletin of the Psychonomic Society, 7, 425–428. https://doi.org/10.3758/BF03337236
(2006). The picture superiority effect in conceptual implicit memory: A conceptual distinctiveness hypothesis. American Journal of Psychology, 119, 1–20. https://doi.org/10.2307/20445315
(1984). MINERVA 2: A simulation model of human memory. Behavior Research Methods, Instruments & Computers, 16, 96–101. https://doi.org/10.3758/BF03202365
(2008). The picture superiority effect in associative recognition. Memory & Cognition, 36, 1351–1359. https://doi.org/10.3758/MC.36.7.1351
(2011). Extensions of the picture superiority effect in associative recognition. Canadian Journal of Experimental Psychology, 65, 236–244. https://doi.org/10.1037/a0023796
(1996). Effect of modality in earwitness identification: Memory for verbal and nonverbal auditory stimuli presented in two contexts. Journal of General Psychology, 123, 277–287. https://doi.org/10.1080/00221309.1996.9921280
(1961). Theory of probability (3rd ed.). Oxford, UK: Oxford University Press.
(1967). Differential memory for picture and word stimuli. Journal of Educational Psychology, 58, 303–307. https://doi.org/10.1037/h0025025
(1996). Cognitive components of picture naming. Psychological Bulletin, 120, 113–139. https://doi.org/10.1037/0033-2909.120.1.113
(1994). Processes of successful intentional forgetting. Psychological Bulletin, 116, 274–292. https://doi.org/10.1037/0033-2909.116.2.274
(1995). Bayes factors. Journal of the American Statistical Association, 90, 773–795. https://doi.org/10.1080/01621459.1995.10476572
(2004). Semantic context influences memory for verbs more than memory for nouns. Memory & Cognition, 32, 198–211. https://doi.org/10.3758/BF03196852
(1975). Recognition memory for odors. Chemical Senses & Flavor, 1, 331–337. https://doi.org/10.1093/chemse/1.3.331
(1973). Accuracy of recognition memory for common sounds. Bulletin of the Psychonomic Society, 1, 298–300. https://doi.org/10.3758/BF03334350
(1979). Comparison of accuracy in auditory and tactile recognition memory for environmental stimuli. Perceptual and Motor Skills, 48, 63–66. https://doi.org/10.2466/pms.1979.48.1.63
(2007). Effects of post-cue interval on intentional forgetting. British Journal of Psychology, 98, 257–272. https://doi.org/10.1348/000712606X120410
(1986). Effects of encoding strategy on long-term memory for odours. Quarterly Journal of Experimental Psychology, 38, 753–765. https://doi.org/10.1080/14640748608401624
(1990). Memory for odors and odor names: Modalities of elaboration and imagery. Journal of Experimental Psychology: Learning, Memory, and Cognition, 16, 656–664. https://doi.org/10.1037/0278-7393.16.4.656
(1998).
Directed forgetting . In J. M. GoldingC. M. MacLeodEds., Intentional forgetting: Interdisciplinary approaches (pp. 1–57). Mahwah, NJ: Erlbaum.Madacy Music Group Inc . (1994). Fun! with sound effects (Vol. II), [CD]. Quebec, Canada: St. Laurent.Madacy Special Products . (2005). 1000 sound effects. Quebec, Canada: St. Laurent.(2005). The “one-shot” hypothesis for context storage. Journal of Experimental Psychology: Learning, Memory, and Cognition, 31, 322–336. https://doi.org/10.1037/0278-7393.31.2.322
(2002). A comparison of conscious and automatic memory processes for picture and word stimuli: A process dissociation analysis. Consciousness and Cognition, 11, 423–460. https://doi.org/10.1016/S1053-8100(02)00007-7
(1998). Familiarity breeds differentiation: A subjective-likelihood approach to the effects of experience in recognition memory. Psychological Review, 105, 724–760. https://doi.org/10.1037/0033-295X.105.4.734-760
(1971). Recognition memory for common sounds. Psychonomic Science, 23, 307–308. https://doi.org/10.3758/BF03336124
(1999). The picture superiority effect: Support for the distinctiveness model. American Journal of Psychology, 112, 113–146. https://doi.org/10.2307/1423627
(2016). The philosophy of Bayes factors and the quantification of statistical evidence. Journal of Mathematical Psychology, 72, 6–18. https://doi.org/10.1016/j.jmp.2015.11.001
(1974). Imagery in recognition. British Journal of Psychology, 65, 7–12. https://doi.org/10.1111/j.2044-8295.1974.tb02765.x
(1965). Erasure or partitioning in short-term memory. Psychonomic Science, 3, 429–430. https://doi.org/10.3758/BF03343215
(1979).
Remembering pictures and words: Appearance, significance, and name . In L. S. CermakF. I. M. CraikEds., Levels of processing in human memory (pp. 45–76). Hillsdale, NJ: Erlbaum.(1976). On the nature of pictorial encoding: A levels-of-processing analysis. Journal of Experimental Psychology: Human Learning and Memory, 2, 49–57. https://doi.org/10.1037/0278-7393.2.1.49
(1977). Learning to order pictures and words: A model of sensory and semantic encoding. Journal of Experimental Psychology: Human Learning and Memory, 3, 485–497. https://doi.org/10.1037/0278-7393.3.5.485
(1976). Pictorial superiority effect. Journal of Experimental Psychology: Human Learning and Memory, 2, 523–528. https://doi.org/10.1037/0278-7393.2.5.523
(1965). Short-term memory for complex meaningful visual configurations: A demonstration of capacity. Canadian Journal of Psychology, 19, 155–160. https://doi.org/10.1037/h0082899
(1968). A note on long-term recognition memory for pictorial material. Psychonomic Science, 11, 58. https://doi.org/10.3758/BF03330991
(2003). Generalized eta and omega squared statistics: Measures of effect size for some common research designs. Psychological Methods, 8, 434–447. https://doi.org/10.1037/1082-989X.8.4.434
(1971). Imagery and verbal processes. New York, NY: Holt, Rinehart & Winston.
(1975).
Coding distinctions and repetition effects in memory . In G. H. BowerEd., The psychology of learning and motivation (vol. 9, pp. 179–214) https://doi.org/10.1016/S0079-7421(08)60271-6. New York, NY: Academic Press(1976).
Imagery in recall and recognition . In J. BrownEd., recall and recognition (pp. 103–129). New York, NY: Wiley.(1991). Dual coding theory: Retrospect and current status. Canadian Journal of Psychology, 45, 255–287. https://doi.org/ 10.1037/h0084295
(2007). Mind and its evolution: A dual coding theoretical approach. Mahwah, NJ: Erlbaum.
(1969). Concrete image and verbal memory codes. Journal of Experimental Psychology, 80, 279–285. https://doi.org/10.1037/h0027273
(1973). Picture superiority in free recall: Imagery or dual coding? Cognitive Psychology, 5, 176–206. https://doi.org/ 10.1016/0010-0285(73)90032-7
(1975). Free and serial recall of pictures, sounds, and words. Memory & Cognition, 3, 586–590. https://doi.org/10.3758/BF03198221
(1968). Why are pictures easier to recall than words? Psychonomic Science, 11, 137–138. https://doi.org/10.3758/BF03331011
(1990). Recognition and recall of odours: The effects of suppressing visual and verbal encoding processes. British Journal of Psychology, 81, 221–226. https://doi.org/10.1111/j.2044-8295.1990.tb02357.x
(1971). Sequential and nonsequential memory for verbal and nonverbal auditory stimuli. Journal of Experimental Psychology, 91, 341–343. https://doi.org/10.1037/h0031845
(1975). Time to understand pictures and words. Nature, 253, 437–438. https://doi.org/10.1038/253437a0
(2010). Directed forgetting: Comparing pictures and words. Canadian Journal of Experimental Psychology, 64, 41–46. https://doi.org/10.1037/a0016569
. (2017). R: A language and environment for statistical computing. R Foundation for Statistical Computing: Vienna, Austria.
(1980).
SAM: A theory of probabilistic search in associative memory . In G. H. BowerEd., The psychology of learning and motivation: Advances in research and theory (Vol. 14, pp. 207–262). New York, NY: Academic Press.(1981). Search of associative memory. Psychological Review, 88, 93–134. https://doi.org/10.1037/0033-295X.88.2.93
(1984). Odor recognition: Familiarity, identifiability, and encoding consistency. Journal of Experimental Psychology: Learning, Memory, and Cognition, 10, 316–325. https://doi.org/10.1037/0278-7393.10.2.316
(1995).
Bayesian model selection in social research . In P. V. MarsdenEd., Sociological methodology 1995 (pp. 111–196). Cambridge, UK: Blackwell.(1996). Perceptual effects on remembering: Recollective processes in picture recognition memory. Journal of Experimental Psychology: Learning, Memory, and Cognition, 22, 365–377. https://doi.org/10.1037/0278-7393.22.2.365
(2000). A mechanistic account of the mirror effect for word frequency: A computational model of remember-know judgments in a continuous recognition paradigm. Journal of Experimental Psychology: Learning, Memory, and Cognition, 26, 294–320. https://doi.org/10.1037/0278-7393.26.2.294
(2008). Memory predictions are influenced by perceptual information: Evidence for metacognitive illusions. Journal of Experimental Psychology: General, 137, 615–625. https://doi.org/10.1037/a0013684
(2009). Metacognitive illusions for auditory information: Effects on monitoring and control. Psychonomic Bulletin & Review, 16, 550–554. https://doi.org/10.3758/PBR.16.3.550
(2012). Why does picture naming take longer than word reading? The contribution of articulatory processes. Psychonomic Bulletin & Review, 19, 955–961. https://doi.org/10.3758/s13423-012-0287-x
(2003). Memory for environmental sounds in sighted, congenitally blind and late blind adults: Evidence for cross-modal compensation. International Journal of Psychophysiology, 50, 27–39. https://doi.org/10.1016/S0167-8760(03)00122-3
(2013). Default Bayes factors for model selection in regression. Multivariate Behavioral Research, 47, 877–903. https://doi.org/10.1080/00273171.2012.734737
(2012). Default Bayes factors for ANOVA designs. Journal of Mathematical Psychology, 56, 356–374. https://doi.org/10.1016/j.jmp. 2012.08.001
(2009). Bayesian t tests for accepting and rejecting the null hypothesis. Psychonomic Bulletin & Review, 16, 225–237. https://doi.org/10.3758/PBR.16.2.225
(1974). Ordered recall of sounds and words in short-term memory. Bulletin of the Psychonomic Society, 4, 559–561. https://doi.org/10.3758/BF03334290
(1977). Retention of order information for sounds and words. Canadian Journal of Psychology, 31, 14–23. https://doi.org/10.1037/h0081645
(1973). Negative effects of using list items as recall cues. Journal of Verbal Learning & Verbal Behavior, 12, 43–50. https://doi.org/10.1016/S0022-5371(73)80059-3
(1976). Depth of processing in recall and recognition memory: Differential effects of stimulus meaningfulness and serial position. Journal of Experimental Psychology: Human Learning and Memory, 2, 680–687. https://doi.org/10.1037/0278-7393.2.6.680
(1967). Recognition memory for words, sentences, and pictures. Journal of Verbal Learning & Verbal Behavior, 6, 156–163. https://doi.org/10.1016/S0022-5371(67)80067-7
(1997). A model for recognition memory: REM – retrieving effectively from memory. Psychonomic Bulletin & Review, 4, 145–166. https://doi.org/10.3758/BF03209391
(1977). The pictorial superiority effect in recognition memory. Bulletin of the Psychonomic Society, 10, 1–4. https://doi.org/10.3758/BF03333530
(1978). The effect of repeated tests on recognition memory for pictures and words. Bulletin of the Psychonomic Society, 11, 263–266. https://doi.org/10.3758/BF03336826
(1972). Recognition memory for words, pictures, and words + pictures. Psychonomic Science, 27, 345–347. https://doi.org/10.3758/BF03328986
(1974). On the fate of visual and verbal memory codes for pictures and words: Evidence for a dual coding mechanism in recognition memory. Journal of Verbal Learning & Verbal Behavior, 13, 27–37. https://doi.org/10.1016/S0022-5371(74)80027-7
(1973). Learning 10,000 pictures. The Quarterly Journal of Experimental Psychology, 25, 207–222. https://doi.org/10.1080/14640747308400340
(1970). Perception and memory for pictures: Single-trial learning of 2500 visual stimuli. Psychonomic Science, 19, 73–74. https://doi.org/10.3758/BF03337426
(2006). Conceptual and perceptual factors in the picture superiority effect. European Journal of Cognitive Psychology, 18, 813–847. https://doi.org/10.1080/09541440500412361
(1995). The picture superiority effect in a cross-modality recognition task. Memory & Cognition, 23, 425–441. https://doi.org/10.3758/BF03197244
(1989). Theoretical analysis of the cognitive processing of lexical and pictorial stimuli: Reading, naming, and visual and conceptual comparisons. Psychological Review, 96, 5–24. https://doi.org/10.1037/0033-295X.96.1.5
(1944). The teacher’s word book of 30,000 words. Oxford, UK: Bureau of Publications.
(1985). Memory and consciousness. Canadian Psychology, 26, 1–12. https://doi.org/10.1037/h0080017
(1996). Failure to find the picture superiority effect in implicit perceptual memory tests. Journal of Experimental Psychology: Learning, Memory, and Cognition, 22, 670–686. https://doi.org/10.1037/0278-7393.22.3.670
(1987). Altering retrieval demands reverses the picture superiority effect. Memory & Cognition, 15, 269–280. https://doi.org/10.3758/BF03197030
(2003). Anomalies in cognition: Olfactory memory. European Psychologist, 8, 77–86. https://doi.org/10.1027/1016-9040.8.2.77
