Skip to main content

Attentional Modulation of the Emotional Expression Processing Studied with ERPs and sLORETA

Published Online: Doi: https://doi.org/10.1027/0269-8803/a000109

Recent ERP studies demonstrate that the processing of facial emotional expression can be modulated by attention. The aim of the present study was to investigate the neural correlates of attentional influence on the emotional expression processing at early stages. We recorded ERP responses to facial stimuli containing neutral versus emotional expression in two different conditions. The first task was to discriminate facial expressions, while the second task was to categorize face gender. Enhanced positivity at occipital and occipito-temporal locations between 110 and 170 ms poststimulus was elicited by facial stimuli presented in the expression task when compared to the gender task. This effect temporally overlapped with the P1 and N170 components, which reflect the early stages of face processing. To localize the sources of the brain activity underlying observed attentional modulation, we used Standardized Low Resolution Electromagnetic Tomography. Enhanced activity within the extrastriate cortex for the expression task was obtained as the reflection of early ERP effect. Additionally, we found stronger activation within the superior temporal and the fusiform gyrus of the right hemisphere in the expression task when compared to the gender task. Our findings undoubtedly confirm that early stages of the emotional expression processing can be modified by top-down attention.

References

  • Adolphs, R. , Damasio, H. , Tranel, D. , Damasio, A. R. (1996). Cortical systems for the recognition of emotion in facial expressions. Journal of Neuroscience, 16, 7678–7687. First citation in articleGoogle Scholar

  • Allison, T. , Puce, A. , McCarthy, G. (2000). Social perception from visual cues: Role of the STS region. Trends in Cognitive Science, 4, 267–278. First citation in articleCrossrefGoogle Scholar

  • Anllo-Vento, L. , Luck, S. J. , Hillyard, S. A. (1998). Spatio-temporal dynamics of attention to color: Evidence from human electrophysiology. Human Brain Mapping, 6, 216–238. First citation in articleCrossrefGoogle Scholar

  • Batty, M. , Taylor, M. J. (2003). Early processing of the six basic facial emotional expressions. Cognitive Brain Research, 17, 613–620. First citation in articleCrossrefGoogle Scholar

  • Beck, D. M. , Kastner, S. (2009). Top-down and bottom-up mechanisms in biasing competition in the human brain. Vision Research, 49, 154–1165. First citation in articleCrossrefGoogle Scholar

  • Bentin, S. , Allison, T. , Puce, A. , Perez, E. , McCarthy, G. (1996). Electrophysiological studies of face perception in humans. Journal of Cognitive Neuroscience, 8, 551–565. First citation in articleCrossrefGoogle Scholar

  • Blau, V. C. , Maurer, U. , Tottenham, N. , McCandliss, B. (2007). The face-specific N170 component is modulated by emotional expression. Behavioral and Brain Function, 3, 7. First citation in articleCrossrefGoogle Scholar

  • Brett, M. , Johnsrude, I. S. , Owen, A. M. (2002). The problem of functional localization in the human brain. Nature Reviews Neuroscience, 3, 243–249. First citation in articleCrossrefGoogle Scholar

  • Calder, A. J. , Young, A. W. (2005). Understanding the recognition of facial identity and facial expression. Nature Reviews Neuroscience, 6, 641–651. First citation in articleCrossrefGoogle Scholar

  • Campanella, S. , Hanoteau, C. , Dèpy, D. , Rossion, B. , Bruyer, R. , Crommenlinck, M. , Guèrit, J. M. (2000). Right N170 modulation in a face discrimination task: An account for categorical perception of familiar faces. Psychophysiology, 37, 796–806. First citation in articleCrossrefGoogle Scholar

  • Eimer, M. (2000). The face-specific N170 reflects late stages in the structural encoding of faces. NeuroReport, 11, 2319–2324. First citation in articleGoogle Scholar

  • Eimer, M. , Holmes, A. (2007). Event-related brain potential correlates of emotional face processing. Neuropsychologia, 45, 15–31. First citation in articleCrossrefGoogle Scholar

  • Ekman, P. , Friesen, W. V. (1976). Pictures of facial affect. Palo Alto, CA: Consulting Psychologists Press. First citation in articleGoogle Scholar

  • Fox, E. , Zougkou, K. (2011). Individual differences in the processing of facial expressions. In A. Calder, G. Rhodes, M. Johnson, J. Haxby (Eds.), The Oxford Handbook of Face Perception (pp. 515–534). Oxford, UK: Oxford University Press. First citation in articleGoogle Scholar

  • Fuchs, M. , Kastner, J. , Wagner, M. , Hawes, S. , Ebersole, J. S. (2002). A standardized boundary element method volume conductor model. Clinical Neurophysiology, 113, 702–12. First citation in articleCrossrefGoogle Scholar

  • Gajewski, P. D. , Stoerig, P. (2011). N170 – an index of categorical face perception? An ERP study of human, nonhuman primate, and dog faces. Journal of Psychophysiology, 25, 174–179. First citation in articleLinkGoogle Scholar

  • Gratton, G. , Coles, M. G. H. , Donchin, E. (1983). A new method for off-line removal of ocular artifact. Electroencephalography and Clinical Neurophysiology, 55, 468–484. First citation in articleCrossrefGoogle Scholar

  • Gobbini, M. I. , Leibenluft, E. , Santiago, N. , Haxby, J. V. (2004). Social and emotional attachment in the neural representation of faces. NeuroImage, 22, 1628–1635. First citation in articleCrossrefGoogle Scholar

  • Gobbini, M. I. , Haxby, J. V. (2007). Neural systems for recognition of familiar faces. Journal of Neurophysiology, 45, 32–41. First citation in articleGoogle Scholar

  • Gorno-Tempini, M. L. , Price, C. J. , Josephs, O. , Vandenberghe, R. , Cappa, S. F. , Kapur, N. , Frackowiak, R. S. J. (1998). The neural systems sustaining face and proper-name processing. Brain, 121, 2103–2118. First citation in articleCrossrefGoogle Scholar

  • Halgren, E. , Raij, T. , Marinkovic, K. , Jousmaki, V. , Hari, R. (2000). Cognitive response profile of the human fusiform face area as determined by MEG. Cerebral Cortex, 10, 69–81. First citation in articleCrossrefGoogle Scholar

  • Han, S. , He, X. , Woods, D. L. (2000). Hierarchical processing and level-repetition effect as indexed by early brain potentials. Psychophysiology, 37, 817–830. First citation in articleCrossrefGoogle Scholar

  • Haxby, J. V. , Hoffman, E. A. , Gobbini, I. M. (2000). The distributed human neural system for face perception. Trends in Cognitive Science, 4, 223–233. First citation in articleCrossrefGoogle Scholar

  • Haxby, J. V. , Hoffman, E. A. , Gobbini, I. M. (2002). Human neural systems for face recognition and social communication. Biological Psychiatry, 51, 59–67. First citation in articleCrossrefGoogle Scholar

  • Hillyard, S. A. , Anllo-Vento, L. (1998). Event-related brain potentials in the study of visual selective attention. Proceedings of the National Academy of Sciences of the USA, 95, 781–787. First citation in articleGoogle Scholar

  • Hillyard, S. A. , Teder-Sälejärvi, W. A. , Münte, T. F. (1998). Temporal dynamics of early perceptual processing. Current Opinion in Neurobiology, 8, 202–210. First citation in articleCrossrefGoogle Scholar

  • Hillyard, S. A. , Vogel, E. K. , Luck, S. J. (1998). Sensory gain control (amplification) as a mechanism of selective attention: Electrophysiological and neuroimaging evidence. Philosophical Transaction of the Royal Society B, 353, 1257–1270. First citation in articleCrossrefGoogle Scholar

  • Ishai, A. , Pessoa, L. , Bikle, P. C. , Ungerleider, L. G. (2004). Repetition suppression of faces is modulated by emotion. Proceedings of the National Academy of Sciences of the USA, 101, 9827–9832. First citation in articleGoogle Scholar

  • Ishai, A. , Schmidt, C. F. , Boesiger, P. (2005). Face perception is mediated by a distributed cortical network. Brain Research Bulletin, 67, 87–93. First citation in articleCrossrefGoogle Scholar

  • Itier, R. J. , Alain, C. , Sedore, K. , McIntosh, A. R. (2007). Early face processing specificity: It’s in the eyes!. Journal of Cognitive Neuroscience, 19, 1815–1826. First citation in articleCrossrefGoogle Scholar

  • Itier, R. J. , Herdman, A. T. , George, N. , Cheyne, D. , Taylor, M. J. (2006). Inversion and contrast-reversal effects on face processing assessed by MEG. Brain Research, 1115, 108–120. First citation in articleCrossrefGoogle Scholar

  • Itier, R. J. , Taylor, M. J. (2004). Source analysis of the N170 to faces and objects. NeuroReport, 15, 1261–1265. First citation in articleGoogle Scholar

  • Jurcak, V. , Tsuzuki, D. , Dan, I. (2007). 10/20, 10/10, and 10/5 systems revisited: Their validity as relative head-surface-based positioning systems. NeuroImage, 34, 1600–1611. First citation in articleCrossrefGoogle Scholar

  • Kanwisher, N. , McDermott, J. , Chun, M. M. (1997). The fusiform face area: A module in human extrastriate cortex specialized for face perception. Journal of Neuroscience, 17, 4302–4311. First citation in articleCrossrefGoogle Scholar

  • Kanwisher, N. , Yovel, G. (2006). The Fusiform Face Area: A cortical region specialized for the perception of faces. Proceedings of the Royal Society of London, 361, 2109–2128. First citation in articleCrossrefGoogle Scholar

  • Kastner, S. , Ungerleider, L. G. (2000). Mechanisms of visual attention in the human cortex. Annual Review of Neuroscience, 23, 315–341. First citation in articleCrossrefGoogle Scholar

  • Kastner, S. , Ungerleider, L. G. (2001). Neural basis of biased competition in human visual cortex. Neuropsychologia, 39, 1263–1276. First citation in articleCrossrefGoogle Scholar

  • Krolak-Salmon, P. , Henaff, M. A. , Vighetto, A. , Bertrand, O. , Mauguiere, F. (2004). Early amygdala reaction to fear spreading in occipital, temporal, and frontal cortex: A depth electrode ERP study in human. Neuron, 42, 665–676. First citation in articleCrossrefGoogle Scholar

  • Lancaster, J. L. , Woldorff, M. G. , Parsons, L. M. , Liotti, M. , Freitas, C. S. , Rainey, L. , Kochunov, P. V. , Nickerson, D. , Mikiten, S. A. , Fox, P. T. (2000). Automated Talairach Atlas labels for functional brain mapping. Human Brain Mapping, 10, 120–131. First citation in articleCrossrefGoogle Scholar

  • Mazziotta, J. , Toga, A. , Evans, A. , Fox, P. , Lancaster, J. , Zilles, K. , … Mazoyer, B. (2001). A probabilistic atlas and reference system for the human brain: International Consortium for Brain Mapping (ICBM). Philosophical Transaction of the Royal Society B, 356, 1293–1322. First citation in articleCrossrefGoogle Scholar

  • Miyoshi, M. , Katayama, J. , Morotomi, T. (2004). Face-specific N170 component is modulated by facial expressional change. NeuroReport, 15, 911–914. First citation in articleGoogle Scholar

  • Mouchetant-Rostaing, Y. , Giard, M.-H. , Bentin, S. , Aguera, P.-E. , Pernier, J. (2000). Neurophysiological correlates of face gender processing in humans. European Journal of Neuroscience, 12, 303–310. First citation in articleCrossrefGoogle Scholar

  • Nichols, T. E. , Holmes, A. P. (2002). Nonparametric permutation tests for functional neuroimaging: A primer with examples. Human Brain Mapping, 15, 1–25. First citation in articleCrossrefGoogle Scholar

  • Pascual-Marqui, R. D. (2002). Standardized low-resolution brain electromagnetic tomography (sLORETA): Technical details. Methods and Findings in Experimental and Clinical Pharmacology, 24, 5–12. First citation in articleGoogle Scholar

  • Pegna, A. J. , Landis, T. , Khateb, A. (2008). Electrophysiological evidence for early non-conscious processing of fearful facial expressions. International Journal of Psychophysiology, 70, 127–136. First citation in articleCrossrefGoogle Scholar

  • Perrett, D. I. , Rolls, E. T. , Caan, W. (1982). Visual neurones responsive to faces in the monkey temporal cortex. Experimental Brain Research, 47, 329–342. First citation in articleCrossrefGoogle Scholar

  • Perrett, D. I. , Smith, P. A. J. , Potter, D. D. , Mistlin, A. J. , Head, A. S. , Milner, A. D. , Jeeves, M. A. (1985). Visual cells in the temporal cortex sensitive to face view and gaze direction. Proceedings of the Royal Society of London, 223, 293–317. First citation in articleCrossrefGoogle Scholar

  • Pessoa, L. , Kastner, S. , Ungerleider, L. G. (2002). Attentional control of the processing of neutral and emotional stimuli. Cognitive Brain Research, 15, 31–45. First citation in articleCrossrefGoogle Scholar

  • Pessoa, L. , McKenna, M. , Gutierrez, E. , Ungerleider, L. G. (2002). Neural processing of emotional faces requires attention. Proceedings of the National Academy of Sciences of the USA, 99, 11458–11463. First citation in articleGoogle Scholar

  • Pourtois, G. , Dan, E. S. , Grandjean, D. , Sander, D. , Vuilleumier, P. (2005). Enhanced extrastriate visual response to bandpass spatial frequency filtered fearful faces: Time course and topographic evoked-potentials mapping. Human Brain Mapping, 26, 65–79. First citation in articleCrossrefGoogle Scholar

  • Pourtois, G. , Grandjean, D. , Sander, D. , Vuilleumier, P. (2004). Electrophysiological correlates of rapid spatial orienting towards fearful faces. Cerebral Cortex, 14, 619–633. First citation in articleCrossrefGoogle Scholar

  • Puce, A. , Allison, T. , Gore, J. C. , McCarthy, G. (1995). Face-sensitive regions in human extrastriate cortex studied by functional MRI. Journal of Neurophysiology, 74, 1192–1199. First citation in articleCrossrefGoogle Scholar

  • Rigato, S. , Farroni, T. , Johnson, M. H. (2010). The shared signal hypothesis and neural responses to expressions and gaze in infants and adults. Social, Cognitive and Affective Neuroscience, 5, 88–97. First citation in articleGoogle Scholar

  • Rossion, B. , Campanella, S. , Gomez, C. M. , Delinte, A. , Debatisse, D. , Liard, L. , Dubois, S. , Bruyer, R. , Crommelinck, M. , Guerit, J. M. (1999). Task modulation of brain activity related to familiar and unfamiliar face processing: An ERP study. Clinical Neurophysiology, 110, 449–462. First citation in articleCrossrefGoogle Scholar

  • Rossion, B. , Caldara, R. , Seghier, M. , Schuller, A. M. , Lazeyras, F. , Mayer, E. (2003). A network of occipito-temporal face-sensitive areas besides the right middle fusiform gyrus is necessary for normal face processing. Brain, 126, 2381–2395. First citation in articleCrossrefGoogle Scholar

  • Rossion, B. , Joyce, C. A. , Cottrell, G. W. , Tarr, M. J. (2003). Early lateralization and orienting tuning for face, word, and object processing in the visual cortex. NeuroImage, 20, 1609–1624. First citation in articleCrossrefGoogle Scholar

  • Schmolesky, M. T. , Wang, Y. , Hanes, D. P. , Thompson, K. G. , Leutgeb, S. , Schall, J. D. , Leventhal, A. G. (1998). Signal timing across the Macaque visual system. Journal of Neurophysiology, 79, 3272–3278. First citation in articleGoogle Scholar

  • Sprengelmeyer, R. , Jentzsch, I. (2006). Event related potentials and the perception of intensity in facial expressions. Neuropsychologia, 44, 2899–2906. First citation in articleCrossrefGoogle Scholar

  • Streit, M. , Ioannides, A. A. , Liu, L. , Wolwer, W. , Dammers, J. , Gross, J. , Gaebel, W. , Müller-Gärtner, H.-W. (1999). Neurophysiological correlates of the recognition of facial expressions expressions of emotion as revealed by magnetoencephalography. Cognitive Brain Research, 7, 481–491. First citation in articleCrossrefGoogle Scholar

  • Taylor, M. J. (2002). Non-spatial attentional effects on P1. Clinical Neurophysiology, 113, 1903–1908. First citation in articleCrossrefGoogle Scholar

  • Vlamings, P. H. J. M. , Goffaux, V. , Kemner, C. (2009). Is the early modulation of brain activity by fearful facial expressions primarily mediated by coarse low spatial frequency information? Journal of Vision, 9, 1–13. First citation in articleCrossrefGoogle Scholar

  • Vuilleumier, P. , Pourtois, G. (2007). Distributed and interactive brain mechanisms during emotion face perception: Evidence from functional neuroimaging. Neuropsychologia, 45, 174–194. First citation in articleCrossrefGoogle Scholar

  • Vuilleumier, P. , Richardson, M. P. , Armony, J. L. , Driver, J. , Dolan, R. J. (2004). Distant influences of amygdala lesion on visual cortical activation during emotional face processing. Nature Neuroscience, 7, 1271–1278. First citation in articleCrossrefGoogle Scholar

  • Wronka, E. , Walentowska, W. (2011). Attention modulates emotional expression processing. Psychophysiology, 48, 1047–1056. First citation in articleCrossrefGoogle Scholar

  • Yovel, G. , Levy, J. , Grabowecky, M. , Paller, K. A. (2003). Neural correlates of the left-visual-field superiority in face perception appear at multiple stages of face processing. Journal of Cognitive Neuroscience, 15, 462–474. First citation in articleCrossrefGoogle Scholar

Access content

To read the fulltext, please use one of the options below to sign in or purchase access.