Computational Modeling of Face Recognition Based on Psychophysical Experiments
Abstract
Recent results from psychophysical studies are discussed which clearly show that face processing is not only holistic. Humans do encode face parts (component information) in addition to information about the spatial interrelationship of facial features (global configural information). Based on these findings we propose a computational architecture of face recognition, which implements a component and configural route for encoding and recognizing faces. Modeling results showed a striking similarity between human psychophysical data and the computational model. In addition, we could show that our framework is able to achieve good recognition performance even under large view rotations. Thus, our study is an example of how an interdisciplinary approach can provide a deeper understanding of cognitive processes and lead to further insights in human psychophysics as well as computer vision.
References
Bahrick, H. P. , Bahrick, P. O. , Wittlinger, R. P. (1975). Fifty years of memory for names and faces: A cross-sectional approach. Journal of Experimental Psychology: General, 104, 54– 75Blanz, V. , Romdhani, S. , Vetter, T. (2002). Face identification across different poses and illuminations with a 3D morphable model. Proc. 5th Int. Conference on Automatic Face and Gesture Recognition, 202– 207Blanz, V. , Vetter, T. (1999). A morphable model for the synthesis of 3D faces. Proc. Siggraph, 99, 187– 194Bruce, V. (1982). Changing faces: Visual and non-visual coding process in face recognition. British Journal of Psychology, 73, 105– 116Bruce, V. (1988). Recognising faces. Hillsdale, NJ: Lawrence ErlbaumCollishaw, S. M. , Hole, G. J. (2000). Featural and configurational processes in the recognition of faces of different familiarity. Perception, 29, 893– 910Davidoff, J. , Donnelly, N. (1990). Object superiority: A comparison of complete and part probes. Acta Psychologica, 73, 225– 243Farah, M. J. , Tanaka, J. W. , Drain, H. M. (1995). What causes the face inversion effect?. Journal of Experimental Psychology: Human Perception and Performance, 21, 628– 634Green, D. M. , Swets, J. A. (1966). Signal detection theory and psychophysics. New York: WileyGroner, R. (1967). Dimensionen der Wahrnehmung von Gesichtern [Perceptual dimensions of human faces]. Zeitschrift für experimentelle und angewandte Psychologie, XIV(1), 135– 154Hill, H. , Schyns, P. G. , Akamatsu, S. (1997). Information and viewpoint dependence in face recognition. Cognition, 62, 201– 222Hjelmas, E. , Low, B. K. (2001). Face detection: A survey. Computer Vision and Image Understanding, 83, 236– 274Leder, H. , Bruce, V. (2000). When inverted faces are recognized: The role of configural information in face recognition. Quarterly Journal of Experimental Psychology, 53A, 513– 536McMillan, N. A. , Creelman, C. D. (1991). Detection theory: A user’s guide. New York: Cambridge University PressMurray, J. E. , Yong, E. , Rhodes, G. (2000). Revisiting the perception of upside-down faces. Psychological Science, 11, 498– 502O’Toole, A. , Edelman, S. , Bülthoff, H. H. (1998). Stimulus-specific effects in face recognition over changes in viewpoint. Vision Research– 38, 2351– 2363Pilu, M. (1997). A direct method for stereo correspondence based on singular value decomposition. Proc. Computer Vision and Pattern Recognition, 261– 266Rock, I. (1973). Orientation and form. New York: Academic PressRock, I. (1974). The perception of disoriented figures. Scientific American, 230, 78– 85Rock, I. (1988). On Thompson’s inverted-face phenomenon (Research Note). Perception, 17, 815– 817Schwaninger, A. , Carbon, C. Ch. , Leder, H. (2003). Expert face processing: Specialization and constraints. In G. Schwarzer & H. Leder, The development of face processing (81-97). Seattle: Hogrefe & HuberSchwaninger, A. , Lobmaier, J. , Collishaw, S. M. (2002). Role of featural and configural information in familiar and unfamiliar face recognition. Lecture Notes in Computer Science, 2525, 643– 650Schwaninger, A. , Mast, F. (1999). Why is face recognition so orientation-sensitive? Psychophysical evidence for an integrative model. Perception, 28(Suppl.), 116–Schwaninger, A. , Mast, F. (2004). The face inversion effect can be explained by capacity limitations of an orientation normalization mechanism. Manuscript submitted for publicationSearcy, J. H. , Bartlett, J. C. (1996). Inversion and processing of component and spatial-relational information of faces. Journal of Experimental Psychology: Human Perception and Performance, 22, 904– 915Sergent, J. (1984). An investigation into component and configurational processes underlying face recognition. British Journal of Psychology, 75, 221– 242Sergent, J. (1985). Influence of task and input factors on hemispheric involvement in face processing. Journal of Experimental Psychology: Human Perception and Performance, 11(6), 846– 861Tanaka, J. W. , Farah, M. J. (1991). Second-order relational properties and the inversion-effect: Testing a theory of face perception. Perception & Psychophysics, 50, 367– 372Tanaka, J. W. , Farah, M. (1993). Parts and wholes in face recognition. Quarterly Journal of Experimental Psychology, 46, 225– 245Troje, N. F. , Bülthoff, H. H. (1996). Face recognition under varying poses: The role of texture and shape. Vision Research, 36(12), 1761– 1771Ullman, S. , Vidal-Naquet, M. , Sali, E. (2002). Visual features of intermediate complexity and their use in classification. Nature Neuroscience, 5(7), 682– 687Valentin, D. , Abdi, H. , Edelman, B. (1997). What represents a face: A computational approach for the integration of physiological and psychological data. Perception, 26, 1271– 1288Valentine, T. (1988). Upside-down faces: A review of the effect of inversion upon face recognition. British Journal of Psychology, 79, 471– 491Valentine, T. , Bruce, V. (1988). Mental rotation of faces. Memory and Cognition, 16, 556– 566Wallraven, C. , Bülthoff, H. H. (2001a). Automatic acquisition of exemplar-based representations for recognition from image sequences. Workshop on models vs. exemplars. Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, CVPR 2001Wallraven, C. , Bülthoff, H. H. (2001b). View-based recognition under illumination changes using local features. Workshop on identifying objects across variations in lighting: Psychophysics and Computation. Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, CVPR 2001Wallraven, C. , Schwaninger, A. , Schuhmacher, S. , Bülthoff, H. H. (2002). View-based recognition of faces in man and machine: Re-visiting inter-extra-ortho. Lecture Notes in Computer Science, 2525, 651– 660Yin, R. K. (1969). Looking at upside-down faces. Journal of Experimental Psychology, 81, 141– 145
