Eye Movements of Children and Adults While Reading Television Subtitles
Abstract
Abstract. Eye movements of children (Grade 5-6) and adults were monitored while they were watching a foreign language movie with either standard (foreign language soundtrack and native language subtitling) or reversed (foreign language subtitles and native language soundtrack) subtitling. With standard subtitling, reading behavior in the subtitle was observed, but there was a difference between one- and two-line subtitles. As two lines of text contain verbal information that cannot easily be inferred from the pictures on the screen, more regular reading occurred; a single text line is often redundant to the information in the picture, and accordingly less reading of one-line text was apparent. Reversed subtitling showed even more irregular reading patterns (e.g., more subtitles skipped, fewer fixations, longer latencies). No substantial age differences emerged, except that children took longer to shift attention to the subtitle at its onset, and showed longer fixations and shorter saccades in the text. On the whole, the results demonstrated the flexibility of the attentional system and its tuning to the several information sources available (image, soundtrack, and subtitles).
References
(1980). Visual reading processes and the quality of text displays . IPO Annual Progress Report, No. 15, 83– 90.
(1958). Perception and communication . London: Pergamon.
(1999). Language from faces: Uses of the face in speech and in sign. In L.S. Messing & R. Campbell (Eds.), Gesture, speech, and sign (pp. 57-73). New York: Oxford University Press.
(1992). Visual analysis of cartoons: A view from the far side. In K. Rayner (Ed.), Eye movements and visual cognition: Scene perception and reading (pp. 444-461). New York: Springer-Verlag.
(2003). Reading native and foreign language television subtitles in children and adults. In J. Hyönä, R. Radach, & H. Deubel (Eds.), The mind's eyes: Cognitive and applied aspects of eye movement research (pp. 671-684). Oxford, UK: Elsevier Science.
(1992). Attention allocation with overlapping sound, image, and text. In K. Rayner (Ed.), Eye movements and visual cognition: Scene perception and reading (pp. 415-427). New York: Springer-Verlag.
(1985). Attention shifts in partially redundant information situations. In R. Groner, G.W. McConkie, & C. Menz (Eds.), Eye movements and human information processing (pp. 375-384). Amsterdam: Elsevier.
(1997). Could enjoying a movie lead to language acquisition?. In P. Winterhoff & T. Van der Voort (Eds.), New horizons in media psychology (pp. 145-155). Opladen: Westdeutscher Verlag.
(1991). Watching subtitled television: Automatic reading behavior. Communication Research, 18, 650– 666.
(1999). Incidental foreign-language acquisition by children watching subtitled television programs. Journal of Psycholinguistic Research, 28, 227– 244.
(1989). Developmental studies of text-picture interactions in the perception of animated cartoons with text. In H. Mandl & J.R. Levin (Eds.), Knowledge acquisition from text and pictures (pp. 223-248). Amsterdam: Elsevier.
(1992a). The mechanics of comprehension and comprehension of mechanics. In K. Rayner (Ed.), Eye movements and visual cognition: Scene perception and reading (pp. 428-443). New York: Springer-Verlag .
(1992b). Mental animation: Inferring motion from static displays of mechanical systems. Journal of Experimental Psychology: Learning, Memory, and Cognition, 18, 1084– 1102.
(1984). Pairing script and dialog: Combinations that show promise for second or foreign language learning. Language Learning, 34, 59– 76.
(1981). Choosing the languages of subtitles and spoken dialogs for media presentations: Implications for second language acquisition. Applied Psycholinguistics, 2, 133– 148.
(1984). Combinations of printed script and spoken dialog that show promise for students of a foreign language. Canadian Journal of Behavioral Science, 16, 1– 11.
(1979). Eye movement dynamics of good and poor readers: Then and now. Journal of Reading Behavior, 11, 319– 328.
(1969). Eye movement latency as a function of age, stimulus uncertainty, and position in the visual field. Perceptual and Motor Skills, 28, 631– 636.
(1992). Incidental acquisition of foreign language through subtitled television programs as a function of similarity with native language and as a function of presentation mode . Unpublished doctoral thesis, Leuven, Belgium, University of Leuven.
(1990). A one-line text is not half a two-line text. In R. Groner, G. d'Ydewalle, & R. Parham (Eds.), From eye to mind: Information acquisition in perception, search, and reading (pp. 205-213). Amsterdam: North-Holland.
(1998). Eye movements in reading and information processing: 20 years of research. Psychological Bulletin, 124, 372– 422.
(1996). Mindless reading revisited: Eye movements during reading and scanning are different. Perception & Psychophysics, 58, 734– 747.
(1987). Eye movements in reading: A tutorial review. In M. Coltheart (Ed.), Attention and performance: Vol. 12. The psychology of reading (pp. 327-362). Hove, UK: Erlbaum.
(2001). Integrating text and pictorial information: Eye movements when looking at print advertisements. Journal of Experimental Psychology: Applied, 7, 219– 226.
(1976). Eye movements while reading and searching spatially transformed text: A developmental examination. Memory & Cognition, 4, 36– 42.
(1965). Eye movements in reading: Facts and fallacies. American Educational Research Journal, 2, 187– 202.
(2004). Inspecting pictures for information to verify a sentence: Eye movements in general encoding and in focused search. Quarterly Journal of Experimental Psychology: Human Experimental Psychology, 57A, 165– 182.
(2006). Foreign-grammar acquisition while watching subtitled television programs. British Journal of Educational Psychology, 76, 243– 258.
(1995). Mindless reading: Eye-movement characteristics are similar in scanning letter strings and reading texts. Perception & Psychophysics, 57, 352– 364.
(1986). Ondertiteling op de B.R.T . [Subtitling at the Belgian radio and television]. (Psychological Reports No. 55). Leuven, Belgium: University of Leuven, Laboratory of Experimental Psychology.
