Intralingual subtitles, interlingual subtitles, and video comprehension: insights from an exploratory study

Authors

  • Rafael Matielo Universidade Federal de Santa Catarina
  • Roberta Pires de Oliveira Universidade Federal de Santa Catarina
  • Luciane Baretta Universidade do Centro-Oeste

DOI:

https://doi.org/10.15448/1984-4301.2017.2.26370

Keywords:

Intralingual subtitles, Interlingual subtitles, Video comprehension, Sitcom.

Abstract

This paper explores the effects of intralingual and interlingual subtitles on Brazilian English as a Foreign Language (EFL) learners’ processing and video comprehension of a North-American sitcom. More specifically, it looks at the effects of intralingual and interlingual subtitles on learners’ general and specific video comprehension. Thirty-six intermediate-level EFL learners, enrolled at the Extracurricular Language Courses at Universidade Federal de Santa Catarina (UFSC), were equally divided into two experimental groups (intralingual subtitles and interlingual subtitles) and one control group (no subtitles). Participants’ performance was measured based on a general and specific video comprehension test. Data were analyzed both quantitatively and qualitatively. Regarding the effects of subtitles on video comprehension, statistical tests and analyses performed revealed that intralingual subtitles were found to be more beneficial in terms of learners’ general and specific video comprehension than interlingual subtitles, which in turn were found to be more effective than no subtitles. Still, participants’ performance in the experimental conditions did not differ statistically. These results are discussed in light of the possible different processing mechanisms and potentials that both intralingual and interlingual subtitles may offer for L2 learning/instructional purposes.

Downloads

Download data is not yet available.

Author Biographies

Rafael Matielo, Universidade Federal de Santa Catarina

Doutor em Letras/Inglês: Estudos Linguísticos e Literários pela Universidade Federal de Santa Catarina.

Roberta Pires de Oliveira, Universidade Federal de Santa Catarina

Doutora em Linguística pela Katholieke Universiteit Leuven (Bélgica) e docente na Universidade Federal de Santa Catarina (UFSC). Atua no Programa de Pós-Graduação em Linguística da Universidade Federal do Paraná (UFPR) e no Programa de Pós-Graduação em Inglês: Estudos Linguísticos e Literários da UFSC.

Luciane Baretta, Universidade do Centro-Oeste

Doutora em Letras/Inglês: Estudos Linguísticos e Literários pela Universidade Federal de Santa Catarina (UFSC) e docente na Universidade do Centro-Oeste (UNICENTRO), em Guarapuava-PR. Atua no Programa de Pós-Graduação em Letras da UNICENTRO.

References

ANDERSON, Daniel; Collins, Patricia. The impact on children’s education: Television’s influence on cognitive development. Washington, DC: U.S. Department of Education, Office of Educational Research and Improvement, 1988.

ATKINSON, David. The mother tongue in the classroom: a neglected resource? English Language Teaching Journal, v. 41, n. 4, p. 241-247, 1987.

AUERBACH, Elsa R. Reexamining English only in the ESL classroom. TESOL Quarterly, v. 27, n. 1, p. 9-32, 1993.

BIANCHI, Francesca; CIABATTONI, Tiziana. Captions and subtitles in EFL learning an investigative study in a comprehensive computer environment. Disponível em: <http://www.openstarts.units.it/dspace/bitstream/10077/2848/1/bianchi_ciabattoni.pdf>. Acesso em: 20 jan. 2017.

BIRD, Stephen; WILLIAMS, John. The effect of bimodal input on implicit and explicit memory: an investigation into the benefits of within-language subtitling. Applied Psycholinguistics, v. 23, n. 4, p. 509-533, 2002.

CAIMI, Annamaria. Audiovisual Translation and Language Learning. The Promotion of Intralingual Subtitles. Journal of Specialised Translation, v. 6, p. 85-98, 2006.

CHANG, Suhsun. The Interaction Between Schemata and Subtitles. Journal of National Taipei University of Technology, v. 39, n. 1, p. 209-227, 2006.

CHEN, Mei-Ling. Effects of the Order of Reading Text or Viewing a Film and L1/L2 Captions on Reading Comprehension. Perceptual & Motor Skills, v. 115, n. 1, p. 18-26, 2012.

DANAN, Marine. Captioning and subtitling: Undervalued language learning strategies. Meta, v. 49, n. 1, p. 67-77, 2004.

D’YDEWALLE, Géry; GIELEN, Ingrid. Attention allocation with overlapping sound, image, and text. In RAYNER, Keith. (Ed.). Eye movements and visual cognition: Scene perception and reading. New York: Springer-Verlag, 1992. p. 415-427.

D’YDEWALLE, Géry; VAN DE POEL, Marijke. Incidental foreign-language acquisition by children watching subtitled television programs. Journal of Psycholinguistic Research, v. 28, p. 227-244, 1999.

ELLIS, Rod. The study of second language acquisition. 2. ed. Oxford: Oxford University Press, 2008.

GARZA, Thomas J. Evaluating the use of captioned video materials in advanced foreign language learning. Foreign Language Annals, v. 24, n. 3, p. 239-258, 1991.

HAYATI, Abdolmajid; MOHMEDI, Firooz. The effect of films with and without subtitles on listening comprehension of ESL learners. British Journal of Educational Technology, v. 42, n. 1, p. 181-192, 2011.

HUANG, Hsin-Chuan; ESKEY, David E. The effects of closed-captioned television on the listening comprehension of intermediate English as a second language (ESL) students. Journal of Educational Technology Systems, v. 28, p. 75-96, 1999.

KOOSLTRA, Cees M.; BEENTJES, Jonannes W. J. Children vocabulary acquisition in a foreign language through watching subtitled television programs at home. ETR&D, v. 47, n. 1, p. 51-60, 1999.

KOSKINEN, Patricia S.; KNABLE, James E.; MARKHAM, Paul L.; JENSEMA, Carl J.; KANE, Kathryn W. Captioned Television and the Vocabulary Acquisition of Adult Second Language Correctional Facility Residents. Journal of Educational Technology Systems, v. 24, n. 4, p. 359-373, 1996.

KRASHEN, Stephen. Principles and Practice in Second Language Acquisition. Pergamon Press, 1982/2009.

KRUGER, Jan-Louis; STEYN, Faans. Subtitles and Eye Tracking: Reading and Performance. Reading Research Quarterly, v. 49, n. 1, p. 105-120, 2014.

LATIFI, Mehdi; MOBALEGH, Ali; MOHAMMADI, Elham. Movie Subtitles and the Improvement of Listening Comprehension Ability. Does it help? Journal of Language Teaching and Learning, v. 1, n. 2, p. 18-29, 2011.

MARKHAM, Paul L. Captioned videotapes and second-language listening word recognition. Foreign Language Annals, v. 32, n. 3, p. 321-328, 1999.

MARKHAM, Paul L.; PETER, Lizette. The influence of English language and Spanish language captions on foreign language listening/reading comprehension. Journal of Educational Technology Systems, v. 31, n. 3, p. 331-341, 2003.

MARKHAM, Paul L.; PETER, Lizette; MCCARTHY, Teresa. The effects of native language vs. target language captions on foreign language students’ DVD video comprehension. Foreign Language Annals, v. 34, n. 5, p. 439-445, 2001.

MATIELO, Rafael. Intralingual Subtitles, Interlingual Subtitles, and L2 Vocabulary Learning. An Exploratory Study with Brazilian EFL Students. 2016. 272 fl. Tese (Doutorado em Letras Inglês) -– Universidade Federal de Santa Catarina, Florianópolis, 2016.

MATIELO, Rafael; COLLET, Thaís; D’ELY, Raquel C. S. F. The effects of interlingual and intralingual subtitles on vocabulary learning by Brazilian EFL learners. An exploratory study. Revista Intercâmbio, v. 27, p. 83-99, 2013.

MONTERO-PEREZ, Maribel; PETERS, Elke; DESMET, Piet. Enhancing Vocabulary Learning through Captioned Video. An Eye-Tracking Study. Modern Language Journal, v. 99, n. 2, p. 308-328, 2015.

NEUMAN, Susan B. The impact of different media on children’s story comprehension. Reading Research and Instruction, v. 28, p. 38-47, 1989.

NEUMAN, Susan B.; KOSKINEN, Patricia. Captioned television as comprehensible input: Effects of incidental word learning from context for language minority students. Reading Research Quarterly, v. 27, p. 94-106, 1992.

PEREGO, Elisa; DEL MISSIER, Fabio; PORTA, Marco; MOSCONI, Mauro. The Cognitive Effectivesness of Subtitle Processing. Media Psychology, v. 13, p. 243-272, 2010.

PETERS, Elke; HEYNEN, Eva; PUIMÈGE, Eva. Learning vocabulary through audiovisual input. The differential effect of L1 subtitles and captions. System, v. 63, p. 134-148, 2016.

PRICE, Karen. Closed-Captioned TV. An Untapped Resource. MATSOL Newsletter, v. 12, n. 2, p. 1-8, 1983.

RAINE, Paul. Incidental Increase in Depth of Vocabulary Knowledge Through the Viewing of Subtitled, Authentic Videos. In: SONDA, Nozomu; KRAUSE, Aleda (Ed.). Making a Difference. Tokyo: JALT, 2013. p. 492-505.

ROMANELLI, Sergio. O uso da tradução no ensino-aprendizagem das línguas estrangeiras. Revista Horizontes de Linguística Aplicada, v. 8, n. 2, p. 200-219, 2009.

SAEEDI, Zari; BIRI, Aso. The Application of Technology in Teaching Grammar to EFL Learners. The Role of Animated Sitcoms. Teaching English with Technology, v. 16, n. 2, p.18-39, 2016.

SHARIF, Masoud R.; EBRAHIMIAN, Maryam. A Comparative Study of 'Subtitled' vs. 'Auditory' Documentaries Comprehension among Persian Speakers of English. International Journal of Applied Linguistics & English Literature, v. 2, n. 2, p. 185-192, 2013.

STEWART, Melissa A.; PERTUSA, Immaculada. Gains to language learners from viewing target language closed-captioned films. Foreign Language Annals, v. 37, n. 3, p. 438-447, 2004.

SU, Shu-Chin; LIANG, Eleen. Using Subtitled Animated Cartoons and Textbook-based CDs to Test Elementary Students’ English Listening and Reading Comprehension in a Cram School. International Journal of Applied Linguistics & English Literature, v. 4, n. 1, p. 106-114, 2015.

SYDORENKO, Tetyana. Modality of Input and Vocabulary Acquisition. Language Learning & Technology, v. 14, n. 2, p. 50-73, 2010.

TAYLOR, Gregory. Perceived processing strategies of students watching captioned video. Foreign Language Annals, v. 38, n. 3, p. 422-427, 2005.

VAN LOMMEL, Sven; LAENEN, Annouschka; D’YDEWALLE, Géry. Foreign grammar acquisition while watching subtitled television programs. British Journal of Educational Psychology, v. 76, p. 243-258, 2006.

VANDERPLANK, Robert Captioned Media in Foreign Language Learning and Teaching. Subtitles for the Deaf and Hard-of-Hearing as Tools for Language Learning. London: Palgrave Macmillan, 2015.

WANG, Yu-Chia. Learning L2 Vocabulary with American TV Drama. From the Learner’s Perspective. English Language Teaching, v. 5, n. 8, p. 217-225, 2012.

WINKE, Paula; GASS, Susan; SYDORENKO, Tetyana. The effects of captioning videos used for foreign language listening activities. Language Learning and Technology, v. 14, n. 1, p. 65-86, 2010.

WINKE, Paula; GASS, Susan; SYDORENKO, Tetyana. Factors Influencing the Use of Captions by Foreign Language Learners. An Eye-Tracking Study. Modern Language Journal, v. 97, n. 1, p. 254-275, 2013.

ZAREI, Abbas Ali; RASHVAND, Zohreh. The Effect of Interlingual and Intralingual,

Verbatim and Nonverbatim Subtitles on L2 Vocabulary Comprehension and Production.

Journal of Language Teaching and Research, v. 2, n. 3, p. 618-625, 2011.

Downloads

Published

2018-03-23

How to Cite

Matielo, R., de Oliveira, R. P., & Baretta, L. (2018). Intralingual subtitles, interlingual subtitles, and video comprehension: insights from an exploratory study. Letrônica, 10(2), 758–774. https://doi.org/10.15448/1984-4301.2017.2.26370