Hostname: page-component-cd9895bd7-mkpzs Total loading time: 0 Render date: 2024-12-25T19:03:27.701Z Has data issue: false hasContentIssue false
  • English
  • Français

Second or foreign language learning through watching audio-visual input and the role of on-screen text

Published online by Cambridge University Press:  10 January 2022

Maribel Montero Perez
Maribel Montero Perez*
Affiliation:
Ghent University, Gent, Belgium
*
Email: [email protected]
Get access Rights & Permissions [Opens in a new window]

Abstract

This article discusses research into the role of audio-visual input for second language (L2) or foreign language learning. It also addresses questions related to the effectiveness of audio-visual input with different types of on-screen text such as subtitles (i.e., in learners’ first language) and captions (i.e., subtitles in the same language as the L2 audio) for L2 learning. The review discusses the following themes: (a) the characteristics of audio-visual input such as the multimodal nature of the input and vocabulary demands of video; (b) L2 learners’ comprehension of audio-visual input and the role of different types of on-screen text; (c) the effectiveness of audio-visual input and on-screen text for aspects of L2 learning including vocabulary, grammar, and listening; and (d) research into L2 learners’ use and perceptions of audio-visual input and on-screen text. The review ends with a consideration of implications for teaching practice and a conclusion that discusses the generalizability of current research in relation to suggestions for future research.

Type
State-of-the-Art Article
Information
Language Teaching , Volume 55 , Issue 2 , April 2022 , pp. 163 - 192
Check for updates
Copyright
Copyright © The Author(s), 2022. Published by Cambridge University Press

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

References

Abrams, Z. I. (2016). Possibilities and challenges of learning German in a multimodal environment: A case study. ReCALL, 28(3), 343–363. https://doi.org/10.1017/S0958344016000082CrossRefGoogle Scholar
Adesope, O. O., & Nesbit, J. C. (2012). Verbal redundancy in multimedia learning environments: A meta-analysis. Journal of Educational Psychology, 104(1), 250–263. https://doi.org/10.1037/a0026147CrossRefGoogle Scholar
Al-Surmi, M. (2012). Authenticity and TV shows: A multidimensional analysis perspective. TESOL Quarterly, 46(4), 671–694. https://doi.org/10.1002/tesq.33Google Scholar
Arndt, H. L., & Woore, R. (2018). Vocabulary learning from watching YouTube videos and reading blog posts. Language Learning & Technology, 22(3), 124–142. https://doi.org/10125/44660Google Scholar
Baltova, I. (1999). Multisensory language teaching in a multidimensional curriculum: The use of authentic Bimodal video in core French. The Canadian Modern Language Review, 56(1), 31–48. https://doi.org/10.3138/cmlr.56.1.31CrossRefGoogle Scholar
Bednarek, M. (2018). Language and television series. A linguistic approach to TV dialogue. Cambridge University Press.CrossRefGoogle Scholar
Bianchi, F., & Ciabattoni, T. (2008). Captions and subtitles in EFL learning: An investigative study in a comprehensive computer environment. In Baldry, A., Pavesi, M., & Taylor Torsello, C. (Eds.), From Didactas to Ecolingua (pp. 69–80). Edizioni Università di Trieste.Google Scholar
Bird, S. (2010). Effects of distributed practice on the acquisition of second language English syntax. Applied PsychoLinguistics, 31(4), 635–650. http://doi.org/10.1017/S0142716410000172CrossRefGoogle Scholar
Bird, S. A., & Williams, J. N. (2002). The effect of bimodal input on implicit and explicit memory: An investigation into the benefits of within-language subtitling. Applied Psycholinguistics, 23(4), 509–533. http://doi.org/10.1017/S0142716402004022CrossRefGoogle Scholar
Birulés-Muntané, J., & Soto-Faraco, S. (2016). Watching subtitled films can help learning foreign languages. PLoS One, 11(6), 1–10. https://doi.org/10.1371/journal.pone.0158409CrossRefGoogle ScholarPubMed
Bisson, M.-J., van Heuven, W. J. B., Conklin, K., & Tunney, R. J. (2014). Processing of native and foreign language subtitles in films: An eye tracking study. Applied Psycholinguistics, 35(2), 1–20. https://doi.org/10.1017/S0142716412000434CrossRefGoogle Scholar
Black, S. (2021). The potential benefits of subtitles for enhancing language acquisition and literacy in children: An integrative review of experimental research. Translation, Cognition & Behavior. [Advance online publication]. https://doi.org/10.1075/tcb.00051.blaCrossRefGoogle Scholar
Boers, F. (2021). Glossing and vocabulary learning. Language Teaching. [Advance online publication] https://doi.org/10.1017/S0261444821000252Google Scholar
Bollansée, L., Puimège, E., & Peters, E. (2021). ‘Watch out! Behind you is the enemy!’ An exploratory study into the relationship between extramural English and productive vocabulary knowledge. In Werner, V. & Tegge, F. (Eds.), Pop culture in language education (pp. 199–214). Routledge.Google Scholar
Borrás, I., & Lafayette, R. C. (1994). Effects of multimedia courseware subtitling on the speaking performance of college students of French. Modern Language Journal, 78(1), 61–75. https://doi.org/10.1111/j.1540-4781.1994.tb02015.xCrossRefGoogle Scholar
Caruana, S. (2021). An overview of audiovisual input as a means for foreign language acquisition in different contexts. Language and Speech, 64(4), 1018–1036. https://doi.org/10.1177/0023830920985897CrossRefGoogle ScholarPubMed
Charles, T. J., & Trenkic, D. (2015). Speech segmentation in a second language: The role of bi-modal input. In Gambier, Y., Caimi, A., & Mariotti, C. (Eds.), Subtitles and language learning: Principles, strategies, and practical experiences (pp. 173–198). Peter Lang.Google Scholar
Chen, Y.-R., Liu, Y.-T., & Todd, A. G. (2018). Transient but effective? Captioning and adolescent EFL learners’ spoken vocabulary acquisition. English Teaching and Learning, 42, 25–56. https://doi.org/10.1007/s42321-018-0002-8CrossRefGoogle Scholar
Cintrón-Valentín, M. C., & Garciá-Amaya, L. (2021). Investigating textual enhancement and captions in L2 grammar and vocabulary. An experimental study. Studies in Second Language Acquisition, 43(5), 1068–1093. https://doi.org/10.1017/S0272263120000492CrossRefGoogle Scholar
Cintrón Valentín, M. C., García-Amaya, L., & Ellis, N. C. (2019). Captioning and grammar learning in the L2 Spanish classroom. The Language Learning Journal, 47(4), 439–459. https://doi.org/10.1080/09571736.2019.1615978CrossRefGoogle Scholar
Cobb, T. (2007). Computing the vocabulary demands of L2 reading. Language Learning & Technology, 11(3), 38–63. http://dx.doi.org/10125/44117Google Scholar
Conklin, K., Pellicer-Sánchez, A., & Carrol, G. (2018). Eye-tracking: A guide for applied linguistics research. Cambridge University Press.CrossRefGoogle Scholar
Cross, J. (2011). Comprehending news videotexts: The influence of the visual content. Language Learning & Technology, 15(2), 44–68. http://dx.doi.org/10125/44251Google Scholar
Davies, M. (2021). The TV and movies corpora. Design, Construction, and use. International Journal of Corpus Linguistics, 26(1), 10–37. https://doi.org/10.1075/ijcl.00035.davCrossRefGoogle Scholar
deHaan, J., Reed, W. M., & Kuwada, K. (2010). The effect of interactivity with a music video game on second language vocabulary recall. Language Learning & Technology, 14(2), 74–94. http://dx.doi.org/10125/44215Google Scholar
De Wilde, V., Brysbaert, M., & Eyckmans, J. (2020). Learning English through out-of-school exposure. Which levels of language proficiency are attained and which types of input are important? Bilingualism, 23(1), 171–185. https://doi.org/10.1017/S1366728918001062CrossRefGoogle Scholar
Diao, Y., Chandler, P., & Sweller, J. (2007). The effect of written text on comprehension of spoken English as a foreign language. The American Journal of Psychology, 120(2), 237–261. https://doi.org/10.2307/20445397Google ScholarPubMed
Doherty, S., & Kruger, J. L. (2018). The development of eye tracking in empirical research on subtitling and captioning. In Dwyer, T., Perkins, C., Redmond, S., & Sita, J. (Eds.), Seeing into screens: Eye tracking and the moving image (pp. 46–64). Bloomsbury.Google Scholar
Durbahn, M., Rodgers, M., & Peters, E. (2020). The relationship between vocabulary and viewing comprehension. System, 88, 102166. https://doi.org/10.1016/j.system.2019.102166CrossRefGoogle Scholar
d'Ydewalle, G., & De Bruycker, W. (2007). Eye movements of children and adults while reading television subtitles. European Psychologist, 12(3), 196–205. https://doi.org/10.1027/1016-9040.12.3.196CrossRefGoogle Scholar
d'Ydewalle, G., & Gielen, I. (1992). Attention allocation with overlapping sound, image and text. In Rayner, K. (Ed.), Eye movements and visual cognition (pp. 415–427). Springer-Verlag.CrossRefGoogle Scholar
d'Ydewalle, G., Praet, C., Verfaillie, K., & Van Rensbergen, J. (1991). Watching subtitled television: Automatic reading behavior. Communication Research, 18, 650–666. https://doi.org/10.1177/009365091018005005CrossRefGoogle Scholar
d'Ydewalle, G., & Van de Poel, M. (1999). Incidental foreign-language acquisition by children watching subtitled television programs. Journal of Psycholinguistic Research, 28(3), 227–245.CrossRefGoogle Scholar
Elgort, I., Brysbaert, M., Stevens, M., & Van Assche, E. (2018). Contextual word learning during reading in a second language: An eye-movement study. Studies in Second Language Acquisition, 40(2), 341–366. https://doi.org/10.1017/S0272263117000109CrossRefGoogle Scholar
European Commission. (2019). Media use in the European Union. Retrieved from https://op.europa.eu/en/publication-detail/-/publication/c2fb9fad-db78-11ea-adf7-01aa75ed71a1/language-enGoogle Scholar
Feng, Y., & Webb, S. (2020). Learning vocabulary through reading, listening, and viewing. Studies in Second Language Acquisition, 42(3), 499–523. https://doi.org/10.1017/S0272263119000494CrossRefGoogle Scholar
Fievez, I., Montero Perez, M., Cornillie, F., & Desmet, P. (2020). Vocabulary learning through viewing captioned or subtitled videos and the role of learner- and word-related factors. Calico Journal, 37(3), 21–41. https://doi.org/10.1558/cj.39370CrossRefGoogle Scholar
Fievez, I., Montero Perez, M., Cornillie, F., & Desmet, P. (2021). Promoting incidental vocabulary learning through watching a French Netflix series with glossed captions. Computer Assisted Language Learning, [Advance online publication]. https://doi.org/10.1558/cj.39370CrossRefGoogle Scholar
Frumuselu, A. D. (2018). The implications of cognitive load theory and exposure to subtitles in English foreign language (EFL). Translation and Translanguaging in Multilingual Contexts, 4(1), 55–76. https://doi.org/10.1075/ttmc.00004.fruCrossRefGoogle Scholar
Frumuselu, A. D. (2019). A friend in need is a film indeed: Teaching colloquial expressions with subtitled television series. In Herrero, C. & Vanderschelden, I. (Eds.), Using film and media in the language classroom (pp. 92–107). Multilingual Matters.CrossRefGoogle Scholar
Frumuselu, A. D., De Maeyer, S., Donche, V., & Gutiérrez-Colon Plana, M. (2015). Television series inside the EFL classroom: Bridging the gap between teaching and learning informal language through subtitles. Linguistics and Education, 32B, 107–117. https://doi.org/10.1016/j.linged.2015.10.001CrossRefGoogle Scholar
Gambier, Y., Caimi, A., & Mariotti, C. (2015). Subtitles and language learning. Principles, strategies and practical experiences. Peter Lang.CrossRefGoogle Scholar
Gass, S., Winke, P., Isbell, D. R., & Ahn, J. (2019). How captions help people learn languages: A working-memory, eye-tracking study. Language Learning & Technology, 23(2), 84–104. https://doi.org/10125/44684Google Scholar
Ghia, E. (2012). Subtitling matters. New perspectives on subtitling and foreign language learning. Peter Lang.Google Scholar
Godfroid, A. (2020). Eye-tracking in second language acquisition and bilingualism. A research synthesis and methodological guide. Routledge.Google Scholar
Godfroid, A., Boers, F., & Housen, A. (2013). An eye for words. Studies in Second Language Acquisition, 35(03), 483–517. https://doi.org/10.1017/S0272263113000119CrossRefGoogle Scholar
Goldstein, B., & Driver, P. (2015). Language learning with digital video. Cambridge University Press.Google Scholar
González Fernández, B., & Schmitt, N. (2015). How much collocation knowledge do L2 learners have? The effects of frequency and amount of exposure. ITL, International Journal of Applied Linguistics, 166(1), 94–126. https://doi.org/10.1075/itl.166.1.03ferCrossRefGoogle Scholar
Guillory, H. (1998). The effects of keyword captions to authentic French video on learner comprehension. CALICO Journal, 15(1), 89–108. http://dx.doi.org/10.1558/cj.v15i1-3.89-108CrossRefGoogle Scholar
Herrero, C., & Vanderschelden, I. (2019). Using film and media in the language classroom. Multilingual Matters.Google Scholar
Hsieh, Y. (2020). Effects of video captioning on EFL vocabulary learning and listening comprehension. Computer Assisted Language Learning, 33(5–6), 567–589. https://doi.org/10.1080/09588221.2019.1577898CrossRefGoogle Scholar
Hu, M., & Nation, I. S. P. (2000). Unknown vocabulary density and reading comprehension. Reading in A Foreign Language, 13(1), 403–430.Google Scholar
Hulstijn, J. H. (2003). Incidental and intentional learning. In Doughty, C. & Long, M. H. (Eds.), The handbook of second language acquisition (pp. 349–381). Blackwell Publishing Inc.CrossRefGoogle Scholar
Jones, C., & Horák, T. (2014). Leave it out! The use of soap operas as models of spoken discourse in the ELT classroom. Journal of Language Teaching and Learning, 4(1), 1–14.Google Scholar
Kato, F., Spring, R., & Mori, C. (2016). Mutually beneficial foreign language learning: Creating meaningful interactions through video-synchronous computer-mediated communication. Foreign Language Annals, 49(2), 355–366. https://doi.org/10.1111/flan.1219CrossRefGoogle Scholar
King, J. (2002). Using DVD feature films in the EFL classroom. Computer Assisted Language Learning, 15(5), 509–523. https://doi.org/10.1076/call.15.5.509.13468CrossRefGoogle Scholar
Koolstra, C. M., & Beentjes, J. W. J. (1999). Children's vocabulary acquisition in a foreign language through watching subtitled television programs at home. Educational Technology Research and Development, 47(1), 51–60. https://doi.org/10.1007/BF02299476CrossRefGoogle Scholar
Kress, G., & Van Leeuwen, T. (2001). Multimodal discourse: The modes and media of contemporary communication. Arnold.Google Scholar
Kruger, J., Doherty, S., & Soto-Sanfiel, M. (2017). Original language subtitles: Their effects on the native and foreign viewer. Comunicar, 1, 23–32. https://doi.org/10.3916/C50-2017-02Google Scholar
Kruger, J., Szarkowska, A., & Krejtz, I. (2015). Subtitling on the moving image: An overview of eye-tracking studies. Refractory: A Journal of Entertainment Media, 25, 1–14.Google Scholar
Kruger, J. L., & Steyn, F. (2014). Subtitles and eye tracking: Reading and performance. Reading Research Quarterly, 49(1), 105–120. http://doi.org/10.1002/rrq.59CrossRefGoogle Scholar
Kusyk, M., & Sockett, G. (2012). From informal resource usage to incidental language acquisition: Language uptake from online television viewing in English. ASp, la revue du GERAS, 62, 45–65. https://doi.org/10.4000/asp.3104CrossRefGoogle Scholar
Laaser, W., & Toloza, E. A. (2017). The changing role of the educational video in higher distance education. International Review of Research in Open and Distance Learning, 18(2), 264–276. https://doi.org/10.19173/irrodl.v18i2.3067CrossRefGoogle Scholar
Laufer, B., & Ravenhorst-Kalovski, G. C. (2010). Lexical threshold revisited: Lexical text coverage, learners’ vocabulary size, and reading comprehension. 22(1), 15–30.Google Scholar
Lavaur, J.-M., & Bairstow, D. (2011). Languages on the screen: Is film comprehension related to the viewers’ fluency level and to the language in the subtitles? International Journal of Psychology, 46(6), 455–462. doi: 10.1080/00207594.2011.565343.CrossRefGoogle Scholar
Lee, M., & Révész, A. (2020). Promoting grammatical development through captions and textual enhancement in multimodal input-based tasks. Studies in Second Language Acquisition, 42(3), 1–27. https://doi.org/10.1017/S0272263120000108CrossRefGoogle Scholar
Lee, P.-J., Liu, Y.-T., & Tseng, W.-T. (2021). One size fits all? In search of the desirable caption display for second language learners with different caption reliance in listening comprehension. Language Teaching Research, 25(3), 400–430. https://doi.org/10.1177/1362168819856451CrossRefGoogle Scholar
Leveridge, A. N., & Yang, J. C. (2013). Testing learner reliance on caption supports in second language listening comprehension multimedia environments. ReCALL, 25(2), 199–214. http://doi.org/10.1017/S0958344013000074CrossRefGoogle Scholar
Leveridge, A. N., & Yang, J. C. (2014). Learner perceptions of reliance on captions in EFL multimedia listening comprehension. Computer Assisted Language Learning, 27(6), 545–559. https://doi.org/10.1080/09588221.2013.776968CrossRefGoogle Scholar
Liao, S., Kruger, J. L., & Doherty, S. (2020). The impact of monolingual and bilingual subtitles on visual attention, cognitive load, and comprehension. The Journal of Specialised Translation, 33, 70–98.Google Scholar
Lin, P. (2021). Developing an intelligent tool for computer-assisted formulaic language learning from YouTube videos. ReCALL. [Advance online publication] https://doi.org/10.1017/s0958344021000252CrossRefGoogle Scholar
Lin, P. M. S. (2014). Investigating the validity of internet television as a resource for acquiring L2 formulaic sequences. System, 42(1), 164–176. http://dx.doi.org/10.1016/j.system.2013.11.010CrossRefGoogle Scholar
Lin, P. M. S., & Siyanova-Chanturia, A. (2015). Internet television for L2 vocabulary learning. In Nunan, D. & Richards, J. C. R. (Eds.), Language learning beyond the classroom (pp. 149–158). Routledge.Google Scholar
Lindgren, E., & Muñoz, C. (2013). The influence of exposure, parents, and linguistic distance on young european learners’ foreign language comprehension. International Journal of Multilingualism, 10(1), 105–129. https://doi.org/10.1080/14790718.2012.679275CrossRefGoogle Scholar
Lwo, L., & Chia-Tzu Lin, M. (2012). The effects of captions in teenagers’ multimedia L2 learning. ReCALL, 24(2), 188–208. https://doi.org/10.1017/S0958344012000067CrossRefGoogle Scholar
Majuddin, E., Siyanova-Chanturia, A., & Boers, F. (2021). Incidental acquisition of multiword expressions through audio-visual materials. Studies in Second Language Acquisition, 43(5), 985–1008. https://doi.org/10.1017/S0272263121000036CrossRefGoogle Scholar
Mariotti, C. (2015). A survey on stakeholders’ perceptions of subtitles as a means to promote foreign language learning. In Gambier, Y., Caimi, A., & Mariotti, C. (Eds.), Subtitles and language learning. Principles, strategies and practical experiences (pp. 83–103). Peter Lang.Google Scholar
Markham, P., Peter, L., & McCarthy, T. (2001). The effects of native language vs. target language captions on foreign language students’ DVD video comprehension. Foreign Language Annals, 34(5), 439–445. https://doi.org/10.1111/j.1944-9720.2001.tb02083.xCrossRefGoogle Scholar
Matthews, J., Cheng, J., & O'Toole, J. M. (2014). Computer-mediated input, output and feedback in the development of L2 word recognition from speech. ReCALL, 27(3), 321–339. http://doi.org/10.1017/S0958344014000421CrossRefGoogle Scholar
Mayer, R. E. (2001). Multimedia learning. Cambridge University Press.CrossRefGoogle Scholar
Mayer, R. E., Fiorella, L., & Stull, A. (2020). Five ways to increase the effectiveness of instructional video. Educational Technology Research and Development, 68, 837–852. https://doi.org/10.1007/s11423-020-09749-6CrossRefGoogle Scholar
Mayer, R. E., Lee, H., & Peebles, A. (2014). Multimedia learning in a second language: A cognitive load perspective. Applied Cognitive Psychology, 28(5), 653–660. https://doi.org/10.1002/acp.3050CrossRefGoogle Scholar
Mirzaei, M., Meshgi, K., Akita, Y., & Kawahara, T. (2017). Partial and synchronized captioning: A new tool to assist learners in developing second language listening skill. ReCALL, 29(2), 178–199. doi:10.1017/S0958344017000039CrossRefGoogle Scholar
Mitterer, H., & McQueen, J. M. (2009). Foreign subtitles help but native-language subtitles harm foreign speech perception. PLoS One, 4(11), 4–8. https://doi.org/10.1371/journal.pone.0007785CrossRefGoogle ScholarPubMed
Mohd Jelani, N. A., & Boers, F. (2018). Examining incidental vocabulary acquisition from captioned video: Does test modality matter? ITL - International Journal of Applied Linguistics, 169(1), 169–190. https://doi.org/10.1075/itl.00011.jelCrossRefGoogle Scholar
Montero Perez, M. (2020). Incidental vocabulary learning through viewing video. The role of vocabulary knowledge and working memory. Studies in Second Language Acquisition, 42(4), 749–773. doi:10.1017/S0272263119000706CrossRefGoogle Scholar
Montero Perez, M., Peters, E., Clarebout, G., & Desmet, P. (2014a). Effects of captioning on video comprehension and incidental vocabulary learning. Language Learning & Technology, 18(1), 118–141. https://doi.org/10125/44357Google Scholar
Montero Perez, M., Peters, E., & Desmet, P. (2014b). Is less more ? Effectiveness and perceived usefulness of keyword and full captioned video for L2 listening comprehension. ReCALL, 26(1), 21–43. https://doi.org/10.1017/S0958344013000256CrossRefGoogle Scholar
Montero Perez, M., Peters, E., & Desmet, P. (2015). Enhancing vocabulary learning through captioned video: An eye-tracking study. Modern Language Journal, 99(2), 308–328. https://doi.org/10.1111/modl.12215CrossRefGoogle Scholar
Montero Perez, M., Peters, E., & Desmet, P. (2018). Vocabulary learning through viewing video: The effect of two enhancement techniques. Computer Assisted Language Learning, 31(1–2), 1–26. https://doi.org/10.1080/09588221.2017.1375960CrossRefGoogle Scholar
Montero Perez, M., & Rodgers, M. (2019). Video and language learning. The Language Learning Journal, 47(4), 403–406. https://doi.org/10.1080/09571736.2019.1629099CrossRefGoogle Scholar
Montero Perez, M., Van Den Noortgate, W., & Desmet, P. (2013). Captioned video for L2 listening and vocabulary learning: A meta-analysis. System, 41(3), 720–739. https://doi.org/10.1016/j.system.2013.07.013CrossRefGoogle Scholar
Mora, J., & Cerviño-Povedano, E. (2019). The effects of bimodal L2 input on the processing of function words by Spanish EFL learners: An eye-tracking study. In Herrero, C. & Vanderschelden, I. (Eds.), Using film and media in the language classroom (pp. 76–91). Multilingual Matters.CrossRefGoogle Scholar
Muñoz, C. (2017). The role of age and proficiency in subtitle reading. An eye-tracking study. System, 67, 77–86. https://doi.org/10.1016/j.system.2017.04.015CrossRefGoogle Scholar
Muñoz, C., Cadierno, T., & Casas, I. (2018). Different starting points for English language learning: A comparative study of Danish and Spanish young learners. Language Learning, 68(4), 1076–1109. https://doi.org/10.1111/lang.12309CrossRefGoogle Scholar
Muñoz, C., Pujadas, G., & Pattemore, A. (2021). Audio-visual input for learning L2 vocabulary and grammatical constructions. Second Language Research. [Advance online publication]. https://doi.org/10.1177/02676583211015797CrossRefGoogle Scholar
Nakanishi, T. (2015) A meta-analysis of extensive reading research. TESOL Quarterly, 49(1), 6–37. https://doi.org/10.1002/tesq.157CrossRefGoogle Scholar
Nation, P. (2007). The four strands. Innovation in Language Learning and Teaching, 1(1), 1–13. https://doi.org/10.2167/illt039.0CrossRefGoogle Scholar
Neuman, S. B., & Koskinen, P. (1992). Captioned television as comprehensible input: Effects of incidental word learning from context for language minority students. Reading Research Quarterly, 27, 95–106. https://doi.org/10.2307/747835CrossRefGoogle Scholar
Paivio, A. (1986). Mental representations: A dual coding approach. Oxford University Press.Google Scholar
Pattemore, A., & Muñoz, C. (2020). Learning L2 constructions from captioned audio-visual exposure: The effect of learner-related factors. System, 93, 102303. https://doi.org/10.1016/j.system.2020.102303CrossRefGoogle Scholar
Perego, E., Del Missier, F., Porta, M., & Mosconi, M. (2010). The cognitive effectiveness of subtitle processing. Media Psychology, 13(3), 243–272. https://doi.org/10.1080/15213269.2010.502873CrossRefGoogle Scholar
Peters, E. (2018). The effect of out-of-class exposure to English language media on learners’ vocabulary knowledge. ITL - International Journal of Applied Linguistics, 169(1), 142–168. https://doi.org/10.1075/itl.00010.petCrossRefGoogle Scholar
Peters, E. (2019). The effect of imagery and on-screen text on foreign language vocabulary learning from audio-visual input. TESOL Quarterly, 53(4), 1008–1032. https://doi.org/10.1002/tesq.531.CrossRefGoogle Scholar
Peters, E. (2020). Factors affecting the learning of single-word items. In Webb, S. (Ed.), The Routledge handbook of vocabulary studies (pp. 125–142). Routledge.Google Scholar
Peters, E., Heynen, E., & Puimège, E. (2016). Learning vocabulary through audio-visual input: The differential effect of L1 subtitles and captions. System, 63, 134–148. https://doi.org/10.1016/j.system.2016.10.002CrossRefGoogle Scholar
Peters, E., & Muñoz, C. (2020). Introduction to the special issue. Language learning from multimodal input. Studies in Second Language Acquisition, 42(3), 489–497. https://doi.org/10.1017/S0272263120000212Google Scholar
Peters, E., Noreillie, A., Heylen, K., Bulté, B., & Desmet, P. (2019). The impact of instruction and out-of-school exposure to foreign language input on learners’ vocabulary knowledge in two languages. Language Learning, 69(3), 747–782. https://doi.org/10.1111/lang.12351zCrossRefGoogle Scholar
Peters, E., & Webb, S. (2018). Incidental vocabulary acquisition through viewing L2 television and factors that affect learning. Studies in Second Language Acquisition, 40(3), 551–577. https://doi.org/10.1017/S0272263117000407CrossRefGoogle Scholar
Price, K. (1983). Closed-captioned TV: An untapped resource. MATSOL Newsletter, 12(2), 1–8.Google Scholar
Puimège, E., & Peters, E. (2019a). Learners’ English vocabulary knowledge prior to formal instruction: The role of learner-related and word-related variables. Language Learning, 69(4), 943–977. https://doi.org/10.1111/lang.12364CrossRefGoogle Scholar
Puimège, E., & Peters, E. (2019b). Learning L2 vocabulary from audio-visual input: An exploratory study into incidental learning of single words and formulaic sequences. The Language Learning Journal, 47(4), 424–438. https://doi.org/10.1080/09571736.2019.1638630CrossRefGoogle Scholar
Puimège, E., & Peters, E. (2020). Learning formulaic sequences through viewing L2 television and factors that affect learning. Studies in Second Language Acquisition, 42(3), 525–549. https://doi.org/10.1017/s027226311900055xCrossRefGoogle Scholar
Pujadas, G., & Muñoz, C. (2019). Extensive viewing of captioned and subtitled TV series: A study of L2 vocabulary learning by adolescents. The Language Learning Journal, 47(4), 479–496. https://doi.org/10.1080/09571736.2019.1616806CrossRefGoogle Scholar
Pujadas, G., & Muñoz, C. (2020). Examining adolescent EFL learners’ TV viewing comprehension through captions and subtitles. Studies in Second Language Acquisition, 42(3), 1–25. https://doi.org/10.1017/S0272263120000042CrossRefGoogle Scholar
Pujolà, J.-T. (2002). CALLing for help: Researching language learning strategies using help facilities in a web-based multimedia program. ReCALL, 14(2), 235–262. https://doi.org/10.1017/S0958344002000423CrossRefGoogle Scholar
Quaglio, P. (2010) Television dialogue. The sitcom friends vs. Natural conversation. John Benjamins.Google Scholar
Reinders, H., & Benson, P. (2017). Research agenda: Language learning beyond the classroom. Language Teaching, 50(4), 561–578. https://doi.org/10.1017/S0261444817000192CrossRefGoogle Scholar
Rodgers, M. (2016). Extensive listening and viewing: The benefits of audiobooks and television. The European Journal of Applied Linguistics and TEFL, 5(2), 43–57.Google Scholar
Rodgers, M. (2018). The images in television programs and the potential for learning unknown words. ITL - International Journal of Applied Linguistics, 169(1), 191–211. https://doi.org/10.1075/itl.00012.rodCrossRefGoogle Scholar
Rodgers, M., & Webb, S. (2011). Narrow viewing: The vocabulary in related television programs. TESOL Quarterly, 45(4), 689–717. http://doi.org/10.5054/tq.201CrossRefGoogle Scholar
Rodgers, M., & Webb, S. (2017). The effects of captions on EFL learners ‘ comprehension of English-language television programs. CALICO Journal, 34(1), 20–39. https://doi.org/10.1558/cj.29522CrossRefGoogle Scholar
Rodgers, M., & Webb, S. (2020). Incidental vocabulary learning through viewing television. ITL - International Journal of Applied Linguistics, 171(2), 191–220. https://doi.org/10.1075/itl.18034.rodCrossRefGoogle Scholar
Rose, K. R. (2001). Compliments and compliment responses in film: Implications for pragmatics research and language teaching. IRAL - International Review of Applied Linguistics in Language Teaching, 39(4), 309–326. https://doi.org/10.1515/iral.2001.007CrossRefGoogle Scholar
Rost, M. (2002). Teaching and researching listening. Pearson Education Limited.Google Scholar
Rost, M. (2014). Developing listening fluency in asian EFL settings. In Muller, T., Adamson, J., Shigeo Brown, P., & Herder, S. (Eds.), Exploring EFL fluency in Asia (pp. 281–296). Palgrave Macmillan.Google Scholar
Ruck, J. (2020). Elementary-level learners’ engagement with multimodal resources in two audio-visual genres. The Language Learning Journal. [Advance online publication] https://doi.org/10.1080/09571736.2020.1752291CrossRefGoogle Scholar
Satar, H. M. (2016). Meaning-making in online language learner interactions via desktop videoconferencing. ReCALL, 28(3), 305–325. https://doi.org/10.1017/S0958344016000100CrossRefGoogle Scholar
Sauro, S., & Zourou, K. (2019). What are the digital wilds? Language Learning & Technology, 23(1), 1–7. https://doi.org/10125/44666Google Scholar
Scheffler, P., Jones, C., & Domińska, A. (2021). The Peppa Pig television series as input in pre-primary EFL instruction: A corpus-based study. International Journal of Applied Linguistics, 31(1), 3–17. https://doi.org/10.1111/ijal.12298CrossRefGoogle Scholar
Serafini, F. (2012). Expanding the four resources model: Reading visual and multimodal texts. Pedagogies, 7(2), 150–164. https://doi.org/10.1080/1554480X.2012.656347CrossRefGoogle Scholar
Sherman, J. (2010). Using authentic video in the language classroom. Cambridge University Press.Google Scholar
Sockett, G. (2012). From the cultural hegemony of English to online informal learning: Cluster frequency as an indicator of relevance in authentic documents. ASp, la revue du GERAS, 60, 5–20. https://doi.org/10.4000/asp.2469Google Scholar
Sockett, G., & Kusyk, M. (2015). Online informal learning of English: Frequency effects in the uptake of chunks of language from participation in web-based activities. In Cadierno, T. & Eskildsen, S. W. (Eds.), Usage-based perspectives on second language learning (pp. 153–177). Mouton De Gruyter.CrossRefGoogle Scholar
Sokoli, S., & Zabalbeascoa, P. (2019). Audio-visual activities and multimodal resources for foreign language learning. In Herrero, C. & Vanderschelden, I. (Eds.), Using film and media in the language classroom (pp. 170–187). Multilingual Matters.CrossRefGoogle Scholar
Suárez, M. M., & Gesa, F. (2019). Learning vocabulary with the support of sustained exposure to captioned video: Do proficiency and aptitude make a difference? The Language Learning Journal, 47(4), 497–517. https://doi.org/10.1080/09571736.2019.1617768CrossRefGoogle Scholar
Sweller, J. (2005). The redundancy principle in multimedia learning. In Mayer, R. E. (Ed.), The Cambridge handbook of multimedia learning (pp. 159–167). Cambridge University Press.CrossRefGoogle Scholar
Sydorenko, T. (2010). Modality of input and vocabulary acquisition. Language Learning & Technology, 14(2), 50–73. http://dx.doi.org/10125/44214Google Scholar
Szarkowska, A., Díaz Cintas, J., & Gerber-Morón, O. (2021). Quality is in the eye of the stakeholders: What do professional subtitlers and viewers think about subtitling? Universal Access in the Information Society, 20, 661–675. https://doi.org/10.1007/s10209-020-00739-2CrossRefGoogle Scholar
Talaván, N., & Avila-Cabrera, (2015). First insights into the combination of dubbing and subtitling as L2 didactic tools. In Gambier, Y., Caimi, A., & Mariotti, C. (Eds.), Subtitles and language learning. Principles, strategies and practical experiences. Peter Lang.Google Scholar
Taylor, G. (2005). Perceived processing strategies of students watching captioned video. Foreign Language Annals, 38, 422–427. https://doi.org/10.1111/j.1944-9720.2005.tb02228.xCrossRefGoogle Scholar
Teng, F. (2019a). Maximizing the potential of captions for primary school ESL students’ comprehension of English-language videos. Computer Assisted Language Learning, 32(7), 665–691. https://doi.org/10.1080/09588221.2018.1532912CrossRefGoogle Scholar
Teng, F. (2019b). Incidental vocabulary learning for primary school students: The effects of L2 caption type and word exposure frequency. The Australian Educational Researcher, 46(1), 113–136. https://doi.org/10.1007/s13384-018-0279-6CrossRefGoogle Scholar
Teng, F. (2019c). The effects of video caption types and advance organizers on incidental L2 collocation learning. Computers and Education, 142, 103655. https://doi.org/10.1016/j.compedu.2019.103655CrossRefGoogle Scholar
Teng, F. (2020). Vocabulary learning through videos: Captions, advance-organizer strategy, and their combination. Computer Assisted Language Learning, https://doi.org/10.1080/09588221.2020.1720253CrossRefGoogle Scholar
Teng, F. (2021). Language learning through captioned videos: Incidental vocabulary acquisition. Routledge.Google Scholar
Terantino, J. M. (2011). Emerging technologies YouTube for foreign languages: You have to see this video. Language Learning & Technology, 15(1), 10–16. http://dx.doi.org/10125/44231Google Scholar
The Douglas Fir Group. (2016). A transdisciplinary framework for SLA in a multilingual world. Modern Language Journal, 100(Supplement), 19–47. https://doi.org/10.1111/modl.12301CrossRefGoogle Scholar
Tragant, E., Muñoz, C., & Spada, N. (2016). Maximizing young learners’ input: An intervention program. Canadian Modern Language Review, 72(2), 234–257. https://doi.org/10.3138/cmlr.2942CrossRefGoogle Scholar
Uchihara, T., Webb, S., & Yanagisawa, A. (2019). The effects of repetition on incidental vocabulary learning; A meta-analysis of correlational studies. Language Learning, 69(3), 559–599. https://doi.org/10.1111/lang.12343CrossRefGoogle Scholar
Vandergrift, L. (2004). Listening to learn or learning to listen? Annual Review of Applied Linguistics, 24, 3–25. https://doi.org/10.1017/S0267190504000017CrossRefGoogle Scholar
Vanderplank, R. (1988). The value of teletext sub-titles in language learning. English Language Teaching Journal, 42(4), 272–281. https://doi.org/10.1093/elt/42.4.272CrossRefGoogle Scholar
Vanderplank, R. (1993). A very verbal medium: Language learning through closed captions. TESOL Journal, 3(1), 10–14.Google Scholar
Vanderplank, R. (2010). Déjà vu? A decade of research on language laboratories, television and video in language learning. Language Teaching, 43(1), 1–37. https://doi.org/10.1017/S0261444809990267CrossRefGoogle Scholar
Vanderplank, R. (2016a). Captioned media in foreign language learning and teaching. Palgrave MacMillan.CrossRefGoogle Scholar
Vanderplank, R. (2016b). ‘Effects of’ and ‘effects with’ captions: How exactly does watching a TV programme with same- language subtitles make a difference to language learners? Language Teaching, 49(2), 235–250. https://doi.org/10.1017/S0261444813000207CrossRefGoogle Scholar
Vanderplank, R. (2019). ‘Gist watching can only take you so far’: Attitudes, strategies and changes in behaviour in watching films with captions. The Language Learning Journal, 47(4), 407–423. https://doi.org/10.1080/09571736.2019.1610033CrossRefGoogle Scholar
Vanderplank, R. (2020). Video and informal language learning. In Dressman, M. & Sadler, R. W. (Eds.), The handbook of informal language learning (pp. 181–201). Wiley-Blackwell.Google Scholar
Van Lommel, S., Laenen, A., & d'Ydewalle, G. (2006). Foreign grammar acquisition while watching subtitled television programs. British Journal of Educational Psychology, 76, 243–258. https://doi.org/10.1348/000709905X38946CrossRefGoogle Scholar
Verspoor, M. H., de Bot, K., & van Rein, E. (2011). English as a foreign language. The role of out-of-school language input. In De Houwer, A. & Wilton, A. (Eds.), English in Europe today. Sociocultural and educational perspectives (pp. 147–166). John Benjamins.CrossRefGoogle Scholar
Vulchanova, M., Aurstad, L. M. G., Kvitnes, I. E. N., & Eshuis, H. (2015). As naturalistic as it gets: Subtitles in the English classroom in Norway. Frontiers in Psychology, 5, 1–10. https://doi.org/10.3389/fpsyg.2014.01510CrossRefGoogle ScholarPubMed
Wang, Y. (2012). Learning L2 vocabulary with American TV drama: From the learner's perspective. English Language Teaching, 5(8), 217–225. doi:10.5539/elt.v5n8p217CrossRefGoogle Scholar
Wang, Y. (2019). Effects of L1/L2 captioned TV programs on students’ vocabulary learning and comprehension. CALICO Journal, 36(3), 204–224. https://doi.org/10.1558/cj.36268CrossRefGoogle Scholar
Webb, S. (2010). Pre-learning low-frequency vocabulary in second language television programmes. Language Teaching Research, 14(4), 501–515. http://doi.org/10.1177/1362168810375371CrossRefGoogle Scholar
Webb, S. (2015). Extensive viewing: Language learning through watching television. In Nunan, D. & Richards, J. C. (Eds.), Language learning beyond the classroom (pp. 159–168). Routledge.Google Scholar
Webb, S. (2020). Incidental vocabulary learning. In Webb, S. (Ed.), The Routledge handbook of vocabulary studies (pp. 225–239). Routledge.Google Scholar
Webb, S., & Chang, A. C.-S. (2015). How does prior word knowledge affect vocabulary learning progress in an extensive reading program? Studies in Second Language Acquisition, 37(4), 651–675. https://doi.org/10.1017/S0272263114000606CrossRefGoogle Scholar
Webb, S., & Rodgers, M. (2009a). The lexical coverage of movies. Applied Linguistics, 30(3), 407–427. https://doi.org/10.1093/applin/amp010CrossRefGoogle Scholar
Webb, S., & Rodgers, M. (2009b). Vocabulary demands of television programs. Language Learning, 59(2), 335–366. https://doi.org/10.1111/j.1467-9922.2009.00509.xCrossRefGoogle Scholar
Werner, V. (2020). TV discourse, grammaticality, and language awareness. TESL-EJ, 24(3), 1–23.Google Scholar
Winke, P., Gass, S., & Sydorenko, T. (2010). The effects of captioning videos used for foreign language listening activities. Language Learning & Technology, 14(1), 65–86. http://dx.doi.org/10125/44203Google Scholar
Winke, P., Sydorenko, T., & Gass, S. (2013). Factors influencing the use of captions by foreign language learners: An Eye- tracking study. Modern Language Journal, 97(1), 254–275. https://doi.org/10.1111/j.1540-4781.2013.01432.xCrossRefGoogle Scholar
Wisniewska, N., & Mora, J. C. (2020). Can captioned video benefit second language pronunciation? Studies in Second Language Acquisition, 42(3), 1–26. https://doi.org/10.1017/S0272263120000029CrossRefGoogle Scholar
Wong, K. M., & Samudra, P. G. (2019). L2 vocabulary learning from educational media: Extending dual-coding theory to dual-language learners. Computer Assisted Language Learning, 34(8), 1182–1204. https://doi.org/10.1080/09588221.2019.1666150Google Scholar
Yeldham, M. (2018). Viewing L2 captioned videos: What's in it for the listener? Computer Assisted Language Learning, 30(8), 864–883. https://doi.org/10.1080/09588221.2017.1406956Google Scholar