Skip to main content Accessibility help

We use cookies to distinguish you from other users and to provide you with a better experience on our websites. Close this message to accept cookies or find out how to manage your cookie settings.

Close cookie message
×
Hostname: page-component-78c5997874-s2hrs Total loading time: 0 Render date: 2024-11-02T21:34:42.904Z Has data issue: false hasContentIssue false

29 - Multimedia Learning in Second Language Acquisition

Published online by Cambridge University Press:  05 June 2012

By
Jan L. Plass  and
Linda C. Jones
Edited by
Richard Mayer
Jan L. Plass
Affiliation:
New York University
Linda C. Jones
Affiliation:
University of Arkansas
Richard Mayer
Affiliation:
University of California, Santa Barbara
Get access

Summary

Abstract

In this chapter, we discuss research on second-language acquisition with multimedia. We propose a model of cognitive processing in second-language acquisition that is based on interactionist models and on a cognitive theory of multimedia learning (CTML). For each of the major phases in this model, we discuss the cognitive processing involved, describe how multimedia can be used to support these processes, and report what the research says about the effectiveness of such multimedia support. We discuss limitations of existing research, derive implications for cognitive theory as well as for designers of instructional multimedia materials for second-language acquisition, and suggest directions for future research.

What Is Second-Language Acquisition with Multimedia?

Introduction

The use of a language – whether first or second – has as its goal the communication of ideas, maintenance of social relations, and creation of discourse, all of which require the development of several core competencies. These include input competencies, such as listening and reading, and output competencies, such as speaking and writing, and entail the process of receiving (input), attending to (interaction), and assigning meaning (output) to verbal (aural or written) and/or visual stimuli. They also include competencies in communicating in the target language, which includes an understanding of the cultural and situational context of such communication.

Type
Chapter
Information
The Cambridge Handbook of Multimedia Learning , pp. 467 - 488
Publisher: Cambridge University Press
Print publication year: 2005

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

References

Al-Seghayer, K. (2001). The effect of multimedia annotation modes on L2 vocabulary acquisition: A comparative study. Language Learning and Technology, 5(1), 202–232Google Scholar
Amon, E., Muyskens, J. A., & Omaggio Hadley, A. C. (2000). Vis à Vis, (2nd ed.) [Computer software, CD-ROM]. Boston: McGraw-HillGoogle Scholar
Atkinson, D. (2003). Toward a sociocognitive approach to second language acquisition. The Modern Language Journal, 86, 525–545CrossRefGoogle Scholar
Ausubel, D. (1968). Educational psychology: A cognitive view. New York: Holt, Rinehart, & WinstonGoogle Scholar
Bacon, S. (1992). Authentic listening in Spanish: How learners adjust their strategies to the difficulty of the input. Hispania, 75, 398–411CrossRefGoogle Scholar
Bernstein, J., Najimi, A., & Ehsani, F. (1999). Subarashii: Encounters in Japanese Spoken Language Education. CALICO Journal, 17, 361–384Google Scholar
Borras, I., & Lafayette, R. C. (1994). Effects of multimedia courseware subtitling on the speaking performance of college students of French. The Modern Language Journal, 78(1), 61–75CrossRefGoogle Scholar
Brett, P. (1995). Multimedia for listening comprehension: The design of a multimedia-based resource for developing listening skills. System, 23, 77–85CrossRefGoogle Scholar
Brett, P. (1997). A comparative study of the effects of the use of multimedia on listening comprehension. System, 25, 39–53CrossRefGoogle Scholar
Brown, C. (1993). Factors affecting the acquisition of vocabulary: Frequency and saliency of words. In Huckin, T., Haynes, M., & Coady, J. (Eds.), Second language reading and vocabulary learning (pp. 263–286). Norwood, NJ: AblexGoogle Scholar
Canale, M., & Swain, M. (1980). Theoretical bases of communicative approaches to second language teaching and testing. Applied Linguistics, 1(1), 1–47CrossRefGoogle Scholar
Cariana, R. B., & Lee, D. (2001). The effects of recognition and recall study tasks with feedback in a computer-based vocabulary lesson. Educational Technology Research and Development, 49(3), 23–36CrossRefGoogle Scholar
Chamot, A. (1995). Learning strategies and listening comprehension. In Mendelsohn, D. J. & Rubin, J., (Eds.), A guide for the teaching of second language listening (pp. 13–30). San Diego: Dominie PressGoogle Scholar
Chamot, A., & Küpper, L. (1989). Learning strategies in foreign language instruction. Foreign Language Annals, 22, 13–24CrossRefGoogle Scholar
Channell, J. (1988). Psycholinguistic considerations in the study of L2 vocabulary acquisition. In Carter, R. & McCarthy, M. (Eds.), Vocabulary and language teaching (pp. 83–96). New York: LongmanGoogle Scholar
Chapelle, C. (1997). CALL in the year 2000: Still in search of research paradigms?Language Learning and Technology, 1(1), 19–43Google Scholar
Chapelle, C. (1998). Multimedia call: Lessons to be learned from research on instructed SLA. Language Learning and Technology, 2(1), 22–34Google Scholar
Chomsky, N. (1957). Syntactic structures. The Hague, The Netherlands: MoutonGoogle Scholar
Chun, D. M. (2001). L2 reading on the web: Strategies for accessing information in hypermedia. Computer Assisted Language Learning, 14(5), 367–403CrossRefGoogle Scholar
Chun, D. M., & Plass, J. L. (1996a). Effects of multimedia annotations on vocabulary acquisition. The Modern Language Journal, 80, 183–198CrossRefGoogle Scholar
Chun, D. M., & Plass, J. L. (1996b). Facilitating reading comprehension with multimedia. System, 24, 503–519CrossRefGoogle Scholar
Chun, D. M., & Plass, J. L. (1998). Ciberteca [Computer software, CD–ROM]. New York: St. Martin's PressGoogle Scholar
Clark, R. E. (1983). Reconsidering Research on Learning from Media. Review of Educational Research, 53, 445–459CrossRefGoogle Scholar
Craik, F., & Lockhart, R. (1972). Levels of processing: A framework for memory research. Journal of Verbal Learning and Verbal Behavior, 11, 671–684CrossRefGoogle Scholar
Davis, J. N., & Lyman-Hager, M. A. (1997). Computers and L2 reading: Student performance, Student attitudes. Foreign Language Annals, 30(1), 58–72CrossRefGoogle Scholar
Deno, S. L. (1968). Effects of words and pictures as stimuli in learning language equivalents. Journal of Educational Psychology, 59(3), 202–206CrossRefGoogle ScholarPubMed
Ridder, I. (2002). Visible or invisible links: Does the highlighting of hyperlinks affect incidental vocabulary learning, text comprehension, and the reading process?Language Learning and Technology, 6(1), 123–146Google Scholar
Doughty, C. (1991). Second language instruction does make a difference: Evidence from an empirical study of SL relativization. Studies in Second Language Acquisition, 13, 431–469CrossRefGoogle Scholar
Duquette, L., & Painchaud, G. (1996). A Comparison of vocabulary acquisition in audio and video contexts. The Canadian Modern Language Review, 54(1), 143–172CrossRefGoogle Scholar
Ellis, R. (1997). SLA research and language teaching. Oxford, England: Oxford University PressGoogle Scholar
Faerch, C., & Kaspar, G. (1986). The role of comprehension in second-language learning. Applied Linguistics, 7, 257–274CrossRefGoogle Scholar
Feyten, C. (1991). The power of listening ability: An overlooked dimension in language acquisition. The Modern Language Journal, 75, 174–180CrossRefGoogle Scholar
Fischer, R., & Farris, M. (1995). Instructional basis of Libra. IALL Journal of Language Learning Technologies, 28(1), 29–90Google Scholar
Gass, S. (1997). Input, interaction, and the second language learner. Mahwah, NJ: Lawrence Erlbaum Associates PublishersGoogle Scholar
Glover, J. A. (1989). The “testing” phenomenon: Not gone but nearly forgotten. Journal of Educational Psychology, 81(3), 392–399CrossRefGoogle Scholar
Grace, C. (1998). Retention of word meanings inferred from context and sentence-level translations: Implications for the design of beginning-level CALL software. The Modern Language Journal, 82(4), 533–544CrossRefGoogle Scholar
Hanley, J. E., & Cole, S. P. (1995). A comparison study of two advance organizers for introducing beginning foreign language students to video. The Modern Language Journal, 79(3), 387–395Google Scholar
Heining-Boynton, A. L., Cowell, G. S., & Torres-Quiñones, S. S. (1999). ¡Atrévete! [Computer software, CD-ROM]. Fort Worth, TX: HarcourtGoogle Scholar
Hernandez, S. S. (2004). The effects of video and captioned text and the influence of verbal and spatial abilities on second language listening comprehension in a multimedia environment. Unpublished doctoral dissertation, New York University
Herron, C. (1994). An investigation of the effectiveness of using an advance organizer to introduce video in the foreign language classroom. The Modern Language Journal, 78(2), 190–198CrossRefGoogle Scholar
Herron, C. (1995). A comparison study of the effects of video-based versus text-based instruction in the foreign language classroom. The French Review, 68(5), 775–795Google Scholar
Herron, C., Dubreil, S., Cole, S., & Corrie, C. (2000). Using instructional video to teach culture to beginning foreign language students. CALICO Journal, 17, 395–429Google Scholar
Herron, C. A., Hanley, J. E. B., & Cole, S. P. (1995). A comparison study of two advance organizers for introducing beginning foreign language students to video. The Modern Language Journal, 79(3), 387–395CrossRefGoogle Scholar
Herron, C. A., York, H., & Cole, S. P., & Linden, P. (1998). A comparison study of student retention of foreign language video: Declarative versus interrogative advance organizer. The Modern Language Journal, 82(2), 237–247CrossRefGoogle Scholar
Hulstijn, J. (1992). Retention of inferred and given word meanings: Experiments in incidental vocabulary learning. In Arnaud, P. J. & Bejoint, H. (Eds.), Vocabulary and applied linguistics (pp. 113–125). London: MacmillanGoogle Scholar
Hulstijn, J., Hollander, M., & Greidanus, T. (1996). Incidental vocabulary learning by advanced foreign language students: The influence of marginal glosses, dictionary use, and reoccurrence of words. The Modern Language Journal, 80(3), 327–339CrossRefGoogle Scholar
Hymes, D. (1972). On communicative competence. In Pride, J. B. & Holmes, J. (Eds.), Sociolinguistics: Selected readings (pp. 269–293). Harmondsworth, England: PenguinGoogle Scholar
Jensen, E. D., & Vinther, T. (2003). Exact repetition as input enhancement in second language acquisition. Language Learning, 53(3), 373–428CrossRefGoogle Scholar
Johnson-Laird, P. N. (1988). The computer and the mind. Cambridge, MA: Harvard University PressGoogle Scholar
Joiner, E. (1986). Listening in the foreign language. In Wing, Barbara (Ed.), Northeast Conference reports: Northeast Conference on the Teaching of Foreign Languages (pp. 43–70). Carlisle, PA: Northeastern ConferenceGoogle Scholar
Joiner, E. (1997). Teaching listening: How technology can help. In Bush, M. & Terry, R. (Eds.), Technology-enhanced language learning (pp. 77–120). Lincolnwood, IL: National Textbook CompanyGoogle Scholar
Jones, L. C. (2001). Listening comprehension in multimedia learning: An extension of the generative theory of multimedia learning. Dissertation Abstracts International Section A: Humanities and Social Sciences, 62(2-A), 538Google Scholar
Jones, L. C. (2004). Testing L2 vocabulary recognition and recall using pictorial and written test items. Language Learning and Technology, 8(3), 122–143Google Scholar
Jones, L. C., & Plass, J. L. (2002). Supporting listening comprehension and vocabulary acquisition in French with multimedia annotations. The Modern Language Journal, 86(4), 546–561CrossRefGoogle Scholar
Just, M. A., & Carpenter, P. A. (1992). A capacity theory of comprehension: Individual differences in working memory. Psychological Review, 99, 122–149CrossRefGoogle ScholarPubMed
Kellogg, G. S., & Howe, M. J. (1971). Using words and pictures in foreign language learning. Alberta Journal of Educational Research, 17(2), 89–94Google Scholar
Kern, R. (1995). Restructuring classroom interaction with networked computers: Effects on quantity and characteristics of language production. The Modern Language Journal, 79(4), 457–476CrossRefGoogle Scholar
Kern, R., & Warschauer, M. (2000). Theory and practice of network-based language teaching. In Warschauer, M., & Kern, R. (Eds.), Networked-based language teaching: Concepts and Practice (pp. 1–19). New York: Cambridge University PressGoogle Scholar
Kim, M. (2002). The use of the computer in developing L2 reading comprehension: Literature review and its implications. (ERIC Document Reproduction Service No. ED472671)
Kintsch, W. (1998). Comprehension. A paradigm for cognition. Cambridge, UK: Cambridge University PressGoogle Scholar
Kost, C. R., Foss, P., & Lenzini, J. J. (1999). Textual and pictorial glosses: Effectiveness on incidental vocabulary growth when reading in a foreign language. Foreign Language Annals, 32, 89–113CrossRefGoogle Scholar
Krashen, S. (1982). Principles and practice in second language acquisition. New York: PergamonGoogle Scholar
Krashen, S. (1988). Second language acquisition and second language learning. New York: Prentice HallGoogle Scholar
Larsen-Freeman, D., & Long, M. (1991). An introduction to second language acquisition research. London: LongmanGoogle Scholar
Laufer, B., & Hill, M. (2000). What lexical information do L2 learners select in a CALL dictionary and how does it affect word retention?Language Learning & Technology, 3(2), 58–76Google Scholar
Lawless, K. A., & Brown, S. W. (1997). Multimedia learning environments: Issues of learner control and navigation. Instructional Science, 25(2), 117–131CrossRefGoogle Scholar
Lee, L. (1998). Going beyond classroom learning: Acquiring cultural knowledge via on-line newspapers and intercultural exchanges via on-line chatrooms. CALICO Journal, 16, 101–121CrossRefGoogle Scholar
Leutner, D., & Plass, J. L. (1998). Measuring learning styles with questionnaires versus direct observation of preferential choice behavior in authentic learning situations: The Visualizer/Verbalizer Behavior Observation Scale (VV–BOS). Computers in Human Behavior, 14, 543–557CrossRefGoogle Scholar
Liu, M., & Reed, W. M. (1995). The effect of hypermedia assisted instruction on second language learning. Journal of Educational Computing Research, 12(2), 159–175CrossRefGoogle Scholar
Lomicka, L. L. (1998). “To gloss or not to gloss”: An investigation of reading comprehension online. Language Learning and Technology, 1(2), 41–50Google Scholar
Long, M. H. (1985). Input and second language acquisition theory. In Gass, S. M. & Madden, C. G. (Eds.), Input in second language acquisition (pp. 377–393). Rowley, MA: Newbury House PublishersGoogle Scholar
Long, D. (1989). Second language listening comprehension: A schema theoretic perspective. The Modern Language Journal, 73, 22–30CrossRefGoogle Scholar
Lyman-Hager, M., Davis, J. N., Burnett, J., & Chennault, R. (1993). Une Vie de Boy: Interactive reading in French. In Borchardt, F. L. & Johnson, E. M. T. (Eds.), Proceedings of the CALICO 1993 Annual Symposium on Assessment (pp. 93–97). Durham, NC: Duke UniversityGoogle Scholar
Lynch, T. (1995). The development of interactive listening strategies in second language academic settings. In Mendelsohn, D. J. & Rubin, J., (Eds.), A guide for the teaching of second language listening (pp. 166–185). San Diego: Dominie PressGoogle Scholar
Lyster, R., & Ranta, L. (1997). Corrective feedback and learner uptake: Negotiation of form in communicative classrooms. Studies in Second Language Acquisition, 19, 37–66CrossRefGoogle Scholar
Mayer, R. (2001). Multimedia learning. New York: Cambridge University PressCrossRefGoogle Scholar
McDaniel, M. A., & Mason, M. E. J. (1985). Altering memory representations through retrieval. Journal of experimental psychology. Learning, Memory, and Cognition, 11, 371–385CrossRefGoogle Scholar
Myers, J. L. (1990). Causal relatedness and text comprehension. In Balota, D. A., d'Arcais, G. F., & Rayner, K. (Eds.), Comprehension processes in reading (pp. 361–375). Hillsdale, NJ: ErlbaumGoogle Scholar
Nelson, T., & Oliver, W. (1999). Murder on the Internet. CALICO Journal, 17, 101–114CrossRefGoogle Scholar
Neuman, B., & Koskinen, P. (1992). Captioned television as comprehensible input: Effects of incidental word learning from context for language minority students. Reading Research Quarterly, 27(1), 95–106CrossRefGoogle Scholar
Nikolova, O. R. (2002). Effects of students' participation in authoring of multimedia materials on student acquisition of vocabulary. Language Learning and Technology, 6(1), 100–122Google Scholar
Nobuyoshi, J., & Ellis, R. (1993). Focused communication tasks and second language acquisition. ELT Journal, 47, 203–210CrossRefGoogle Scholar
Omaggio, C. (1979). Picture and second language comprehension: Do they help?Foreign Language Annals, 12(2), 107–116CrossRefGoogle Scholar
O'Malley, J. M., Chamot, A., & Walker, C. (1987). Some applications of cognitive theory to second language acquisition. Studies in Second Language Acquisition, 9, 287–306CrossRefGoogle Scholar
Paivio, A., Clark, J. M., & Lambert, W. E. (1988). Bilingual dual-coding theory and semantic repetition effects on recall. Journal of Experimental Psychology: Learning, Memory, and Cognition, 14, 163–172Google Scholar
Paivio, A., & Desrochers, A. (1979). Effects of an imagery mnemonic on second language recall and comprehension. Canadian Journal of Psychology, 33, 17–28CrossRefGoogle Scholar
Pica, T. (1988). Interlanguage adjustments as an outcome of NS-NNS negotiated interaction. Language Learning, 28(1), 45–73CrossRefGoogle Scholar
Pica, T. (1994). Research on negotiation: What does it reveal about second-language learning conditions, processes, and outcomes?Language Learning, 44(3), 493–527CrossRefGoogle Scholar
Pica, T., Doughty, C., & Young, R. (1986). Making input comprehensible: Do interactional modifications help?International Review of Applied Linguistics, 72, 1–25Google Scholar
Plass, J. L., Chun, D. M., Mayer, R. E., & Leutner, D. (1998). Supporting visual and verbal learning preferences in a second-language multimedia learning environment. Journal of Educational Psychology, 90(1), 25–36CrossRefGoogle Scholar
Plass, J. L., Chun, D. M., Mayer, R. E., & Leutner, D. (2003). Cognitive load in reading a foreign language text with multimedia aids and the influence of verbal and spatial abilities. Computers in Human Behavior, 19(2), 221–243CrossRefGoogle Scholar
Postovsky, V. A. (1981). The priority of aural comprehension in the language acquisition process. In Wintz, H. (Ed.), The comprehension approach to foreign language instruction (pp. 170–186). Cambridge, UK: Newbury House publishersGoogle Scholar
Pusack, J., & Otto, S. (1997). Taking control of multimedia. In Bush, M. & Terry, R. (Eds.), Technology-enhanced language learning (pp. 1–46). Lincolnwood, IL: National Textbook CompanyGoogle Scholar
Reeves, T. C. (1993). Pseudoscience in computer-based instruction: The case of learner control research. Journal of Computer-Based Instruction, 20(2), 39–46Google Scholar
Reinert, H. (1976). One picture is worth a thousand words? Not necessarily. The Modern Language Journal, 60(4), 160–168Google Scholar
Rost, M. (1990). Listening in language learning. New York: Longman GroupGoogle Scholar
Samuels, S. J., & Kamil, M. L. (1984). Models of the reading process. In Pearson, P. D., Barr, R., Kamil, M. L., & Mosenthal, P. (Eds.), Handbook of reading research (Vol. 1, pp. 185–224). New York: LongmanGoogle Scholar
Schmidt, R. (1990). The role of consciousness in second language learning. Applied Linguistics, 11, 129–158CrossRefGoogle Scholar
Sharp, D. L. M., Bransford, J. D., Goldman, S. R., & Risko, V. (1995). Dynamic visual support for story comprehension and mental model building by young, at-risk children. Educational Technology Research and Development, 43(4), 25–42CrossRefGoogle Scholar
Shehadeh, A. (1999). Non-native speakers' production of modified comprehensible output and second language learning. Language Learning, 49(4), 627–675CrossRefGoogle Scholar
Silberstein, S. (1987). Let's take another look at reading: Twenty-five years of reading instruction. English Teaching Forum, 25, 28–35Google Scholar
Swaffar, J., Arens, K., & Byrnes, H. (1991). Reading for meaning: An integrated approach to language learning. Englewood Cliffs, NJ: Prentice HallGoogle Scholar
Swain, M. (1985). Communicative competence: Some roles of comprehensible input and comprehensible output in its development. In Gass, S. M., & Madden, C. G. (Eds.), Input in second language acquisition (pp. 235–253). Rowley, MA: Newbury House PublishersGoogle Scholar
Swain, M. (1997). Collaborative dialogue: Its contribution to second language learning. Revista Canaria de Estudios Ingleses, 34, 115–132Google Scholar
Swain, M., & Lapkin, S. (1995). Problems in output and the cognitive processes they generate: A step towards second language learning. Applied Linguistics, 16, 371–391CrossRefGoogle Scholar
Teichert, H. U. (1996). A comparative study using illustrations, brainstorming, and questions as advance organizers in intermediate college German conversations classes. The Modern Language Journal, 80(4), 509–517CrossRefGoogle Scholar
Terrell, T. (1986). Acquisition in the natural approach: The binding/access framework. The Modern Language Journal, 70, 213–227CrossRefGoogle Scholar
Underwood, J. (1984). Linguistics, computers and the language teacher. Rowley, MA: Newbury HouseGoogle Scholar
University of Texas. (2004). Français interactif. Retrieved April 7, 2004 from http://www.laits.utexas.edu/fi
Branden, K. (1997). Effects of negotiation on language learners' output. Language Learning, 47, 589–636CrossRefGoogle Scholar
Vygotsky, L. (1996). Thought and language. (Kozulin, Alex, Ed.). Cambridge, MA: MIT PressGoogle Scholar
Wade, S. E., Buxton, W. M., & Kelly, M. (1999). Using think-alouds to examine reader-text interest. Reading Research Quarterly, 34(2), 194–216CrossRefGoogle Scholar
Watanabe, Y. (1997). Input, intake, and retention: Effects of increased processing on incidental learning of foreign language vocabulary. Studies in Second Language Acquisition, 19, 287–307CrossRefGoogle Scholar
Yeh, S., & Lehman, J. D. (2001). Effects of learner control and learning strategies on English as a foreign language (EFL) learning from interactive hypermedia lessons. Journal of Educational Multimedia and Hypermedia, 10(2), 141–159Google Scholar
Yoshii, M., & Flaitz, J. (2002). Second language incidental vocabulary retention: The effect of picture and annotation types. CALICO Journal, 20(1), 33Google Scholar

Save book to Kindle

To save this book to your Kindle, first ensure [email protected] is added to your Approved Personal Document E-mail List under your Personal Document Settings on the Manage Your Content and Devices page of your Amazon account. Then enter the ‘name’ part of your Kindle email address below. Find out more about saving to your Kindle.

Note you can select to save to either the @free.kindle.com or @kindle.com variations. ‘@free.kindle.com’ emails are free but can only be saved to your device when it is connected to wi-fi. ‘@kindle.com’ emails can be delivered even when you are not connected to wi-fi, but note that service fees apply.

Find out more about the Kindle Personal Document Service.

Available formats
×

Save book to Dropbox

To save content items to your account, please confirm that you agree to abide by our usage policies. If this is the first time you use this feature, you will be asked to authorise Cambridge Core to connect with your account. Find out more about saving content to Dropbox.

Available formats
×

Save book to Google Drive

To save content items to your account, please confirm that you agree to abide by our usage policies. If this is the first time you use this feature, you will be asked to authorise Cambridge Core to connect with your account. Find out more about saving content to Google Drive.

Available formats
×