Hostname: page-component-586b7cd67f-l7hp2 Total loading time: 0 Render date: 2024-11-20T07:35:13.908Z Has data issue: false hasContentIssue false
  • English
  • Français

A meta-analysis of effectiveness studies on computer technology-supported language learning

Published online by Cambridge University Press:  27 March 2013

Maja Grgurović ,
Carol A. Chapelle  and
Mack C. Shelley
Maja Grgurović
Affiliation:
Department of Linguistics, University of Illinois at Chicago, 1710 University Hall, 601 S. Morgan St., Chicago, IL, 60607, USA (email: [email protected])
Carol A. Chapelle
Affiliation:
Department of English, Iowa State University, 339 Ross Hall, Ames, IA 50011, USA (email: [email protected])
Mack C. Shelley
Affiliation:
Departments of Statistics and Political Science, Iowa State University, 1413 Snedecor, 539 Ross Hall, Ames, IA 50011, USA (email: [email protected])
Get access Rights & Permissions [Opens in a new window]

Abstract

With the aim of summarizing years of research comparing pedagogies for second/foreign language teaching supported with computer technology and pedagogy not-supported by computer technology, a meta-analysis was conducted of empirical research investigating language outcomes. Thirty-seven studies yielding 52 effect sizes were included, following a search of literature from 1970 to 2006 and screening of studies based on stated criteria. The differences in research designs required subdivision of studies, but overall results favored the technology-supported pedagogy, with a small, but positive and statistically significant effect size. Second/foreign language instruction supported by computer technology was found to be at least as effective as instruction without technology, and in studies using rigorous research designs the CALL groups outperformed the non-CALL groups. The analyses of instructional conditions, characteristics of participants, and conditions of the research design did not provide reliable results because of the small number of effect sizes representing each group. The meta-analysis results provide an empirically-based response to the questions of whether or not technology-supported pedagogies enhance language learning, and the process of conducting the meta-analysis pointed to areas in research methodology that would benefit from attention in future research.

Keywords

research methodsmeta-analysissecondary researchresearch synthesissecond/foreign language learningcomputer-assisted language learning.
Type
Research Article
Information
ReCALL , Volume 25 , Issue 2 , May 2013 , pp. 165 - 198
Copyright
Copyright © European Association for Computer Assisted Language Learning 2013

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

References

Abraham, L. B. (2008) Computer-mediated glosses in second language reading comprehension and vocabulary learning: A meta-analysis. Computer Assisted Language Learning, 21: 199–226.CrossRefGoogle Scholar
Adair-Hauck, B., Willingham-McLain, L.Youngs, B. E. (2000) Evaluating the integration of technology and second language learning. CALICO Journal, 17(2): 296–306.Google Scholar
Al-Jarf, R. S. (2002) Effect of online learning on struggling ESL college writers. National Educational Computing Conference, San Antonio, Texas: National Educational Computing Conference Proceedings, 23.Google Scholar
Aust, R., Kelley, M. J.Roby, W. (1993) The use of hyper-reference and conventional dictionaries. Educational Technology, Research and Development, 41(4): 63–73.CrossRefGoogle Scholar
Bowles, M. A. (2004) L2 glossing: To CALL or not to CALL. Hispania, 87(3): 541–552.CrossRefGoogle Scholar
Chapelle, C. A. (2001) Computer applications in second language acquisition. Cambridge: Cambridge University Press.CrossRefGoogle Scholar
Chapelle, C. A. (2003) English language learning and technology: Lectures on applied linguistics in the age of information and communication technology. Amsterdam: John Benjamins Publishing.CrossRefGoogle Scholar
Chapelle, C. A. (2007) Challenges in evaluation of innovation: Observations from technology research. Innovation in Language Learning and Teaching, 1(1): 30–45.CrossRefGoogle Scholar
Chenoweth, N. A., Ushida, E.Murday, K. (2006) Student learning in hybrid French and Spanish courses: An overview of language online. CALICO Journal, 24(1): 115–145.CrossRefGoogle Scholar
Cooper, H. (1998) Synthesizing research: A guide for literature reviews. Thousand Oaks, CA: Sage.Google Scholar
Cohen, J. (1988) Statistical power analysis for behavioral sciences. Hillsdale, NJ: Erlbaum.Google Scholar
De la Fuente, M. J. (2003) Is SLA Interactionist theory relevant to CALL? A study on the effects of computer-mediated interaction in L2 vocabulary acquisition. Computer Assisted Language Learning, 16(1): 47–81.CrossRefGoogle Scholar
Dunkel, P. (1991) The effectiveness research on computer-assisted instruction and computer-assisted language learning. In: Dunkel, P. (ed.), Computer-assisted language learning and testing: Research issues and practice. New York: Newbury House, 5–36.Google Scholar
Echavez-Solano, N. (2003) A comparison of student outcomes and attitudes in technology-enhanced vs. traditional second-semester Spanish language courses. Unpublished doctoral dissertation, The University of Minnesota.Google Scholar
Felix, U. (2005a) What do meta-analyses tell us about CALL effectiveness? ReCALL, 17(2): 269–288.CrossRefGoogle Scholar
Felix, U. (2005b) Analyzing Recent CALL Effectiveness Research – Towards a Common Agenda. Computer Assisted Language Learning, 18(1–2): 1–32.CrossRefGoogle Scholar
Jeon, E. H.Kaya, T. (2006) Effects of L2 instruction on interlanguage pragmatic development. In: Norris, J. and Ortega, L. (eds.), Synthesizing research on language learning and teaching. Philadelphia PA: John Benjamins, 165–211.CrossRefGoogle Scholar
Kulik, J. A. (2003) Effects of using instructional technology in colleges and universities: What controlled evaluation studies say. Arlington: SRI International.Google Scholar
Kulik, J. A.Kulik, C. L. C. (1987) Review of recent literature on computer-based instruction. Contemporary Education Review, 12: 222–230.Google Scholar
Kulik, J. A.Kulik, C. L. C. (1991) Effectiveness of computer-based instruction: An updated analysis. Computers in Human Behavior, 7(1–2): 75–94.CrossRefGoogle Scholar
Li, S. (2010) The effectiveness of corrective feedback in SLA: A meta-analysis. Language Learning, 60(2): 309–365.CrossRefGoogle Scholar
Liu, M., Moore, Z., Graham, L.Lee, S. (2002) A look at the research in computer-based technology use in second language learning: A review of literature from 1990–2000. Journal of Research on Technology in Education, 34(3): 250–273.CrossRefGoogle Scholar
Lipsey, M. W.Wilson, D. B. (2001) Practical meta-analysis. Thousand Oaks, CA: Sage.Google ScholarPubMed
Nagata, N. (1996) Computer vs. workbook instruction in second language acquisition. CALICO Journal, 14(1): 53–75.CrossRefGoogle Scholar
Norris, J. M.Ortega, L. (2000) Effectiveness of L2 instruction: A research synthesis and a quantitative meta-analysis. Language Learning, 50: 417–528.CrossRefGoogle Scholar
Norris, J. M.Ortega, L. (2006) Synthesizing research on language learning and teaching. Philadelphia, PA: John Benjamins.CrossRefGoogle Scholar
Odenthal, J. M. (1992) The effect of a computer-based writing program on the attitudes and performance of students acquiring English as a Second Language. Unpublished doctoral dissertation, Claremont Graduate School, San Diego State University, Claremont, California.Google Scholar
Oswald, F. L.Plonsky, L. (2010) Meta-analysis in second language research: Choices and challenges. Annual Review of Applied Linguistics, 30: 85–110.CrossRefGoogle Scholar
Payne, J. S.Whitney, P. J. (2002) Developing L2 oral proficiency through synchronous CMC: output, working memory, and interlanguage development. CALICO Journal, 20(1): 7–32.CrossRefGoogle Scholar
Pederson, K. M. (1987) Research on CALL. In: Smith, W. F. (ed.), Modern media in foreign language education: Theory and implementation. Lincolnwood, IL: National Textbook Company, 99–132.Google Scholar
Rawdon, T., Sharp, R. L., Shelley, M.Thomas, J. R. (2012) Meta-analysis of the placebo effect in nutritional supplement studies of muscular performance. Kinesiology Review, 1(2): 137–148.CrossRefGoogle Scholar
Shelley, M., Rawdon, T., Sharp, R., Thomas, J., Schalinske, K. (2007) Meta-analysis in the human sciences: Are placebo effects real? In: American Statistical Association, 2006 proceedings of the American Statistical Association, section on survey research methods [CD-ROM]. Alexandria, VA: American Statistical Association.Google Scholar
Taylor, A. M. (2006) The effects of CALL versus traditional L1 glosses on L2 reading comprehension. CALICO Journal, 23: 309–318.CrossRefGoogle Scholar
Tozcy, A.Coady, J. (2004) Successful learning of frequent vocabulary through CALL also benefits reading comprehension and speed. Computer Assisted Language Learning, 17(5): 473–495.CrossRefGoogle Scholar
Troia, G. A. (2004) Migrant students with limited English proficiency: Can Fast ForWord Language make a difference in their language skills and academic achievement? Remedial and Special Education, 25(6): 353–366.CrossRefGoogle Scholar
US Department of Education, Office of Planning, Evaluation, and Policy Development (2009) Evaluation of evidence-based practices in online learning: A meta-analysis and review of online learning studies. Washington, DC. www.ed.gov/about/offices/list/opepd/ppss/reports.htmlGoogle Scholar
Zhao, Y. (2003) Recent developments in technology and language learning: a literature review and meta-analysis. CALICO Journal, 21(1): 7–27.CrossRefGoogle Scholar
Supplementary material: File

Grgurović et al. supplementary material

Supplementary Tables and Appendices

Download Grgurović et al. supplementary material(File)
File 153.2 KB