Skip to main content Accessibility help
×
Hostname: page-component-78c5997874-t5tsf Total loading time: 0 Render date: 2024-11-08T08:18:13.119Z Has data issue: false hasContentIssue false

Part III - Investigating Score Uses and Consequences

Published online by Cambridge University Press:  14 January 2021

Carol A. Chapelle
Affiliation:
Iowa State University
Erik Voss
Affiliation:
Teachers College, Columbia University
Get access

Summary

Image of the first page of this content. For PDF version, please use the ‘Save PDF’ preceeding this image.'
Type
Chapter
Information
Validity Argument in Language Testing
Case Studies of Validation Research
, pp. 233 - 322
Publisher: Cambridge University Press
Print publication year: 2021

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

References

References

Chan, S. (2017). Using keystroke logging to understand writers’ processes on a reading-into-writing test. Language Testing in Asia, 7(10), 127.Google Scholar
Chapelle, C. A., Enright, M. K., & Jamieson, J. M. (Eds.). (2008). Building a validity argument for the Test of English as a Foreign LanguageTM. New York: Routledge.Google Scholar
Creswell, J. W., & Plano Clark, V. L. (2017). Designing and conducting mixed methods research (3rd ed.). Thousand Oaks, CA: Sage.Google Scholar
Cumming, A., Kantor, R., Baba, K., Erdosy, U., Eouanzoui, K., & James, M. (2005). Differences in written discourse in independent and integrated prototype tasks for next generation TOEFL. Assessing Writing, 10(1), 543.CrossRefGoogle Scholar
Fulcher, G. (2010). Practical language testing. London: Hodder Education.Google Scholar
Gebril, A., & Plakans, L. (2009). Investigating source use, discourse features, and process in integrated writing tests. Spann Fellow Working Papers in Second or Foreign Language Assessment, 7, 4784.Google Scholar
Jun, H. S. (2014). A validity argument for the use of scores from a web-search-permitted and web-source-based integrated writing test. Unpublished doctoral dissertation, Iowa State University, Ames, IA.Google Scholar
Kane, M. T. (1992). An argument-based approach to validity. Psychological Bulletin, 112(3), 527535.Google Scholar
Kane, M. T. (2006). Validation. In Brennan, R. L. (Ed.), Educational measurement (4th ed., pp. 1764). Westport, CT: Greenwood Publishing.Google Scholar
Kane, M. T. (2012). Articulating a validity argument. In Fulcher, G. & Davidson, F. (Eds.), The Routledge handbook of language testing (pp. 3447). New York: Routledge.Google Scholar
Kane, M. T. (2013). Validating the interpretations and uses of test scores. Journal of Educational Measurement, 50(1), 173.Google Scholar
Ranalli, J., Feng, H.-S., & Chukharev-Hudilainen, E. (2018). Exploring the potential of process-tracing technologies to support assessment for learning of L2 writing. Assessing Writing, 36, 7789.Google Scholar
Stapleton, P. (2005a). Evaluating web-sources: Internet literacy and L2 academic writing. ELT Journal, 59(2), 135143.Google Scholar
Stapleton, P. (2005b). Using the web as a research source: Implications for L2 academic writing. Modern Language Journal, 89(2), 177189.Google Scholar
Weigle, S. C., & Jensen, L. (1997). Assessment issues for content-based instruction. In Snow, M. A. & Brinton, D. (Eds.), The content-based classroom: Perspectives on integrating language and content (pp. 201212). White Plains, NY: Addison Wesley Longman.Google Scholar

References

Bachman, L. F. (2005). Building and supporting a case for test use. Language Assessment Quarterly, 2(1), 134.Google Scholar
Bachman, L. F., & Palmer, A. (2010). Language assessment in practice. Oxford: Oxford University Press.Google Scholar
Cheng, L. (2014). Consequences, impact, and washback. In Kunnan, A. J. (Ed.), The companion to language assessment (pp. 11301146). Chichester: John Wiley & Sons. https://doi.org/10.1002/9781118411360.wbcla071Google Scholar
Chapelle, C. A., Chung, Y.-R., Hegelheimer, V., Pendar, N., & Xu, J. (2010). Towards a computer-delivered test of productive grammatical ability. Language Testing, 27(4), 443469. https://doi.org/10.1177/0265532210367633Google Scholar
Chung, Y.-R. (2014). A test of productive English grammatical ability in academic writing: Development and validation. Unpublished doctoral dissertation, Iowa State University, Ames, IA.Google Scholar
Creswell, J. W. (2009). Research design: Qualitative, quantitative, and mixed methods approaches (3rd ed.). Thousand Oaks, CA: Sage.Google Scholar
Cronbach, L. J. (1988). Five perspectives on validity argument. In Wainer, H. (Ed.), Test validity (pp. 317). Hillsdale, NJ: Erlbaum.Google Scholar
Kane, M. (2016). Explicating validity. Assessment in Education: Principles, Policy & Practice, 23(2), 198211.Google Scholar
McNamara, T. (2006). Validity in language testing: The challenge of Sam Messick’s legacy. Language Assessment Quarterly, 3(1), 3151.Google Scholar
Messick, S. (1989). Validity. In Linn, R. L (Ed.), Educational measurement (3rd ed., pp. 13103). New York: American Council on Education/Macmillan Publishing Company.Google Scholar
Messick, S. (1996). Validity of performance assessments. In Phillips, G. W. (Ed.), Technical issues in large-scale performance assessment (pp. 118). Washington, DC: U.S. Department of Education, National Center for Education Statistics.Google Scholar
Moss, P. A. (1998). The role of consequences in validity theory. Educational Measurement: Issues and Practice, 17(2), 612.Google Scholar
Sireci, S. G. (2016). On the validity of useless tests. Assessment in Education: Principles, Policy & Practice, 23(2), 226235. https://doi.org/10.1080/0969594X.2015.1072084Google Scholar
Thompson, J. B. (1990). Ideology and modern culture. In Thompson, J. B. (Ed.), The methodology of interpretation (pp. 272327). Stanford, CA: Stanford University Press.Google Scholar

References

Blais, J.-G., & Laurier, M. D. (1995). The dimensionality of a placement test from several analytical perspectives. Language Testing, 12(1), 7298. https://doi.org/10.1177/026553229501200105Google Scholar
Bradshaw, J. (1990). Test-takers’ reactions to a placement test. Language Testing, 7(1), 1330. https://doi.org/10.1177/026553229000700103Google Scholar
Brown, J. D. (1989). Improving ESL placement tests using two perspectives. TESOL Quarterly, 23(1), 6583. https://doi.org/10.2307/3587508Google Scholar
Chapelle, C. A., Enright, M. K., & Jamieson, J. (2008). Building a validity argument for the Test of English as a Foreign Language. New York and London: Routledge.Google Scholar
Cho, Y., & Bridgeman, B. (2012). Relationship of TOEFL IBT scores to academic performance: Some evidence from American universities. Language Testing, 29(3), 421442. https://doi.org/10.1177/0265532211430368Google Scholar
Clark, M. (2004). By the numbers: The rationale for Rasch analysis in placement testing. Second Language Studies, 22(2), 6190.Google Scholar
Creswell, J. W., & Plano Clark, V. L. (2007). Designing and conducting mixed methods research. Thousand Oaks, CA: Sage Publications.Google Scholar
Fox, J. D. (2009). Moderating top-down policy impact and supporting EAP curricular renewal: Exploring the potential of diagnostic assessment. Journal of English for Academic Purposes, 8(1), 2642. https://doi.org/10.1016/j.jeap.2008.12.004Google Scholar
Fulcher, G. (1997). An English language placement test: Issues in reliability and validity. Language Testing, 14(2), 113139. https://doi.org/10.1177/026553229701400201Google Scholar
Graham, J. G. (1987). English language proficiency and the prediction of academic success. TESOL Quarterly, 21(3), 505521. https://doi.org/10.2307/3586500CrossRefGoogle Scholar
Green, A. B., & Weir, C. J. (2004). Can placement tests inform instructional decisions? Language Testing, 21(4), 467494. https://doi.org/10.1191/0265532204lt293oaGoogle Scholar
Isbell, D., Nelly, M., & Arvizu, G. (2014). Is equating reasonable for small-scale language testing programs? In The 36th Language Testing Research Colloquium. Amsterdam, The Netherlands: VU University.Google Scholar
Kane, M. T. (2013). Validating the interpretations and uses of test scores. Journal of Educational Measurement, 50(1), 173. https://doi.org/10.1111/jedm.12000CrossRefGoogle Scholar
Kunnan, A. J. (1990). DIF in native language and gender groups in an ESL placement test. TESOL Quarterly, 24(4), 741746. https://doi.org/10.2307/3587128Google Scholar
Kunnan, A. J. (1992). An investigation of a criterion-referenced test using G-theory, and factor and cluster analyses. Language Testing, 9(1), 3049. https://doi.org/10.1177/026553229200900104Google Scholar
Lee, Y.-J., & Greene, J. (2007). The predictive validity of an ESL placement test: A mixed methods approach. Journal of Mixed Methods Research, 1(4), 366389. https://doi.org/10.1177/1558689807306148Google Scholar
Li, Z. (2015). An argument-based validation study of the English Placement Test (EPT) – Focusing on the inferences of extrapolation and ramification. Iowa State University. Retrieved from http://search.proquest.com/docview/1733954827Google Scholar
Midgley, C., Maehr, M. L., Hruda, L. Z., Anderman, E. M., Anderman, L., Freeman, K. E., … Urdan, T. (2000). Manual for the patterns of adaptive learning scales. Ann Arbor, MI: University of Michigan.Google Scholar
Nakamura, Y. (2007). A Rasch-based analysis of an in-house English placement test. In Newfields, T., Gledall, I., Wanner, P., & Kawate-Mierzejewska, M. (Eds.), Second language acquisition – Theory and pedagogy: Proceedings of the 6th annual JALT Pan-SIG conference (pp. 97109). Sendai, Japan: Tohoku Bunka Gakuen University. Retrieved from http://jalt.org/pansig/2007/HTML/Nakamura.htmGoogle Scholar
Phakiti, A., Hirsh, D., & Woodrow, L. (2013). It’s not only English: Effects of other individual factors on English language learning and academic learning of ESL international students in Australia. Journal of Research in International Education, 12(3), 239258. https://doi.org/10.1177/1475240913513520Google Scholar
Pintrich, P. R., Smith, D. A. F., Garcia, T., & McKeachie, W. J. (1993). Reliability and predictive validity of the motivated strategies for learning questionnaire (Mslq). Educational and Psychological Measurement, 53(3), 801813. https://doi.org/10.1177/0013164493053003024Google Scholar
Plakans, L., & Burke, M. (2013). The decision-making process in language program placement: Test and nontest factors interacting in context. Language Assessment Quarterly, 10(2), 115134. https://doi.org/10.1080/15434303.2011.627598Google Scholar
Saldaña, J. (2009). The coding manual for qualitative researchers. Thousand Oaks, CA: Sage.Google Scholar
Wang, J., & Wang, X. (2012). Structural equation modeling. Applications using Mplus. West Sussex: Wiley.Google Scholar

Save book to Kindle

To save this book to your Kindle, first ensure [email protected] is added to your Approved Personal Document E-mail List under your Personal Document Settings on the Manage Your Content and Devices page of your Amazon account. Then enter the ‘name’ part of your Kindle email address below. Find out more about saving to your Kindle.

Note you can select to save to either the @free.kindle.com or @kindle.com variations. ‘@free.kindle.com’ emails are free but can only be saved to your device when it is connected to wi-fi. ‘@kindle.com’ emails can be delivered even when you are not connected to wi-fi, but note that service fees apply.

Find out more about the Kindle Personal Document Service.

Available formats
×

Save book to Dropbox

To save content items to your account, please confirm that you agree to abide by our usage policies. If this is the first time you use this feature, you will be asked to authorise Cambridge Core to connect with your account. Find out more about saving content to Dropbox.

Available formats
×

Save book to Google Drive

To save content items to your account, please confirm that you agree to abide by our usage policies. If this is the first time you use this feature, you will be asked to authorise Cambridge Core to connect with your account. Find out more about saving content to Google Drive.

Available formats
×