Hostname: page-component-cd9895bd7-dk4vv Total loading time: 0 Render date: 2025-01-06T00:52:26.678Z Has data issue: false hasContentIssue false
  • English
  • Français

Speed-Accuracy Response Models: Scoring Rules based on Response Time and Accuracy

Published online by Cambridge University Press:  01 January 2025

Gunter Maris  and
Han van der Maas
Gunter Maris*
Affiliation:
Cito – University of Amsterdam
Han van der Maas
Affiliation:
University of Amsterdam
*
Requests for reprints should be sent to Gunter Maris, Cito – University of Amsterdam, Arnhem, The Netherlands. E-mail: [email protected]
Get access Rights & Permissions [Opens in a new window]

Abstract

Starting from an explicit scoring rule for time limit tasks incorporating both response time and accuracy, and a definite trade-off between speed and accuracy, a response model is derived. Since the scoring rule is interpreted as a sufficient statistic, the model belongs to the exponential family. The various marginal and conditional distributions for response accuracy and response time are derived, and it is shown how the model parameters can be estimated. The model for response accuracy is found to be the two-parameter logistic model. It is found that the time limit determines the item discrimination, and this effect is illustrated with the Amsterdam Chess Test II.

Keywords

item response theoryresponse timestwo-parameter logistic modelscoring rule
Type
Original Paper
Information
Psychometrika , Volume 77 , Issue 4 , October 2012 , pp. 615 - 633
Copyright
Copyright © 2012 The Psychometric Society

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

References

Birnbaum, A. (1968). Some latent trait models and their use in inferring an examinee’s ability. In Lord, F.M., & Novick, M.R. (Eds.), Statistical theories of mental test scores (pp. 395–479). Reading: Addison-Wesley.Google Scholar
Bock, R.D. (1972). Estimating item parameters and latent ability when responses are scored in two or more nominal categories. Psychometrika, 37, 29–51.CrossRefGoogle Scholar
de Leeuw, J. (1994). Block-relaxation algorithms in statistics. In Bock, H.H., Lenski, W., & Richter, M.M. (Eds.), Information systems and data analysis (pp. 308–325). Berlin: Springer.CrossRefGoogle Scholar
de Leeuw (J.2006). Some majorization techniques (Tech. Rep. No. 2006032401). Department of statistics, UCLA. .Google Scholar
Dempster, A.P., Laird, N.M., & Rubin, D.B. (1977). Maximum likelihood from incomplete data via the EM algorithm (with discussion). Journal of the Royal Statistical Society, 39, 1–38.CrossRefGoogle Scholar
Dennis, I., & Evans, J. (1996). The speed-error trade-off problem in psychometric testing. British Journal of Psychology, 87, 105–129.CrossRefGoogle Scholar
Hunter, D., & Lange, K. (2004). A tutorial on MM algorithms. American Statistician, 58 130–37.CrossRefGoogle Scholar
Rasch, G. (1960). Probabilistic models for some intelligence and attainment tests. Copenhagen: The Danish Institute of Educational Research. (Expanded edition, 1980. Chicago: The University of Chicago Press).Google Scholar
Tuerlinckx, F., & De Boeck, P. (2005). Two interpretations of the discrimination parameter. Psychometrika, 70 4629–650.CrossRefGoogle Scholar
van der Linden, W.J. (2007). A hierarchical framework for modeling speed and accuracy on test items. Psychometrika, 72, 287–308.CrossRefGoogle Scholar
Van der Maas, H.L., Molenaar, D., Maris, G., Kievit, R.A., & Borsboom, D. (2011). Cognitive psychology meets psychometric theory: on the relation between process models for decision making and latent variable models for individual differences. Psychological Review, 118 2339–356.CrossRefGoogle ScholarPubMed
Van der Maas, H.L., & Wagenmakers, E.J. (2005). A psychometric analysis of chess expertise. The American Journal of Psychology, 118 129–60.CrossRefGoogle ScholarPubMed
van Ruitenburg, J., (2005). Algorithms for parameter estimation in the Rasch model. Unpublished master’s thesis, Erasmus University. .Google Scholar
Verhelst, N.D., & Glas, C.A.W. (1995). The one parameter logistic model: OPLM. In Fischer, G.H., & Molenaar, I.W. (Eds.), Rasch models: foundations, recent developments and applications (pp. 215–238). New York: Springer.CrossRefGoogle Scholar
Wickelgren, W. (1977). Speed-accuracy tradeoff and information processing dynamics. Acta Psychologica, 41, 67–85.CrossRefGoogle Scholar