Hostname: page-component-745bb68f8f-5r2nc Total loading time: 0 Render date: 2025-01-07T18:43:21.206Z Has data issue: false hasContentIssue false

Checking the Assumptions of Rasch's Model for Speed Tests

Published online by Cambridge University Press:  01 January 2025

M. G. H. Jansen*
Affiliation:
University of Groningen
C. A. W. Glas
Affiliation:
University of Twente
*
Requests for reprints should be sent to Margo Jansen, Department of Education, University of Groningen, Grote Rozenstraat 38, 9712 TJ Groningen, The Netherlands. E-Mail: [email protected]

Abstract

Two new tests for a model for the response times on pure speed tests by Rasch (1960) are proposed. The model is based on the assumption that the test response times are approximately gamma distributed, with known index parameters and unknown rate parameters. The rate parameters are decomposed in a subject ability parameter and a test difficulty parameter. By treating the ability as a gamma distributed random variable, maximum marginal likelihood (MML) estimators for the test difficulty parameters and the parameters of the ability distribution are easily derived. Also the model tests proposed here pertain to the framework of MML. Two tests or modification indices are proposed. The first one is focused on the assumption of local stochastic independence, the second one on the assumption of the test characteristic functions. The tests are based on Lagrange multiplier statistics, and can therefore be computed using the parameter estimates under the null model. Therefore, model violations for all items and pairs of items can be assessed as a by-product of one single estimation run. Power studies and applications to real data are included as numerical examples.

Type
Theory and Methods
Copyright
Copyright © 2005 The Psychometric Society

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

References

Abramowitz, M., Stegun, I.A. (1972). Handbook of mathematical functions. New York: Dover.Google Scholar
Aitchison, J., Silvey, S.D. (1958). Maximum likelihood estimation of parameters subject to restraints. Annals of Mathematical Statistics, 29, 813828.CrossRefGoogle Scholar
Fischer, G.H. (1995). Derivations of the Rasch model. In Fischer, G.H., & Molenaar, I.W. (Eds.), Rasch models: Foundations, recent developments and applications (pp. 3952). New York: Springer-Verlag.CrossRefGoogle Scholar
Glas, C.A.W. (1992). A Rasch model with a multivariate distribution of ability. In Wilson, M. (Ed.), Objective measurement: Theory into practice, Vol. 1. (pp. 236258), New Jersey, NJ: Ablex.Google Scholar
Glas, C.A.W. (1998). Detection of differential item functioning using Lagrange multiplier tests. Statistica Sinica, 8, 647667.Google Scholar
Glas, C.A.W. (1999). Modification indices for the 2PL and the nominal response model. Psychometrika, 64, 273294.CrossRefGoogle Scholar
Glas, C.A.W., Verhelst, N.D. (1995a). Testing the Rasch model. In Fischer, G.H., Molenaar, I.W. (Eds.), Rasch models: Foundations, recent developments, and applications (pp. 6996). New York: Springer-Verlag.CrossRefGoogle Scholar
Glas, C.A.W., Verhelst, N.D. (1995b). Tests of fit for polytomous Rasch models. In Fischer, G.H., Molenaar, I.W. (Eds.), Rasch models: Foundations, recent developments, and applications (pp. 325352). New York: Springer-Verlag.CrossRefGoogle Scholar
Jansen, M.G.H. (1997a). Rasch model for speed tests and some extensions with applications to incomplete designs. Journal of Educational and Behavioral Statistics, 22, 125140.CrossRefGoogle Scholar
Jansen, M.G.H. (1997b). Rasch's model for reading speed with manifest exploratory variables. Psychometrika, 62, 393409.CrossRefGoogle Scholar
Jansen, M.G.H., Glas, C.A.W. (2001). Statistical tests for differential test functioning in Rasch's model for speed tests. In Boomsma, A., van Duijn, M.A.J., Snijders, T.A.B. (Eds.), Essays on Item Response Theory (pp. 149162). New York: Springer-Verlag.CrossRefGoogle Scholar
Johnsen, T.B. (1995, July). Scores and latencies in a letter series test. Paper presented at the 7th. European Meeting of the Psychometric Society, Leiden, The Netherlands.Google Scholar
Lord, F.M., Novick, M.R. (1968). Statistical theories of mental test scores. Reading, MA: Addison-Wesley.Google Scholar
Louis, T.A. (1982). Finding the observed information matrix when using the EM algorithm. Journal of the Royal Statistical Society, Series B, 44, 226233.CrossRefGoogle Scholar
Maris, E. (1993). Additive and multiplicative models for gamma distributed random variables, and their applications as psychometric models for response times. Psychometrika, 58, 445469.CrossRefGoogle Scholar
Perline, R., Wright, B.D., Wainer, H. (1979). The Rasch model as additive conjoint measurement. Applied Psychological Measurement, 1979, 237256.CrossRefGoogle Scholar
Rao, C.R. (1947). Large sample tests of statistical hypothesis concerning several parameters with applications to problems of estimation. Proceedings of the Cambridge Philosophical Society, 44, 5057.Google Scholar
Rasch, G. (1960). Probabilistic models for some intelligence and attainment tests. Copenhagen: Danish Institute for Educational Research.Google Scholar
Visser, J.J.C.M. (1997). Lezen op AVI-niveau: de schaling, normering en validering van de nieuwe AVI-toetskaarten [Reading on AVI-level: Scaling, Norming and Validating the AVI-test]. 's-Hertogenbosch: KPC groep.Google Scholar