Hostname: page-component-745bb68f8f-b6zl4 Total loading time: 0 Render date: 2025-01-08T12:24:28.719Z Has data issue: false hasContentIssue false
  • English
  • Français

Test Reliability and Practice Effects

Published online by Cambridge University Press:  01 January 2025

Paul J. Hoffman
Paul J. Hoffman*
Affiliation:
Oregon Research Institute
Get access Rights & Permissions [Opens in a new window]

Abstract

The purpose of this paper is to develop mathematical formulations of test reliability when the estimation of reliability requires successive observations and these observations are not independent of the process (or act) of measurement. The specific application of concern arises in performance testing where performance varies as a function of practice and where practice accrues as a result of measurement. Repeated measures are experimentally nonindependent in such cases. Formulations for the estimation of reliability are developed for each of two cases. The first of these assumes a linear model for acquisition; the second assumes a nonlinear (quadratic) model. Illustrative data are presented whereby insights may be gained as to the inadequacy of the models.

Type
Original Paper
Information
Psychometrika , Volume 28 , Issue 3 , September 1963 , pp. 273 - 288
Copyright
Copyright © 1963 The Psychometric Society

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

Footnotes

*

This investigation was supported by research grant (G14437) from National Science Foundation to Oregon Research Institute.

†

The analysis of much of the data referred to in this report was made possible through the facilities of the Western Data Processing Center at the University of California, Los Angeles.

References

Alexander, H. W. The estimation of reliability when several trials are available. Psychometrika, 1947, 12, 79–99.CrossRefGoogle ScholarPubMed
Anastasi, Anne Psychological testing, New York: MacMillan, 1954.Google Scholar
Ebel, R. L. Estimation of the reliability of ratings. Psychometrika, 1951, 16, 407–424.CrossRefGoogle Scholar
Garside, R. F. The regression of gains upon initial scores. Psychometrika, 1956, 21, 67–77.CrossRefGoogle Scholar
Guilford, J. P. Psychometric methods, New York: McGraw-Hill, 1954.Google Scholar
Gulliksen, H. O. Theory of mental tests, New York: Wiley, 1950.CrossRefGoogle Scholar
Horst, P. A generalized expression for the reliability of measures. Psychometrika, 1949, 16, 21–31.CrossRefGoogle Scholar
Hoyt, C. J. Test reliability estimated by analysis of variance. Psychometrika, 1941, 6, 153–160.CrossRefGoogle Scholar
Hoyt, C. J. and Krishnaiah, P. R. Estimation of test reliability by analysis of variance technique. J. exp. Educ., 1960, 28, 257–259.CrossRefGoogle Scholar
Jackson, R. W. B. and Ferguson, G. A. Studies on the reliability of tests, Toronto: Dept. of Educational Research, Univ. of Toronto, 1941.Google Scholar
McNemar, Q. Psychological statistics (3rd ed.), New York: Wiley, 1962.Google Scholar
Thorndike, R. L. Personnel selection, New York: Wiley, 1949.Google Scholar