Hostname: page-component-745bb68f8f-kw2vx Total loading time: 0 Render date: 2025-01-08T12:19:04.004Z Has data issue: false hasContentIssue false
  • English
  • Français

A Technique for Criterion-Keying and Selecting Test Items

Published online by Cambridge University Press:  01 January 2025

John W. French
John W. French*
Affiliation:
Educational Testing Service
Get access Rights & Permissions [Opens in a new window]

Abstract

For multiple-choice tests where no a priori key exists, the initial selection of a key for maximum validity may be made on the basis of the number of persons choosing each alternative and their mean criterion score. The keying formula is derived. Once the initial keying has been done, further precision in keying and item selection may use, in addition, the mean total test score for persons choosing each alternative. Item-selection formulas suggested by Horst and by Gulliksen for maximizing test validity are both in the form of a ratio, an “item-validity index” divided by an “item-reliability index.” The formula derived here is shown to be equivalent to the numerators of these formulas. The expression in the denominators uses the total test score. Although a radical appears in the denominator of Horst's formula and not in the denominator of Gulliksen's formula, both of them select the same items in practice.

Type
Original Paper
Information
Psychometrika , Volume 17 , Issue 1 , March 1952 , pp. 101 - 106
Copyright
Copyright © 1952 The Psychometric Society

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

Footnotes

*

The author gratefully acknowledges the suggestions and criticisms of Dr. Harold Gulliksen, Research Adviser at the Educational Testing Service.

References

Adkins, D. C. Construction and analysis of achievement tests, Washington, D. C.: U. S. Government Printing Office, 1947.Google Scholar
Adkins, D. C., and Toops, H. A. Simplified formulas for item selection and construction. Psychometrika, 1937, 2, 165–171.Google Scholar
Green, B. F. Jr., A note on item selection for maximum validity. To be published.Google Scholar
Gulliksen, Harold. Item selection to maximize test validity, Princeton, N. J.: The Educational Testing Service, 1949.Google Scholar
Gulliksen, Harold. The Theory of Mental Tests, New York: John Wiley & Sons, Inc., 1950.CrossRefGoogle Scholar
Horst, A. P. Item selection by means of a maximizing function. Psychometrika, 1936, 1, 229–244.CrossRefGoogle Scholar