Hostname: page-component-745bb68f8f-f46jp Total loading time: 0 Render date: 2025-01-08T12:24:26.718Z Has data issue: false hasContentIssue false

A Modification of Feldt's Test of the Equality of Two Dependent Alpha Coefficients

Published online by Cambridge University Press:  01 January 2025

Yousef M. Alsawalmeh*
Affiliation:
Yarmouk University
Leonard S. Feldt
Affiliation:
The University of Iowa
*
Requests for reprints should be sent to Leonard S. Feldt, 334 Lindquist Center, Iowa City, IA 52242.

Abstract

The available statistical tests of the equality of nonindependent alpha reliability coefficients require that the product of the number of test parts times the number of subjects be quite large—1000 or more. A modification of one of these tests is derived which avoids this limitation. Monte Carlo studies indicate that the modified test effectively controls the Type I error rate with as few as 2 or 3 test parts and 50 subjects. This means the modified test can be safely employed in comparisons between interrater reliabilities.

Type
Original Paper
Copyright
Copyright © 1994 The Psychometric Society

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

References

Alsawalmeh, Y. M. (1991). The development and comparisons of procedures for testing the equality of two independent and two dependent intraclass reliability coefficients, Iowa City, IA: The University of Iowa.Google Scholar
Bose, S. (1935). The distribution of the ratio of variances of two samples drawn from a given normal bivariate correlated population. Sankhya: The Indian Journal of Statistics, 1, 6572.Google Scholar
Brandenburg, D. C., Forsyth, R. A. (1974). Approximating standardized achievement test norms with a theoretical model. Educational and Psychological Measurement, 34, 39.CrossRefGoogle Scholar
Cook, D. L. (1959). A replication of Lord's study of skewness and kurtosis of observed test-score distributions. Educational and Psychological Measurement, 19, 8187.CrossRefGoogle Scholar
Feldt, L. S. (1965). The approximate sampling distribution of Kuder-Richardson reliability coefficient twenty. Psychometrika, 30, 357370.CrossRefGoogle ScholarPubMed
Feldt, L. S. (1969). A test of the hypothesis that Cronbach's alpha or Kuder-Richardson coefficient twenty is the same for two tests. Psychometrika, 34, 363373.CrossRefGoogle Scholar
Feldt, L. S. (1980). A test of the hypothesis that Cronbach's alpha reliability coefficient is the same for two tests administered to the same sample. Psychometrika, 45, 99105.CrossRefGoogle Scholar
Feldt, L. S., Steffen, M., Gupta, N. C. (1985). A comparison of five methods of estimating the standard error of measurement at specific score levels. Applied Psychological Measurement, 9, 351361.CrossRefGoogle Scholar
Hakstian, A. R., Whalen, T. E. (1976). Ak-sample significance test for independent alpha coefficients. Psychometrika, 41, 219231.CrossRefGoogle Scholar
Kendall, M. G., Stuart, A. (1977). The advanced theory of statistics 4th ed.,, New York: MacMillan Publishing.Google Scholar
Kristof, W. (1963). The statistical theory of stepped-up reliability coefficients when a test has been divided into several equivalent parts. Psychometrika, 28, 221238.CrossRefGoogle Scholar
Lord, F. M. (1955). A survey of observed test-score distributions with respect to skewness and kurtosis. Educational and Psychological Measurement, 15, 383389.CrossRefGoogle Scholar
Odell, P. L., Feiveson, A. N. (1966). A numerical procedure to generate a sample covariance matrix. Journal of the American Statistical Association, 61, 199203.CrossRefGoogle Scholar
Pitman, E. J. G. (1939). A note on normal correlation. Biometrika, 31, 912.CrossRefGoogle Scholar
Woodruff, D. J., Feldt, L. S. (1986). Tests for equality of several alpha coefficients when their sample estimates are dependent. Psychometrika, 51, 393413.CrossRefGoogle Scholar