Hostname: page-component-f554764f5-nqxm9 Total loading time: 0 Render date: 2025-04-20T07:39:48.177Z Has data issue: false hasContentIssue false
  • English
  • Français

On Association Coefficients for 2×2 Tables and Properties That Do Not Depend on the Marginal Distributions

Published online by Cambridge University Press:  01 January 2025

Matthijs J. Warrens
Matthijs J. Warrens*
Affiliation:
Leiden University Institute for Psychological Research
*
Requests for reprints should be sent to Matthijs J. Warrens, Psychometrics and Research Methodology Group, Leiden University Institute for Psychological Research, Leiden University, Wassenaarseweg 52, P.O. Box 9555, 2300 RB Leiden, The Netherlands. E-mail: [email protected]
Rights & Permissions [Opens in a new window]

Abstract

Core share and HTML view are not available for this content. However, as you have access to this content, a full PDF is available via the ‘Save PDF’ action button.

We discuss properties that association coefficients may have in general, e.g., zero value under statistical independence, and we examine coefficients for 2×2 tables with respect to these properties. Furthermore, we study a family of coefficients that are linear transformations of the observed proportion of agreement given the marginal probabilities. This family includes the phi coefficient and Cohen’s kappa. The main result is that the linear transformations that set the value under independence at zero and the maximum value at unity, transform all coefficients in this family into the same underlying coefficient. This coefficient happens to be Loevinger’s H.

Keywords

agreement indicesresemblance measurescorrection for chancecorrection for maximum valuephi coefficientCohen’s kappaHubert–Arabie adjusted Rand indexYule’s QLoevinger’s HCole’s C7
Type
Original Paper
Information
Psychometrika , Volume 73 , Issue 4 , December 2008 , pp. 777 - 789
Creative Commons
Creative Common License - CCCreative Common License - BYCreative Common License - NC
This article distributed under the terms of the Creative Commons Attribution Noncommercial License which permits any noncommercial use, distribution, and reproduction in any medium, provided the original author(s) and source are credited.
Copyright
Copyright © 2008 The Author(s)

References

Albatineh, A.N., Niewiadomska-Bugaj, M., & Mihalko, D. (2006). On similarity indices and correction for chance agreement. Journal of Classification, 23, 301–313.CrossRefGoogle Scholar
Baulieu, F.B. (1989). A classification of presence/absence based dissimilarity coefficients. Journal of Classification, 6, 233–246.CrossRefGoogle Scholar
Baulieu, F.B. (1997). Two variant axiom systems for presence/absence based dissimilarity coefficients. Journal of Classification, 14, 159–170.CrossRefGoogle Scholar
Benini, R. (1901). Principii di demografie. No. 29 of manuali Barbèra di science giuridiche sociali e poltiche, Firenzi: G. Barbèra.Google Scholar
Boyce, R.L., & Ellison, P.C. (2001). Choosing the best similarity index when performing fuzzy set ordination on binary data. Journal of Vegetational Science, 12, 711–720.CrossRefGoogle Scholar
Brennan, R.L., & Light, R.J. (1974). Measuring agreement when two observers classify people into categories not defined in advance. British Journal of Mathematical and Statistical Psychology, 27, 154–163.CrossRefGoogle Scholar
Castellan, N.J. (1966). On the estimation of the tetrachoric correlation coefficient. Psychometrika, 31, 67–73.CrossRefGoogle Scholar
Cohen, J. (1960). A coefficient of agreement for nominal scales. Educational and Psychological Measurement, 20, 37–46.CrossRefGoogle Scholar
Cole, L.C. (1949). The measurement of interspecific association. Ecology, 30, 411–424.CrossRefGoogle Scholar
Cureton, E.E. (1959). Note on φ/φ max. Psychometrika, 24, 89–91.CrossRefGoogle Scholar
Davenport, E.C., El-Sanhurry, N.A. (1991). Phi/phimax: review and synthesis. Educational and Psychological Measurement, 51, 821–828.CrossRefGoogle Scholar
Dice, L.R. (1945). Measures of the amount of ecologic association between species. Ecology, 26, 297–302.CrossRefGoogle Scholar
Digby, P.G.N. (1983). Approximating the tetrachoric correlation coefficient. Biometrics, 39, 753–757.CrossRefGoogle Scholar
Divgi, D.R. (1979). Calculation of the tetrachoric correlation coefficient. Psychometrika, 44, 169–172.CrossRefGoogle Scholar
Duarte, J.M., Santos, J.B., & Melo, L.C. (1999). Comparison of similarity coefficients based on RAPD markers in the common bean. Genetics and Molecular Biology, 22, 427–432.CrossRefGoogle Scholar
Edwards, A.W.F. (1963). The measure of association in a 2×2 table. Journal of the Royal Statistical Society, Series A, 126, 109–114.CrossRefGoogle Scholar
Fleiss, J.L. (1975). Measuring agreement between two judges on the presence or absence of a trait. Biometrics, 31, 651–659.CrossRefGoogle ScholarPubMed
Goodman, L.A., & Kruskal, W.H. (1954). Measures of association for cross classifications. Journal of the American Statistical Association, 49, 732–764.Google Scholar
Gower, J.C., & Legendre, P. (1986). Metric and Euclidean properties of dissimilarity coefficients. Journal of Classification, 3, 5–48.CrossRefGoogle Scholar
Guilford, J.P. (1965). The minimal phi coefficient and the maximal phi. Educational and Psychological Measurement, 25, 3–8.CrossRefGoogle Scholar
Hubálek, Z. (1982). Coefficients of association and similarity based on binary (presence-absence) data: an evaluation. Biological Reviews, 57, 669–689.CrossRefGoogle Scholar
Hubert, L.J., & Arabie, P. (1985). Comparing partitions. Journal of Classification, 2, 193–218.CrossRefGoogle Scholar
Hurlbert, S.H. (1969). A coefficient of interspecific association. Ecology, 50, 1–9.CrossRefGoogle Scholar
Jaccard, P. (1912). The distribution of the flora in the Alpine zone. The New Phytologist, 11, 37–50.CrossRefGoogle Scholar
Janson, S., & Vegelius, J. (1981). Measures of ecological association. Oecologia, 49, 371–376.CrossRefGoogle ScholarPubMed
Janson, S., & Vegelius, J. (1982). The J-index as a measure of nominal scale response agreement. Applied Psychological Measurement, 6, 111–121.CrossRefGoogle Scholar
Krippendorff, K. (1987). Association, agreement, and equity. Quality and Quantity, 21, 109–123.CrossRefGoogle Scholar
Loevinger, J.A. (1947). A systematic approach to the construction and evaluation of tests of ability. Psychometrika Monograph No. 4.CrossRefGoogle Scholar
Loevinger, J.A. (1948). The technique of homogeneous tests compared with some aspects of scale analysis and factor analysis. Psychological Bulletin, 45, 507–530.CrossRefGoogle Scholar
Maxwell, A.E., & Pilliner, A.E.G. (1968). Deriving coefficients of reliability and agreement for ratings. British Journal of Mathematical and Statistical Psychology, 21, 105–116.CrossRefGoogle ScholarPubMed
Mokken, R.J. (1971). A theory and procedure of scale analysis, Hague: Mouton.CrossRefGoogle Scholar
Ochiai, A. (1957). Zoogeographic studies on the soleoid fishes found in Japan and its neighboring regions. Bulletin of the Japanese Society for Fish Science, 22, 526–530.CrossRefGoogle Scholar
Pearson, K. (1900). Mathematical contributions to the theory of evolution. VII. On the correlation of characters not quantitatively measurable. Philosophical Transactions of the Royal Society of London, Series A, 195, 1–47.Google Scholar
Popping, R. (1983). Overeenstemmingsmaten Voor Nominale Data. Unpublished doctoral dissertation, Rijksuniversiteit Groningen, Groningen, The Netherlands.Google Scholar
Popping, R. (1984). Traces of agreement. On some agreement indices for open-ended questions. Quality and Quantity, 18, 147–158.CrossRefGoogle Scholar
Rand, W. (1971). Objective criteria for the evaluation of clustering methods. Journal of the American Statistical Association, 66, 846–850.CrossRefGoogle Scholar
Ratliff, R.D. (1982). A correction of Cole’s C 7 and Hurlbert’s C 8 coefficients of interspecific association. Ecology, 50, 1–9.Google Scholar
Sijtsma, K., & Molenaar, I.W. (2002). Introduction to nonparametric item response theory, Thousand Oaks: Sage.CrossRefGoogle Scholar
Simpson, G.G. (1943). Mammals and the nature of continents. American Journal of Science, 24, 11–31.Google Scholar
Sokal, R.R., & Michener, C.D. (1958). A statistical method for evaluating systematic relationships. University of Kansas Science Bulletin, 38, 1409–1438.Google Scholar
Sokal, R.R., & Sneath, P.H. (1963). Principles of numerical taxonomy, San Francisco: Freeman.Google Scholar
Steinley, D. (2004). Properties of the Hubert–Arabie adjusted Rand index. Psychological Methods, 9, 386–396.CrossRefGoogle ScholarPubMed
Warrens, M.J. (in press). On the equivalence of Cohen’s kappa and the Hubert–Arabie adjusted Rand index. Journal of Classification.Google Scholar
Yule, G.U. (1900). On the association of attributes in statistics. Philosophical Transactions of the Royal Society A, 75, 257–319.Google Scholar
Yule, G.U. (1912). On the methods of measuring the association between two attributes. Journal of the Royal Statistical Society, 75, 579–652.CrossRefGoogle Scholar
Zegers, F.E. (1986). A general family of association coefficients. Unpublished doctoral dissertation, Rijksuniversiteit Groningen, Groningen, The Netherlands.Google Scholar
Zysno, P.V. (1997). The modification of the phi-coefficient reducing its dependence on the marginal distributions. Methods of Psychological Research Online, 2, 41–52.Google Scholar