Hostname: page-component-586b7cd67f-t7czq Total loading time: 0 Render date: 2024-12-01T04:28:24.357Z Has data issue: false hasContentIssue false
  • English
  • Français

Assessing Inter-Rater Reliability for Rating Scales: Resolving some Basic Issues

Published online by Cambridge University Press:  27 April 2018

Domenic V. Cicchetti
Domenic V. Cicchetti*
Affiliation:
V. A. Hospital, West Haven, Connecticut 06516; Associate Professor of Psychology, Department of Psychiatry, Yale University
Get access Rights & Permissions [Opens in a new window]

Summary

This paper extends the recent work of Hall (1974) by presenting the minimal sample sizes and the specific linear agreement weights required for assessing the reliability of rating scales commonly used in neuropsychiatric and other clinico-medicai settings. The weights are shown to vary as a function of (a) whether or not the rating scale contains a point of ‘absence’, and (b) the number of ordinal points on the scale.

Type
Papers
Information
The British Journal of Psychiatry , Volume 129 , Issue 5 , November 1976 , pp. 452 - 456
Copyright
Copyright © Royal College of Psychiatrists, 1976 

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

References

Cicchetti, D. V. (1972) A new measure of agreement between rank ordered variables. Proceedings of the American Psychological Association, 7, 17–18.Google Scholar
Cicchetti, D. V. & Allison, T. (1973) Assessing the reliability of scoring EEG sleep records: an improved method. Proceedings and Journal of the Electro-physiological Technologists' Association, 20, 92–102.Google Scholar
Cicchetti, D. V., & Fleiss, J. L. (1975) A comparison of the null distributions of weighted kappa and the C ordinal statistic. Invited paper presented at the Joint Central Regional Meetings of the American Statistical Association, St Paul, Minnesota.Google Scholar
Cohen, J. (1968) Weighted kappa: nominal scale agreement with provision for scaled disagreement or partial credit. Psychological Bulletin, 70, 213–20.CrossRefGoogle ScholarPubMed
Fleiss, J. L., Cohen, J. & Evfritt, B. S. (1969) Large sample standard errors of kappa and weighted kappa. Psychological Bulletin, 72, 323–7.Google Scholar
Hall, J. N. (1974) Inter-rater reliability of ward rating scales. British Journal of Psychiatry, 125, 248–55.Google Scholar
Lorr, M., Klett, J., McNair, D. M. & Lasky, J. J. (1962) Inpatient Multidimensional Psychiatric Scale (IMPS). Palo Alto: Consulting Psychologists Press.Google Scholar
Overall, J. E. & Gorham, D. R. (1962) The brief psychiatric rating scale. Psychological Reports, 10, 799–812.CrossRefGoogle Scholar
Overall, J. E. & Klett, C. J. (1972) Applied Multivariate Analysis. New York: McGraw-Hill (Introductory chapar).Google Scholar
Submit a response

eLetters

No eLetters have been published for this article.