Hostname: page-component-78c5997874-m6dg7 Total loading time: 0 Render date: 2024-11-03T08:29:38.519Z Has data issue: false hasContentIssue false
  • English
  • Français

Development of a method for quantifying cognitive ability in the elderly through adaptive test administration

Published online by Cambridge University Press:  04 April 2011

Susanna Konsztowicz ,
Haiqun Xie ,
Johanne Higgins ,
Nancy Mayo  and
Lisa Koski
Susanna Konsztowicz
Affiliation:
Integrated Program in Neuroscience, Department of Neurology and Neurosurgery, McGill University
Haiqun Xie
Affiliation:
Division of Experimental Medicine, Department of Medicine, McGill University
Johanne Higgins
Affiliation:
School of Rehabilitation, Faculty of Medicine, University of Montreal, Canada
Nancy Mayo
Affiliation:
Division of Clinical Epidemiology, Research Institute of the McGill University Health Centre
Lisa Koski*
Affiliation:
Division of Clinical Epidemiology, Research Institute of the McGill University Health Centre Division of Geriatrics, Research Institute of the McGill University Health Centre
*
Correspondence should be addressed to: Dr. Lisa Koski, Royal Victoria Hospital, R4.74, 687 Pine Avenue West, Montreal, Quebec, H3A 1A1, Canada. Phone: +1 (514) 934-1934 ext. 35652; Fax: +1 (514) 934-1934 ext. 31734. Email: [email protected].
Get access Rights & Permissions [Opens in a new window]

Abstract

Background: The field of geriatric medicine has identified a need for an evaluative tool that can rapidly quantify global cognitive ability and accurately monitor change over time in patients with a wide range of impairments. We hypothesized that the development of an adaptive test approach to cognitive measurement would help to meet that need. This study aimed to provide evidence for the interpretability of scores obtained from a novel, adaptive approach to cognitive assessment, called the Geriatric Rapid Adaptive Cognitive Estimate (GRACE) method.

Methods: An adaptive method for cognitive assessment was developed using data from 185 patients referred for geriatric cognitive assessment, and pilot tested in an additional 137 patients. Correlations between test scores and between rank orders of patients were computed to examine the reliability and validity of cognitive ability scores obtained by (1) administering test questions out of their usual order, (2) administering only a subset of questions, and (3) administering questions adaptively using simplified selection rules based on the most difficult question passed.

Results: Cognitive ability scores obtained with the GRACE method correlated highly with the Montreal Cognitive Assessment (MoCA) scores (r = 0.93) and ranked patients similarly in order of ability (r > 0.87). A simplified adaptive testing algorithm for pencil-and-paper assessment demonstrated moderately high correlations with scores obtained from administering the full set of MMSE and MoCA items as well as the MoCA items alone.

Conclusions: Scores from the GRACE method can be obtained easily in 5–10 minutes, reducing test burden. The resulting numeric score quantifies cognitive ability, allowing clinicians to compare patients and monitor change in global cognition over time. The adaptive nature of this method allows for evaluation of persons across a broader range of cognitive ability levels than currently available tests.

Keywords

GRACE methodMoCAMMSERasch analysisassessmentgeriatricaging
Type
Research Article
Information
International Psychogeriatrics , Volume 23 , Issue 7 , September 2011 , pp. 1116 - 1123
Copyright
Copyright © International Psychogeriatric Association 2011

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

References

American Psychiatric Association (2000). Diagnostic and Statistical Manual of Mental Disorders, 4th edn, text revision. Washington, DC: American Psychiatric Association.Google Scholar
Bond, T. G. and Fox, C. M. (2007). Applying the Rasch model: Fundamental Measurement in the Human Sciences, New Jersey: Lawrence Erlbaum Associates, Inc.Google Scholar
Chertkow, H. et al. (2007). Mild cognitive impairment and cognitive impairment, no dementia. Part A: Concept and diagnosis. Alzheimers and Dementia, 3, 266–282. doi: 10.1016/j.jalz.2007.07.013CrossRefGoogle Scholar
Cinamon, J. S., Finch, L., Miller, S., Higgins, J. and Mayo, N. (2010). Preliminary evidence for the development of a stroke specific geriatric depression scale. International Journal of Geriatric Psychiatry, 26, 188–198. doi: 10.1002/gps.2513CrossRefGoogle Scholar
Folstein, M. F., Folstein, S. E. and Mchugh, P. R. (1975). “Mini-mental state”: a practical method for grading the cognitive state of patients for the clinician. Journal of Psychiatric Research, 12, 189–198.CrossRefGoogle ScholarPubMed
Higgins, J., Finch, L. E., Kopec, J. and Mayo, N. E. (2010). Development and initial psychometric evaluation of an item bank created to measure upper extremity function in persons with stroke. Journal of Rehabilitation Medicine, 42, 170–178. doi: 10.2340/16501977-0501CrossRefGoogle ScholarPubMed
Jacova, C., Kertesz, A., Blair, M., Fisk, J. D. and Feldman, H. H. (2007). Neuropsychological testing and assessment for dementia. Alzheimers and Dementia, 3, 299–317. doi: 10.1016/j.jalz.2007.07.011CrossRefGoogle ScholarPubMed
Jones, R. N. and Gallo, J. J. (2000). Dimensions of the Mini-Mental State Examination among community dwelling older adults. Psychological Medicine, 30, 605–618.CrossRefGoogle ScholarPubMed
Koski, L., Xie, H. Q. and Finch, L. (2009). Measuring cognition in a geriatric outpatient clinic: Rasch analysis of the Montreal Cognitive Assessment. Journal of Geriatric Psychiatry and Neurology, 22, 151–160. doi: 10.1177/0891988709332944CrossRefGoogle Scholar
Koski, L., Xie, H. and Konsztowicz, S. (2011). Improving precision in the quantification of cognition using the Montreal Cognitive Assessment and the Mini-Mental State Examination. International Psychogeriatrics. E-published ahead of print. doi: 10.1017/S1041610210002450CrossRefGoogle ScholarPubMed
Montero-Odasso, M. and Muir, S. W. (2010). Simplifying detection of mild cognitive impairment subtypes. Journal of the American Geriatrics Society, 58, 992–994. doi: 10.1111/j.1532-5415.2010.02823.xCrossRefGoogle ScholarPubMed
Nasreddine, Z. S. et al. (2005). The Montreal Cognitive Assessment, MoCA: a brief screening tool for mild cognitive impairment. Journal of the American Geriatrics Society, 53, 695–699.CrossRefGoogle Scholar
Petersen, R. C. (2004). Mild cognitive impairment as a diagnostic entity. Journal of Internal Medicine, 256, 183–94. doi: 10.1111/j.1365-2796.2004.01388.xCrossRefGoogle ScholarPubMed
Rasch, G. (1960). Probabilistic Models for some Intelligence and Attainment Tests, expanded edn. Chicago: The University of Chicago Press.Google Scholar
Schultz-Larsen, K., Kreiner, S. and Lomholt, R. K. (2007a). Mini-Mental Status Examination: Mixed Rasch model item analysis derived two different cognitive dimensions of the MMSE. Journal of Clinical Epidemiology, 60, 268–279. doi: 10.1016/j.jclinepi.2006.06.007CrossRefGoogle ScholarPubMed
Schultz-Larsen, K., Lomholt, R. K. and Kreiner, S. (2007b). Mini-Mental Status Examination: a short form of MMSE was as accurate as the original MMSE in predicting dementia. Journal of Clinical Epidemiology, 60, 260–267. doi: 10.1016/j.jclinepi.2006.06.008CrossRefGoogle Scholar
Shulman, K. I. (2000). Clock-drawing: is it the ideal cognitive screening test? International Journal of Geriatric Psychiatry, 15, 548–561.3.0.CO;2-U>CrossRefGoogle ScholarPubMed
Smith, E. V. Jr. and Smith, R. M. (2004). Introduction to Rasch Measurement, Maple Grove: JAM Press.Google Scholar
Tombaugh, T. N. and McIntyre, N. J. (1992). The Mini-Mental State Examination: a comprehensive review. Journal of the American Geriatrics Society, 40, 922–935.CrossRefGoogle ScholarPubMed
Tuokko, H., Hadjistavropoulos, T., Miller, J. A. and Beattie, B. L. (1992). The Clock Test: a sensitive measure to differentiate normal elderly from those with Alzheimer's disease. Journal of the American Geriatrics Society, 40, 579–584.CrossRefGoogle Scholar
Wouters, H., Zwinderman, A. H., van Gool, W. A., Schmand, B. and Lindeboom, R. (2009). Adaptive cognitive testing in dementia. International Journal of Methods in Psychiatric Research, 18, 118–127. doi: 10.1002/Mpr.283CrossRefGoogle ScholarPubMed
Supplementary material: File

Konsztowicz Supplementary Material

Konsztowicz Supplementary Appendix

Download Konsztowicz Supplementary Material(File)
File 1.1 MB