Hostname: page-component-586b7cd67f-g8jcs Total loading time: 0 Render date: 2024-11-24T14:42:05.817Z Has data issue: false hasContentIssue false
  • English
  • Français

Accounting for estimated IQ in neuropsychological test performance with regression-based techniques

Published online by Cambridge University Press:  01 November 2009

S. MARC TESTA ,
JESSICA M. WINICKI ,
GODFREY D. PEARLSON ,
BARRY GORDON  and
DAVID J. SCHRETLEN
S. MARC TESTA
Affiliation:
Department of Psychiatry and Behavioral Sciences, Johns Hopkins University School of Medicine, Baltimore, Maryland
JESSICA M. WINICKI
Affiliation:
Department of Psychiatry and Behavioral Sciences, Johns Hopkins University School of Medicine, Baltimore, Maryland
GODFREY D. PEARLSON
Affiliation:
Department of Psychiatry and Behavioral Sciences, Johns Hopkins University School of Medicine, Baltimore, Maryland Olin Neuropsychiatry Research Center, Institute of Living/Hartford Hospital, Hartford, Connecticut Department of Psychiatry, Yale University School of Medicine, New Haven, Connecticut
BARRY GORDON
Affiliation:
Department of Neurology, Johns Hopkins University School of Medicine, Baltimore, Maryland
DAVID J. SCHRETLEN*
Affiliation:
Department of Psychiatry and Behavioral Sciences, Johns Hopkins University School of Medicine, Baltimore, Maryland Russell H. Morgan Department of Radiology and Radiological Science, Johns Hopkins University School of Medicine, Baltimore, Maryland
*
*Correspondence and reprint requests to: David J. Schretlen, Johns Hopkins Hospital, 600 N. Wolfe Street, Meyer 218, Baltimore, MD 21287-7218. E-mail: [email protected]
Get access Rights & Permissions [Opens in a new window]

Abstract

Regression-based normative techniques account for variability in test performance associated with multiple predictor variables and generate expected scores based on algebraic equations. Using this approach, we show that estimated IQ, based on oral word reading, accounts for 1–9% of the variability beyond that explained by individual differences in age, sex, race, and years of education for most cognitive measures. These results confirm that adding estimated “premorbid” IQ to demographic predictors in multiple regression models can incrementally improve the accuracy with which regression-based norms (RBNs) benchmark expected neuropsychological test performance in healthy adults. It remains to be seen whether the incremental variance in test performance explained by estimated “premorbid” IQ translates to improved diagnostic accuracy in patient samples. We describe these methods, and illustrate the step-by-step application of RBNs with two cases. We also discuss the rationale, assumptions, and caveats of this approach. More broadly, we note that adjusting test scores for age and other characteristics might actually decrease the accuracy with which test performance predicts absolute criteria, such as the ability to drive or live independently. (JINS, 2009, 15, 1012–1022.)

Keywords

AdultPsychometricsNeuropsychological testsIntelligenceDiagnostic errorsBiometry
Type
Research Articles
Information
Journal of the International Neuropsychological Society , Volume 15 , Issue 6 , November 2009 , pp. 1012 - 1022
Copyright
Copyright © The International Neuropsychological Society 2009

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

References

REFERENCES

Axelrod, B.N., & Millis, S.R. (1994). Preliminary standardization of the Cognitive Estimation Test. Assessment, 1, 269–274.CrossRefGoogle Scholar
Axelrod, B.N., Ryan, J.J., & Ward, L.C. (2001). Evaluation of seven-subtest short forms of the Wechsler Adult Intelligence Scale-III in a referred sample. Archives of Clinical Neuropsychology, 16, 1–8.CrossRefGoogle Scholar
Benedict, H.R.B. (1997). Brief Visuospatial Memory Test-Revised Professional Manual. Odessa, FL: Psychological Assessment Resources, Inc.Google Scholar
Benton, A.L., Sivan, A.B., deS Hamsher, K., Varney, N.R., & Spreen, O. (1994). Contributions to Neuropsychological Assessment: A Clinical Manual (2nd ed.). New York: Oxford University Press.Google Scholar
Binet, A., & Simon, T. (1916). Application of the New Methods to the Diagnosis of the Intellectual Level Among Normal and Subnormal Children in Institutions and in the Primary Schools (L’Annee Psych., 1905, pp. 245–336) (Kite, E.S., Trans.). Baltimore, MD: Williams & Wilkins Co.Google Scholar
Blair, J.R., & Spreen, O. (1989). Predicting premorbid IQ: A revision of the National Adult Reading Test. Clinical Neuropsychologist, 3, 129–136.CrossRefGoogle Scholar
Brandt, J., & Benedict, H.R.B. (2001). Hopkins Verbal Learning Test-Revised Professional Manual. Odessa, FL: Psychological Assessment Resources, Inc.Google Scholar
Bright, P., Jaldow, E., & Kopelman, M.D. (2002). The National Adult Reading Test as a measure of premorbid intelligence: A comparison with estimates derived from demographic variables. Journal of the International Neuropsychological Society, 8, 847–854.CrossRefGoogle ScholarPubMed
Cockburn, J., Keene, J., Hope, T., & Smith, P. (2000). Progressive decline in NART score with increasing dementia severity. Journal of Clinical and Experimental Neuropsychology, 22, 508–517.CrossRefGoogle ScholarPubMed
Cohen, J. (1988). Statistical Power Analysis for the Behavioral Sciences (2nd ed.). Hillsdale, NJ: Lawrence Earlbaum Associates.Google Scholar
Cohen, J., Cohen, P., West, S.G., & Aiken, L.S. (2003). Applied Multiple Regression/Correlation Analysis for the Behavioral Sciences (3rd ed.). Mahwah, NJ: Lawrence Erlbaum Associates Publishers.Google Scholar
Crawford, J.R., & Garthwaite, P.H. (2002). Investigation of the single case in neuropsychology: Confidence limits on the abnormality of test scores and test score differences. Neuropsychologia, 40, 1196–1208.CrossRefGoogle ScholarPubMed
Crawford, J.R., & Garthwaite, P.H. (2006). Comparing patients’ predicted test scores from a regression equation with their obtained scores: A significance test and point estimate of abnormality with accompanying confidence limits. Neuropsychology, 20, 259–271.CrossRefGoogle ScholarPubMed
Crawford, J.R., & Howell, D.C. (1998). Regression equations in clinical neuropsychology: An evaluation of statistical methods for comparing predicted and obtained scores. Journal of Clinical and Experimental Neuropsychology, 20, 755–762.CrossRefGoogle ScholarPubMed
Drebing, C.E., Van Gorp, W.G., Stuck, A.E., Mitrushina, M., & Beck, J. (1994). Early detection of cognitive decline in higher cognitively functioning older adults: Sensitivity and specificity of a neuropsychological screening battery. Neuropsychology, 8, 31–38.CrossRefGoogle Scholar
Folstein, M.F., Folstein, S.E., & McHugh, P.R. (1975). “Mini-mental state”. A practical method for grading the cognitive state of patients for the clinician. Journal of Psychiatric Research, 12, 189–198.CrossRefGoogle Scholar
Friedman, J. (1991). Multivariate adaptive regression splines. Annals of Statistics, 19, 1–67.Google Scholar
Goodglass, H., & Kaplan, E. (1983). Boston Diagnostic Aphasia Examination. Philadelphia: Lea and Febiger.Google Scholar
Graves, R.E., Carswell, L.M., & Snow, W.G. (1999). An evaluation of the sensitivity of premorbid IQ estimators for detecting cognitive decline. Psychological Assessment, 11, 29–38.CrossRefGoogle Scholar
Harnett, M.A., Godfrey, H.P.D., & Knight, R.G. (2004). Regression equations for predicting premorbid performance on executive test measures by persons with traumatic brain injuries. New Zealand Journal of Psychology, 33, 78–87.Google Scholar
Heaton, R.K., Grant, R., & Matthews, C.G. (1991). Comprehensive Norms for an Expanded Halstead-Reitan Battery: Demographic Corrections, Research Findings, and Clinical Applications. Odessa, FL: Psychological Assessment Resources, Inc.Google Scholar
Heaton, R.K., Miller, S.W., Taylor, M.J., & Grant, I. (2004). Revised Comprehensive Norms for an Expanded Halstead-Reitan Battery: Demographically Adjusted Neuropsychological Norms for African American and Caucasian adults. Lutz, FL: Psychological Assessment Resources, Inc.Google Scholar
Johnstone, B., Callahan, C.D., Kapila, C.J., & Bouman, D.E. (1996). The comparability of the WRAT-R reading test and NAART as estimates of premorbid intelligence in neurologically impaired patients. Archives of Clinical Neuropsychology, 11, 513–519.CrossRefGoogle ScholarPubMed
Kingery, L.R., Schretlen, D.J., Sateri, S., Langley, L.K., Marano, N.C., & Meyer, S.M. (2006) Inter–rater and test–retest reliability of a fixed condition design fluency test. Clinical Neuropsychologist. 20, 729–740.CrossRefGoogle Scholar
Kløve, H. (1963). Clinical neuropsychology. In Forster, F.M. (Ed.), Medical Clinics of North America. New York: Saunders.Google Scholar
Knight, R.G., McMahon, J., Green, T.J., & Skeaff, C.M. (2006). Regression equations for predicting scores of persons over 65 on the Rey Auditory Verbal Learning Test, the Mini-Mental State Examination, the Trail Making Test and semantic fluency measures. British Journal of Clinical Psychology, 45, 393–402.CrossRefGoogle ScholarPubMed
Manly, J.J., Jacobs, D.M., Touradji, P., Small, S.A., & Stern, Y. (2002). Reading level attenuates differences in neuropsychological test performance between African American and White elders. Journal of the International Neuropsychological Society, 8, 341–348.CrossRefGoogle ScholarPubMed
McGurn, B., Starr, J.M., Topfer, J.A., Pattie, A., Whiteman, M.C., Lemmon, H.A., et al. (2004). Pronunciation of irregular words is preserved in dementia, validating premorbid IQ estimation. Neurology, 62, 1184–1186.CrossRefGoogle ScholarPubMed
Meyers, J.E., & Meyers, K.R. (1995). Rey Complex Figure Test and Recognition Trial Professional Manual. Odessa, FL: Psychological Assessment Resources, Inc.Google Scholar
Mitrushina, M., Boone, K.B., Razani, J., & D’Elia, L. (2005). Handbook of Normative Data for Neuropsychological Assessment. New York: Oxford.Google Scholar
Nelson, H.E. (1976). A modified card sorting test sensitive to frontal lobe defects. Cortex, 11, 918–932.Google Scholar
Patterson, K.E., Graham, N., & Hodges, J.R. (1994). Reading in dementia of the Alzheimer type: A preserved ability? Neuropsychology, 8, 395–412.CrossRefGoogle Scholar
Reitan, R.M. (1958). Validity of the Trail Making Test as an indicator of organic brain damage. Perceptual and Motor Skills, 8, 271–276.CrossRefGoogle Scholar
Rentz, D.M., Huh, T.J., Faust, R.R., Budson, A.E., Scinto, L.F., Sperling, R.A., et al. (2004). Use of IQ-adjusted norms to predict progressive cognitive decline in highly intelligent older individuals. Neuropsychology, 18, 38–49.CrossRefGoogle ScholarPubMed
Rentz, D.M., Huh, T.J., Sardinha, L.M., Moran, E.K., Becker, J.A., Daffner, K.R., et al. (2007). Intelligence quotient-adjusted memory impairment is associated with abnormal single photon emission computed tomography perfusion. Journal of the International Neuropsychological Society, 13, 821–831.CrossRefGoogle ScholarPubMed
Rentz, D.M., Sardinha, L.M., Huh, T.J., Searl, M.M., Daffner, K.R., & Sperling, R.A. (2006). IQ-based norms for highly intelligent adults. Clinical Neuropsychologist, 20, 637–648.CrossRefGoogle ScholarPubMed
Rey, A., & Osterrieth, P.A. (1993). Translations of excerpts from Andre Rey’s psychological examination of traumatic encephalopathy and P.A. Osterrieth’s Complex Figure Copy Test. Clinical Neuropsychologist, 7, 4–21.Google Scholar
Salthouse, T., Toth, J., Daniels, K., Parks, C., Pak, R., & Wolbrette, M. (2000). Effects of aging on efficiency of task switching in a variant of the trail making test. Neuropsychology, 14, 102–111.CrossRefGoogle Scholar
Schretlen, D.J. (1997). Brief Test of Attention Professional Manual. Odessa, FL: Psychological Assessment Resources, Inc.Google Scholar
Schretlen, D.J., Buffington, A.L., Meyer, S.M., & Pearlson, G.D. (2005). The use of word-reading to estimate “premorbid” ability in cognitive domains other than intelligence. Journal of the International Neuropsychological Society, 11, 784–787.CrossRefGoogle ScholarPubMed
Schretlen, D.J., Testa, S.M., Winicki, J.M., Pearlson, G.D., & Gordon, B. (2008). Frequency and bases of abnormal performance by healthy adults on neuropsychological testing. Journal of the International Neuropsychological Society, 14, 436–445.CrossRefGoogle ScholarPubMed
Schretlen, D.J., Winicki, J.M., Meyer, S.M., Testa, S.M., Pearlson, G.D., & Gordon, B. (2009). Development, Psychometric Properties, and Validity of the Hopkins Adult Reading Test (HART). Clinical Neuropsychologist, 23, 926–943.CrossRefGoogle ScholarPubMed
Silverberg, N.D., & Millis, S.R. (2009). Impairment versus deficiency in neuropsychological assessment: Implications for ecological validity. Journal of the International Neuropsychological Society, 15, 94–102.CrossRefGoogle ScholarPubMed
Stebbins, G.T., Wilson, R.S., Gilley, D.W., & Bernard, B.A. (1990). Use of the National Adult Reading Test to estimate premorbid IQ in dementia. Clinical Neuropsychologist, 4, 18–24.CrossRefGoogle ScholarPubMed
Steinberg, B.A., & Bieliauskas, L.A. (2005). Introduction to the special edition: IQ-based MOANS norms for multiple neuropsychological instruments. Clinical Neuropsychologist, 19, 277–279.CrossRefGoogle Scholar
Steinberg, B.A., Bieliauskas, L.A., Smith, G.E., & Ivnik, R.J. (2005). Mayo’s older Americans normative studies: Age- and IQ-adjusted norms for the Wechsler Memory Scale--Revised. Clinical Neuropsychologist, 19, 378–463.CrossRefGoogle ScholarPubMed
Stern, W., & Whipple, G.M. (1914). The psychological methods of testing intelligence. Baltimore, MD: Warwick & York.Google Scholar
Stevens, J.P. (2002). Applied multivariate statistics for the social sciences (4th ed.). Mahwah, NJ: Lawrence Erlbaum Associates.Google Scholar
Terman, L.M., & Terman, L.M. (1916). The uses of intelligence tests. In The Measurement of Intelligence (pp. 3–21). Boston: Houghton, Mifflin and Company.CrossRefGoogle Scholar
Testa, S.M., & Schretlen, D.J. (2006). Diagnostic utility of regression based norms in schizophrenia. Clinical Neuropsychologist, 20, 206.Google Scholar
Van Der Elst, W., Van Boxtel, M.P.J., Van Breukelen, G.J.P., & Jolles, J. (2006). The Stroop color-word test: Influence of age, sex, and education; and normative data for a large sample across the adult age range. Assessment, 13, 62–79.CrossRefGoogle ScholarPubMed
Ward, L.C. (1990). Prediction of verbal, performance, and full scale IQs from seven subtests of the WAIS-R. Journal of Clinical Psychology, 46, 436–440.3.0.CO;2-M>CrossRefGoogle ScholarPubMed
Wechsler, D. (1981). Wechsler Adult Intelligence Scale-Revised. New York: Psychological Corporation.Google Scholar
Wechsler, D. (1987). Wechsler Memory Scale - Revised. San Antonio, TX: Psychological Corporation.Google Scholar
Wechsler, D. (1997). Wechsler Adult Intelligence Scale - Third Edition. San Antonio, TX: Psychological Corporation Harcourt Brace & Company.Google Scholar
Wilkinson, G.S. (1993). WRAT3 Wide Range Achievement Test Administration Manual. Wilmington, DE: Wide Range, Inc.Google Scholar
Wing, J.K., Sartorius, N., & Ustun, T.B. (1996). Schedules for Clinical Assessment in Neuropsychiatry (SCAN) Version 2.1. Geneva: World Health Organization.Google Scholar
Zachary, R.A., & Gorsuch, R.L. (1985). Continuous norming: Implications for the WAIS--R. Journal of Clinical Psychology, 41, 86–94.3.0.CO;2-W>CrossRefGoogle ScholarPubMed