Hostname: page-component-cd9895bd7-gxg78 Total loading time: 0 Render date: 2024-12-23T00:32:23.115Z Has data issue: false hasContentIssue false
  • English
  • Français

Reporting of Demographic Variables in Neuropsychological Research: An Update of O’Bryant et al.’s Trends in the Current Literature

Published online by Cambridge University Press:  12 November 2020

Luis D. Medina Open the ORCID record for Luis D. Medina [Opens in a new window] ,
Stephanie Torres ,
Anthony Gioia ,
Andrea Ochoa Lopez ,
James Wang  and
Paul T. Cirino
Luis D. Medina*
Affiliation:
Department of Psychology, University of Houston, Houston, TX, USA
Stephanie Torres
Affiliation:
Department of Psychology, University of Houston, Houston, TX, USA
Anthony Gioia
Affiliation:
Department of Psychology, University of Houston, Houston, TX, USA
Andrea Ochoa Lopez
Affiliation:
Department of Psychology, University of Houston, Houston, TX, USA
James Wang
Affiliation:
Department of Psychology, University of Houston, Houston, TX, USA
Paul T. Cirino
Affiliation:
Department of Psychology, University of Houston, Houston, TX, USA
*
*Correspondence and reprint requests to: Luis D. Medina, PhD, Department of Psychology, University of Houston, 3695 Cullen Blvd., Room 126 Heyne, Houston, TX77204-5022, USA. Tel.: +1 713 743 9318. Email: [email protected]
Get access Rights & Permissions [Opens in a new window]

Abstract

Objective:

Demographic trends and the globalization of neuropsychology have led to a push toward inclusivity and diversity in neuropsychological research in order to maintain relevance in the healthcare marketplace. However, in a review of neuropsychological journals, O’Bryant et al. found systematic under-reporting of sample characteristics vital for understanding the generalizability of research findings. We sought to update and expand the findings reported by O’Bryant et al.

Method:

We evaluated 1648 journal articles published between 2016 and 2019 from 7 neuropsychological journals. Of these, 1277 were original research or secondary analyses and were examined further. Articles were coded for reporting of age, sex/gender, years of education, ethnicity/race, socioeconomic status (SES), language, and acculturation. Additionally, we recorded information related to sample size, country, and whether the article focused on a pediatric or adult sample.

Results:

Key variables such as age and sex/gender (both over 95%) as well as education (71%) were frequently reported. Language (20%) and race/ethnicity (36%) were modestly reported, and SES (13%), and acculturation (<1%) were more rarely reported. SES was more commonly reported in pediatric than adult samples, and the opposite was true for education. There were differences between the present results and those of O’Bryant et al., though the same general trends remained.

Conclusions:

Reporting of demographic data in neuropsychological research appears to be slowly changing toward greater comprehensiveness, though clearly more work is needed. Greater systematic reporting of such data is likely to be beneficial for the generalizability and contextualization of neurocognitive function.

Keywords

Sample sizeEthnic groupsLanguageAcculturationSocial class
Type
Critical Review
Information
Journal of the International Neuropsychological Society , Volume 27 , Issue 5 , May 2021 , pp. 497 - 507
Copyright
Copyright © INS. Published by Cambridge University Press, 2020

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

References

REFERENCES

Adesope, O.O., Lavin, T., Thompson, T., & Ungerleider, C. (2010). A systematic review and meta-analysis of the cognitive correlates of bilingualism. Review of Educational Research, 80(2), 207–245. https://doi.org/10.3102/0034654310368803 CrossRefGoogle Scholar
American Psychological Association. (2017). Multicultural Guidelines: An Ecological Approach to Context, Identity, and Intersectionality. Retrieved from http://www.apa.org/about/policy/multicultural-guidelines.pdf Google Scholar
Appelbaum, M., Cooper, H., Kline, R.B., Mayo-Wilson, E., Nezu, A.M., & Rao, S.M. (2018). Journal article reporting standards for quantitative research in psychology: The APA Publications and Communications Board task force report. American Psychologist, 73(1), 3–25. https://doi.org/10.1037/amp0000191 CrossRefGoogle ScholarPubMed
Black, S.A., Espino, D.V., Mahurin, R., Lichtenstein, M.J., Hazuda, H.P., Fabrizio, D., Ray, L.A., & Markides, K.S. (1999). The influence of noncognitive factors on the mini-mental state examination in older Mexican-Americans: Findings from the Hispanic EPESE. Journal of Clinical Epidemiology, 52(11), 1095–1102. https://doi.org/10.1016/S0895-4356(99)00100-6 CrossRefGoogle ScholarPubMed
Cohen, J. (1988). Statistical Power Analysis for the Behavioral Sciences (2nd ed.). Mahwah, NJ: Lawrence Erlbaum. https://agris.fao.org/agris-search/search.do?recordID=US201300292307 Google Scholar
Díaz-Venegas, C., Downer, B., Langa, K.M., & Wong, R. (2016). Racial and ethnic differences in cognitive function among older adults in the USA: Cognition of US older adults by race/ethnicity. International Journal of Geriatric Psychiatry, 31(9), 1004–1012. https://doi.org/10.1002/gps.4410 CrossRefGoogle Scholar
Dotson, V.M. & Duarte, A. (2020). The importance of diversity in cognitive neuroscience. Annals of the New York Academy of Sciences, 1464(1), 181–191. https://doi.org/10.1111/nyas.14268 CrossRefGoogle ScholarPubMed
Falk, E.B., Hyde, L.W., Mitchell, C., Faul, J., Gonzalez, R., Heitzeg, M.M., … Schulenberg, J. (2013). What is a representative brain? Neuroscience meets population science. Proceedings of the National Academy of Sciences, 110(44), 17615–17622. https://doi.org/10.1073/pnas.1310134110 CrossRefGoogle ScholarPubMed
Grant, I. & Adams, K.M. (2009). Neuropsychological Assessment of Neuropsychiatric and Neuromedical Disorders. New York: Oxford University Press.Google Scholar
Heaton, R.K., Grant, I., & Matthews, C.G. (1986). Differences in neuropsychological test performance associated with age, education, and sex. In Grant, I. & Adams, K.M. (Eds.), Neuropsychological Assessment of Neuropsychiatric Disorders (pp. 100–120). New York: Oxford University Press.Google Scholar
Henrich, J., Heine, S.J., & Norenzayan, A. (2010). The weirdest people in the world? Behavioral and Brain Sciences, 33(2–3), 61–83. https://doi.org/10.1017/S0140525X0999152X CrossRefGoogle Scholar
Hughson, J., Woodward-Kron, R., Parker, A., Hajek, J., Bresin, A., Knoch, U., Phan, T., & Story, D. (2016). A review of approaches to improve participation of culturally and linguistically diverse populations in clinical trials. Trials, 17(1), 263. https://doi.org/10.1186/s13063-016-1384-3 CrossRefGoogle ScholarPubMed
Johansen, M. & Thomsen, S.F. (2016). Guidelines for reporting medical research: A critical appraisal. International Scholarly Research Notices, 2016, 1346026. https://doi.org/10.1155/2016/1346026 CrossRefGoogle ScholarPubMed
Lawson, G.M., Hook, C.J., & Farah, M.J. (2018). A meta-analysis of the relationship between socioeconomic status and executive function performance among children. Developmental Science, 21(2), e12529. https://doi.org/10.1111/desc.12529 CrossRefGoogle ScholarPubMed
Lezak, M.D., Howieson, D.B., Loring, D.W., Hannay, H.J., & Fischer, J.S. (2004). Neuropsychological Assessment (4th ed.). New York: Oxford University Press.Google Scholar
Morgan, A.A., Marsiske, M., & Whitfield, K.E. (2008). Characterizing and explaining differences in cognitive test performance between African American and European American older adults. Experimental Aging Research, 34(1), 80–100. https://doi.org/10.1080/03610730701776427 CrossRefGoogle ScholarPubMed
Mungas, D., Reed, B.R., Crane, P.K., Haan, M.N., & González, H. (2004). Spanish and English Neuropsychological Assessment Scales (SENAS): Further development and psychometric characteristics. Psychological Assessment, 16(4), 347–359. https://doi.org/10.1037/1040-3590.16.4.347 CrossRefGoogle ScholarPubMed
Nápoles, A.M., Chadiha, L.A., & Resource Centers for Minority Aging Research. (2011). Advancing the science of recruitment and retention of ethnically diverse populations. The Gerontologist, 51(Suppl 1), S142–S146. https://doi.org/10.1093/geront/gnr019 CrossRefGoogle ScholarPubMed
O’Bryant, S.E., O’Jile, J.R., & McCaffrey, R.J. (2004). Reporting of demographic variables in neuropsychological research: Trends in the current literature. The Clinical Neuropsychologist, 18(2), 229–233. https://doi.org/10.1080/13854040490501439 CrossRefGoogle ScholarPubMed
O’Driscoll, C., & Shaikh, M. (2017). Cross-cultural applicability of the Montreal Cognitive Assessment (MoCA): A systematic review. Journal of Alzheimer’s Disease, 58(3), 789–801. https://doi.org/10.3233/JAD-161042 CrossRefGoogle ScholarPubMed
Opdebeeck, C., Martyr, A., & Clare, L. (2016). Cognitive reserve and cognitive function in healthy older people: A meta-analysis. Aging, Neuropsychology, and Cognition, 23(1), 40–60. https://doi.org/10.1080/13825585.2015.1041450 CrossRefGoogle ScholarPubMed
Pan, W. (2002). Approximate confidence intervals for one proportion and difference of two proportions. Computational Statistics & Data Analysis, 40(1), 143–157. https://doi.org/10.1016/S0167-9473(01)00107-4 CrossRefGoogle Scholar
Paskett, E.D., Reeves, K.W., McLaughlin, J.M., Katz, M.L., McAlearney, A.S., Ruffin, M.T., … Gehlert, S. (2008). Recruitment of minority and underserved populations in the United States: The centers for population health and health disparities experience. Contemporary Clinical Trials, 29(6), 847–861. https://doi.org/10.1016/j.cct.2008.07.006 CrossRefGoogle ScholarPubMed
Quinteros Baumgart, C., & Billick, S.B. (2018). Positive cognitive effects of bilingualism and multilingualism on cerebral function: A review. Psychiatric Quarterly, 89(2), 273–283. https://doi.org/10.1007/s11126-017-9532-9 CrossRefGoogle ScholarPubMed
Rad, M.S., Martingano, A.J., & Ginges, J. (2018). Toward a psychology of Homo sapiens: Making psychological science more representative of the human population. Proceedings of the National Academy of Sciences, 115(45), 11401–11405. https://doi.org/10.1073/pnas.1721165115 CrossRefGoogle Scholar
Robinson, J.M. & Trochim, W.M.K. (2007). An examination of community members’, researchers’ and health professionals’ perceptions of barriers to minority participation in medical research: An application of concept mapping. Ethnicity & Health, 12(5), 521–539. https://doi.org/10.1080/13557850701616987 CrossRefGoogle ScholarPubMed
Rosenthal, J.A. (1996). Qualitative descriptors of strength of association and effect size. Journal of Social Service Research, 21(4), 37–59. https://doi.org/10.1300/J079v21n04_02 CrossRefGoogle Scholar
Rossetti, H.C., Smith, E.E., Hynan, L.S., Lacritz, L.H., Cullum, C.M., Van Wright, A., & Weiner, M.F. (2019). Detection of mild cognitive impairment among community-dwelling African Americans using the Montreal cognitive assessment. Archives of Clinical Neuropsychology, 34(6), 809–813. https://doi.org/10.1093/arclin/acy091 CrossRefGoogle ScholarPubMed
Saenz, J.L., Downer, B., Garcia, M.A., & Wong, R. (2018). Cognition and context: Rural–Urban differences in cognitive aging among older Mexican adults. Journal of Aging and Health, 30(6), 965–986. https://doi.org/10.1177/0898264317703560 CrossRefGoogle ScholarPubMed
Salthouse, T.A. (2011). Neuroanatomical substrates of age-related cognitive decline. Psychological Bulletin, 137(5), 753–784. https://doi.org/10.1037/a0023262 CrossRefGoogle ScholarPubMed
Seidenberg, M., Gamache, M.P., Beck, N.C., Smith, M., Giordani, B., Berent, S., … Boll, T.J. (1984). Subject variables and performance on the Halstead Neuropsychological Test Battery: A multivariate analysis. Journal of Consulting and Clinical Psychology, 52(4), 658–662. https://doi.org/10.1037/0022-006X.52.4.658 CrossRefGoogle ScholarPubMed
Tan, Y.W., Burgess, G.H., & Green, R.J. (2020). The effects of acculturation on neuropsychological test performance: A systematic literature review. The Clinical Neuropsychologist, 1–31. https://doi.org/10.1080/13854046.2020.1714740 Google ScholarPubMed
Torres-Ruiz, M., Robinson-Ector, K., Attinson, D., Trotter, J., Anise, A., & Clauser, S. (2018). A portfolio analysis of culturally tailored trials to address health and healthcare disparities. International Journal of Environmental Research and Public Health, 15(9). https://doi.org/10.3390/ijerph15091859 CrossRefGoogle ScholarPubMed
US Census Bureau. (2019). American Community Survey. Retrieved from https://data.census.gov/cedsci/ Google Scholar
Wall, K.J., Cumming, T.B., & Copland, D.A. (2017). Determining the association between language and cognitive tests in poststroke aphasia. Frontiers in Neurology, 8. https://doi.org/10.3389/fneur.2017.00149 CrossRefGoogle ScholarPubMed
Wendler, D., Kington, R., Madans, J., Van Wye, G., Christ-Schmidt, H., Pratt, L.A., … Emanuel, E. (2006). Are racial and ethnic minorities less willing to participate in health research? PLoS Medicine, 3(2), e19. https://doi.org/10.1371/journal.pmed.0030019 CrossRefGoogle ScholarPubMed
Wong, H.S. & Edwards, P. (2013). Nature or nurture: A systematic review of the effect of socio-economic status on the developmental and cognitive outcomes of children born preterm. Maternal and Child Health Journal, 17(9), 1689–1700. https://doi.org/10.1007/s10995-012-1183-8 CrossRefGoogle ScholarPubMed
Wu, Y.-T., Prina, A.M., & Brayne, C. (2015). The association between community environment and cognitive function: A systematic review. Social Psychiatry and Psychiatric Epidemiology, 50(3), 351–362. https://doi.org/10.1007/s00127-014-0945-6 CrossRefGoogle ScholarPubMed
Xu, H., Zhang, Y., & Wu, B. (2017). Association between migration and cognitive status among middle-aged and older adults: A systematic review. BMC Geriatrics, 17(1), 184. https://doi.org/10.1186/s12877-017-0585-2 CrossRefGoogle ScholarPubMed
Yancey, A.K., Ortega, A.N., & Kumanyika, S.K. (2006). Effective recruitment and retention of minority research participants. Annual Review of Public Health, 27(1), 1–28. https://doi.org/10.1146/annurev.publhealth.27.021405.102113 CrossRefGoogle ScholarPubMed
Yano, K., Grove, J.S., Masaki, K.H., White, L.R., Petrovitch, H., Chen, R., … Curb, J.D. (2000). The effects of childhood residence in Japan and testing language on cognitive performance in late life among Japanese American men in Hawaii. Journal of the American Geriatrics Society, 48(2), 199–204. https://doi.org/10.1111/j.1532-5415.2000.tb03912.x CrossRefGoogle ScholarPubMed
Zell, E., Krizan, Z., & Teeter, S.R. (2015). Evaluating gender similarities and differences using metasynthesis. American Psychologist, 70(1), 10–20. https://doi.org/10.1037/a0038208 CrossRefGoogle ScholarPubMed