89 Performance and Usability of a Remote App-Based Assessment of Cognition Among Older Adult Mobile Game Players and Non-Players

Abstract

Objective:

Mobile, valid, and engaging cognitive assessments are essential for detecting and tracking change in research participants and patients at risk for Alzheimer’s Disease and Related Dementias (ADRDs). The mobile cognitive app performance platform (mCAPP) includes memory and executive functioning tasks to remotely detect cognitive changes associated with aging and preclinical Alzheimer’s disease. This study assesses participants’ comfort and subjective experiences with mCAPP as the potential utility and advantage of mobile app-based assessments for remote monitoring among older adults will depend upon usability and adoptability of such technology.

Participants and Methods:

The mCAPP includes three gamified tasks: (1) a memory task involving learning and matching hidden card pairs (“Concentration”) (2) a stroop-like task (“Brick Drop”), and (3) a digit-symbol coding-like task (“Space Imposters”). Participants included 37 older adults (60% female; age=72±4.4; years of education=17±2.5; 67% White) with normal cognition enrolled in the Penn ADRC cohort. Participants completed one baseline session of mCAPP in-person, followed by two weeks of at-home use with eight scheduled sessions. Information on prior experience with mobile technology and games was collected, and usability of mCAPP was measured at baseline and after 2-weeks of use with the IBM Computer Usability Satisfaction Questionnaire and the mHeath App Usability Questionnaire (MAUQ) respectively. Feedback on perceived difficulty, enjoyment, and likelihood to play mCAPP games again on their own was collected.

Results:

Participants completed on average 11±4.9 sessions over 2 weeks, with each session lasting 11.5±2.5 minutes. 59% of participants reported using their mobile device to play games (“mobile game players”). Performance on mCAPP tasks was slower at baseline for non-players, with trend-level differences on higher-load blocks of Space Imposters (p=.057 and .059). No differences in game performance were seen between groups after playing 8 sessions at-home. There were no differences in usability of mCAPP between groups, with average usability 8.2±1.5 (IBM, 0-9 scale) at T1 and 6.2±0.8 (MAUQ, 1-7 scale) after completion of two weeks of at-home use (TLast). Reported enjoyment was moderate to high for both groups at baseline and increased over time. Likelihood to play Concentration and Brick Drop again trended lower among nonplayers at T1 (p=.061 and .054), but not at TLast. Further, change in likelihood to play mCAPP from T1 to TLast was positive among non-players, with change for Concentration significantly higher for non-players than for players (p=.037).

Conclusions:

Participants were willing and able to complete at-home cognitive testing and most completed more than the assigned sessions. While participants who do not play games on their own mobile device were slower on some tasks at baseline, these differences dissipated with further play at-home. Usability and enjoyment of mCAPP games were high regardless of mobile game-playing status, and non-players demonstrated increased willingness to play mCAPP games again at the end of participation compared to baseline. This pilot study shows preliminary feasibility and adoptability of mobile app-based assessment regardless of prior experience with mobile games.