Hostname: page-component-586b7cd67f-vdxz6 Total loading time: 0 Render date: 2024-11-23T16:04:50.814Z Has data issue: false hasContentIssue false

Visual inspection time as an accessible measure of processing speed: A validation study in children with cerebral palsy

Published online by Cambridge University Press:  13 November 2024

Jacqueline N. Kaufman*
Affiliation:
Department of Physical Medicine and Rehabilitation, University of Michigan – Ann Arbor, Ann Arbor, MI, USA
Marie Van Tubbergen
Affiliation:
Department of Physical Medicine and Rehabilitation, University of Michigan – Ann Arbor, Ann Arbor, MI, USA
Jacobus Donders
Affiliation:
Mary Free Bed Rehabilitation Hospital Grand Rapids, Grand Rapids, MI, USA
Seth Warschausky
Affiliation:
Department of Physical Medicine and Rehabilitation, University of Michigan – Ann Arbor, Ann Arbor, MI, USA
*
Corresponding author: Jacqueline N. Kaufman; Email: [email protected]
Rights & Permissions [Opens in a new window]

Abstract

Objective:

This study examined the validity of a visual inspection time (IT) task as a measure of processing speed (PS) in a sample of children with and without cerebral palsy (CP). IT tasks measure visualization speed without focusing on the motor response time to indicate decision making about the properties of those stimuli.

Methods:

Participants were 113 children ages 8–16, including 45 with congenital CP, and 68 typically developing peers. Measures were a standard visual IT task that required dual key responding and a modified version using an assistive technology button with response option scanning. Performance on these measures was examined against traditional Wechsler PS measures (Coding, Symbol Search).

Results:

IT performance shared considerable variance with traditional paper-pencil PS measures for the group with CP, but not necessarily in the typically developing group. Concurrent validity was found for both IT task versions with traditional PS measures in the group with CP. IT classification accuracy for lowered PS showed modest sensitivity and good specificity particularly for the modified IT task.

Conclusions:

As measures of PS in children with CP who are unable to validly participate in traditional PS tasks, IT tasks demonstrate adequate concurrent validity and may serve as a beneficial alternative measure of PS in this population.

Type
Research Article
Creative Commons
Creative Common License - CCCreative Common License - BY
This is an Open Access article, distributed under the terms of the Creative Commons Attribution licence (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted re-use, distribution and reproduction, provided the original article is properly cited.
Copyright
© The Author(s), 2024. Published by Cambridge University Press on behalf of International Neuropsychological Society

Introduction

Cerebral palsy (CP) is the most common neurological condition associated with childhood physical disability, with incidence estimated at 2-3/1000 live births (Odding et al., Reference Odding, Roebroeck and Stam2006; Paneth et al., Reference Paneth, Hong and Korzeniewski2006). CP involves increased risk for speech, motor, and/or cognitive impairments. Although there is an extensive literature on risks for motor and sensory impairments associated with CP, the neuropsychological risks are less well characterized, stemming in part from the difficulty associated with valid test administration in this population (Coenen et al., Reference Coenen, Eggink, Tijssen and Spikman2018; Laporta-Hoyos et al., Reference Laporta-Hoyos, Ballester-Plane, Leiva, Ribas, Miralbell, Torroja-Nualart and Pueyo2019; Stadskleiv, Reference Stadskleiv2020). This is particularly true for individuals with more severe CP who are at significant risk for cognitive impairments, yet paradoxically face barriers to participation in standardized testing due to high motor and speech response demands inherent in common assessment instruments. These accessibility issues are most evident for processing speed (PS) measures in which the construct of interest is cognitive PS, yet performance outcomes are confounded by response demands which typically are clerical in nature, and often require significant graphomotor control and speed. These barriers and needs highlight the importance of developing alternative testing strategies that include modifications and response strategies that are accessible for individuals with motor and speech impairments in accord with the American Psychological Association Guidelines for Assessment and Intervention with Persons with Disabilities (American Psychological Association, 2022).

The use of modified neuropsychological and psycho-educational batteries to optimize inclusion and accessibility is not novel and many populations have benefitted from such modifications. Intelligence tests such as the Leiter International Performance Scale (Roid & Miller, 1995, Reference Roid and Miller1997), Comprehensive Test of Nonverbal Intelligence (Hammill et al., Reference Hammill, Pearson and Wiederholt1997) and the Raven’s Progressive Matrices (Raven, Reference Raven1998) measure aspects of intellectual reasoning while largely mitigating hearing, language production, and significant motor response demands that may interfere with task performance (e.g., permitting pointing and use of card-exchange systems). There have been limited efforts to assess cognition using alternate formats to address the motor response limitations associated with severe CP. Modifications have included the conversion of items into forced-choice formats (Berninger et al., Reference Berninger, Gans, St James and Connors1988) and measuring event-related brain potentials to indicate responses (Byrne et al., Reference Byrne, Dywan and Connolly1995). Standardized quadrant forced-choice format tests modified for computerized stimulus presentation with assistive technology response options have shown excellent measurement agreement with standard versions (Warschausky et al., Reference Warschausky, Van Tubbergen, Asbell, Kaufman, Ayyangar and Donders2011).

Slowed PS (i.e., longer processing time) is one of the most robust neuropsychological findings following traumatic brain injury (TBI) and a wide range of neurological diseases (Marco et al., Reference Marco, Harrell, Brown, Hill, Jeremy, Kramer, Sherr and Paul2012; Oprandi et al., Reference Oprandi, Oldrati, Delle Fave, Panzeri, Gandola, Massimino and Poggi2021; Shultz et al., Reference Shultz, Hoskinson, Keim, Dennis, Taylor, Bigler, Rubin, Vannatta, Gerhardt, Stancin and Yeates2016; Treble-Barna et al., Reference Treble-Barna, Zang, Zhang, Taylor, Yeates and Wade2017). PS performance improves through childhood; developmentally, increased PS is associated with increased working memory capacity (Fry & Hale, Reference Fry and Hale2000). PS is also associated with verbal learning; Wechsler Intelligence Scale for Children (WISC)-III PS predicts performance on list learning tasks (Donders & Nesbit-Greene, Reference Donders and Nesbit-Greene2004; O’Jile et al., Reference O’Jile, Schrimsher and O’Bryant2005). In children with ADHD, PS was found to be significantly associated with oral reading fluency performance (Jacobson et al., Reference Jacobson, Ryan, Martin, Ewen, Mostofsky, Denckla and Mahone2011).

While often used interchangeably, there are subtle definitional variations in concepts of speed of reasoning. PS broadly is the time required for identification, discrimination, and integration of stimuli and the associated time to make a decision about those stimuli. Visual inspection time (IT) is the time required to make an observation (visually) and to identify the visual/physical properties of the stimulus. Visual IT has been studied extensively as a measure of general speed of processing in typically developing samples. Data suggest that distinct factors of PS include movement time, decision time, perceptual speed, and visualization speed (O’Connor & Burns, Reference O’Connor and Burns2003). Research suggests that while IT is a measure of general speed of processing, it more specifically measures speed of visualization as one component of PS (O’Connor & Burns, Reference O’Connor and Burns2003). Studies have shown that IT correlates with general intellect (Chaiken, Reference Chaiken1994), though some evidence suggests that there is no clear causal relationship between intellect and IT (Luciano et al., Reference Luciano, Posthuma, Wright, de Geus, Smith, Geffen and Martin2005).

Most experimental measures of IT target stimulus duration as the measurement of primary interest rather than speed of motor responding to evaluate PS; therefore, this is an appealing measure of an aspect of PS for use in a population of individuals with known motor and/or speech impairments. Rather than measuring speeded motor responses, traditional measures of IT involve brief (e.g., less than 1000 ms) stimulus presentations followed by probes for examinees to indicate what they have seen. While in typical PS measures speed of responding is the measured outcome, IT tasks manipulate stimuli at the front end by controlling the length of time the individual has access to the target stimulus (i.e., IT stimulus duration). Responses are judged by accuracy in describing the stimulus characteristics (correct/incorrect) rather than speed of responses. IT tasks can range from making a simple decision about a visual stimulus such as the shape or direction of a stimulus or may involve higher level abstract decision making depending upon the construct of interest. Accurate stimulus characterization following a short visualization period would reflect fast PS while the need for a longer visualization period reflects slower PS (Burns et al., Reference Burns, Nettelbeck and Cooper1999).

Children with CP have been shown to exhibit slower IT than typically developing peers with similar age, socioeconomic status and vocabulary level (Shank et al., Reference Shank, Kaufman, Leffard and Warschausky2010). Specifically, using a traditional IT task in which the child was required to use keyboard arrow keys to indicate which leg of a Pi stimulus was longer, children with CP had IT thresholds that were approximately a standard deviation slower than peers. Clearly, for a subset of children with CP, arrow key dexterity demands make even this type of testing inaccessible. To enhance the accessibility of the IT task, Kaufman et al. (Reference Kaufman, Donders and Warschausky2014) developed a modified version that could be used with an assistive technology pressure switch interface, further reducing the motor response demands.

The current study examined the validity of standard and modified versions of a visual IT test, as accessible measures of PS in children with CP compared to typically developing peers (TD). The modified version of IT included a single pressure switch response, allowing response selection from two on-screen choices which were “auto-scanned” following presentation of the stimulus probe. The goal of evaluating these IT measures is to determine their utility in the clinical setting, thus concurrent validity was assessed to establish potential overlap of constructs between the experimental measure and traditional clinical (paper-pencil) PS measures.

Method

Participants

Data were collected with University of Michigan Institutional Review Board approval, as part of a larger ongoing study examining the psychometrics of modified assessment instruments for children with CP. The research was completed in accordance with Helsinki Declaration. The participants included 45 children with a medical diagnosis of CP who were physically capable of completing all measures examined, and 68 typically developing (TD) children without any history of developmental, educational, or neurological problems who served as controls. The samples include the original 34 children with CP and 68 of the 70 typically developing peers from Shank et al. (Reference Shank, Kaufman, Leffard and Warschausky2010) and a subset of the sample described in Kaufman et al. (Reference Kaufman, Donders and Warschausky2014) including all participants who were administered both the IT and WISC-III PS subtests. All children were between the ages of 8 and 16 years. Inclusion criteria for the group with CP included the ability to make a reliable dichotomous choice (Van Tubbergen et al., Reference Van Tubbergen, Warschausky, Birnholz and Baker2008) as well as sufficient fine motor dexterity to reliably depress a single computer keyboard key. In addition, all children were required to pass a graded IT training process that ensured ability to visually identify test stimuli from lures (e.g., circles, triangles), ability to match to target and practice of task demands under long stimulus durations (e.g., 2000–3000 ms), and comprehension of task instructions. Exclusion criteria included a history of clear major neurological disorder (i.e., onset of new condition that occurred after stable period of CP diagnosis such as tumor, brain injury from sports or auto accident or new onset encephalopathy) unrelated to CP or psychiatric condition (major depression or psychosis), and recent changes in medication with known or suspected cognitive or psychoactive effects. There was a significant group difference in medication use (TD group 22.1%, CP 60%), X2 (1, N = 113) = 16.69, p < .001, V = .38. TD group medications included stimulants (5), psychiatric (2), allergy (4), and other (6). Medication in the CP group included stimulants (9), psychiatric (1), anti-seizure (4), anti-spasticity (4), allergy, (5) and other (13). Characteristics of the final groups were derived from a parent-completed intake form (Table 1). Group differences in gender distribution, age, socioeconomic status (Hollingshead, Reference Hollingshead1975) and receptive vocabulary were not statistically significant (p > .05 for all variables). There were significant group differences in gestation, t (104) = 48.18, p < .001, 2 = .32, birth weight, t (106) = 49.61, p < .001, 2 = .32, and seizure history, X2 (1, N = 110) = 13.44, p < .001, V = .35, with shorter gestation, lower birth weight and significant seizure history in the group with CP.

Table 1. Background characteristics by group

Note: CP = cerebral palsy. TD = typically developing. SES = socioeconomic status.

PPVT–III = Peabody Picture Vocabulary Test—Third Edition.

**p < .001.

There was a statistically significant group difference in race and ethnicity, with a relatively greater proportion of minority representation in the TD group than in the group with CP, χ 2 (1, N = 113) = 18.97, p < .001, Cramer’s V = .41. In the TD Group 29.4% of the children was African American, while 4.4% of the group with CP was African American. Within the TD group, race and ethnicity differences in IT thresholds were not statistically significant, however, there were significant race and ethnicity differences in Coding, F (3,68) = 5.56, p < .01, 2 = .21, and Symbol Search, F (3,68) = 6.55, p < .01, 2 = .23, with lower performance in the minority groups. Those groups had lower levels of maternal education, which in turn was correlated with PSI performance, Spearman’s r = .31, p < .05.

In the group with CP, 87.9% of the sample had spastic CP, 6.1% dystonic CP and 6.1% ataxic CP. Motor topographical subtypes were 48.8% diplegic, 43.9% hemiplegic and 7.3% mixed. Gross motor function was evaluated with the Gross Motor Function Classification System (GMFCS) (Palisano et al., Reference Palisano, Rosenbaum, Walter, Russell, Wood and Galuppi1997) with group functional levels as follows: Level 1 (near normal, walks without limitations) 68.90%, n = 31; Level II (mild difficulty; walks with limitations) 11.10%, n = 5; Level III (moderate difficulty; walks using a hand-held mobility device) 15.60%, n = 7; Level IV (moderate to severe difficulties; self-mobility with limitations - may use power chair) 2.20%, n = 1; and V (severely limited; transported in a manual wheelchair) 2.20%, n = 1. The level of manual dexterity of the group with CP was characterized with the Manual Ability Classification System (Eliasson et al., Reference Eliasson, Krumlinde-Sundholm, Rosblad, Beckung, Arner, Ohrvall and Rosenbaum2006) as follows: Level I (near normal; handles most objects successfully) 22.22%, n = 10; Level II (mild difficulty; handles objects but with reduced quality/speed) 66.67%, n = 30; Level III (moderate difficulty; handles objects with difficulty/needs help for activities) 8.89%, n = 4; Level IV (moderate to severe difficulties; handles a limited selection of easily managed objects) 0; and Level V (severely limited; does not handle objects and requires total assistance) 2.22%, n = 1. The four participants at Level III despite moderate difficulty handling objects were able to complete both PSI tasks, obtaining scale scores ranging from 1-5, with all but one scale score>1. The single participant at MACS V was able to complete the PSI tasks, obtaining raw scores of 21 and 12, and scaled scores of 1 and 2 on the Coding and Symbol Search task, respectively.

Measures

Inspection time task

All participants were seated upright in either a standard desk chair (if motor function permitted), or in a personal wheelchair at an angle most closely approximating a standard desk chair while maintaining participant comfort and ability to respond. Stimuli were presented using a visual angle of approximately 10° based on nose-to-screen distance at the initiation of task and stimulus height of 10 cm. Due to the presence of spasticity, fidgeting and uncontrolled movements in many participants, visual angle ultimately varied over the course of stimulus presentation but this did not appear to negatively affect ability to see stimuli. The IT tasks were administered using a standard personal computer with MultiSync LCD 1860NX screen by NEC (Magna, UT). Stimuli were presented using the Presentation stimulus delivery platform software (Neurobehavioral Systems, Inc., Albany, California).

Each child began the IT task with five pre-task training modules intended to establish the participant’s capacity to comprehend task demands, as well as to provide scaffold training for those participants who may have conceptual difficulties with task demands. Graded conceptual training allowed children to first practice simple target identification and matching before moving on to the more complex final task demands. Prior to formal test administration, all participants practiced a slowed version of the final tasks (Figure 1) using both required response modalities; a standard keyboard (standard condition; Figure 1 upper) and a single button response pressure switch device with dichotomous choice scanning (modified condition; Figure 1 lower). All participants met criterion accuracy for each training module described below and continued to the formal task including counterbalanced participation in both the standard IT condition and the modified condition of the task.

Figure 1. Standard (upper) and modified (lower) visual inspection time tasks. Note: In both standard (upper) and adapted (lower) versions of the IT task, participants are presented with a fixation point for 3000 ms (A) which briefly brightens for 1500 ms (B) then clears (C) to alert to pending stimulus presentation (D) of varying duration. Stimuli are immediately followed by a visual mask (E) to prevent visual rehearsal of the target stimulus. Standard administration (upper) followed with a blank screen (Fstandard) and keyboard response (Gstandard), while the adapted administration (lower) showed selection options with an alternating selection box (Fadapted) with pressure switch response to target (Gadapted).

Both the standard and modified versions of the IT task were identical throughout the period of stimulus presentation (see Figure 1, Steps A through E), with task variations occurring only for the selection screen (F), and the response modality (G). Participants were shown a fixation point for 3000 ms (A) with brightening (B) lasting 1500ms to assist with orientation to impending stimulus presentation. A clear screen (C) was followed by the target stimulus presentation with varying duration (D). A visual stimulus mask (E) was used to prevent visual rehearsal of the target (on-screen mask duration = 1000ms – (DurationTarget + 25 ms)). In the standard task condition (Figure 1, upper), mask stimuli are followed by a blank screen (F) which remains for duration of participant response using keyboard arrow keys to the question, “which side of the figure had the longer leg?” In the modified task condition participants were shown both a correct target and an inverse stimulus which served as a lure. A selection box alternated between stimulus choices at a scan rate determined by the participant to be a comfortable pace (i.e., allowed participant to initiate and complete motor response while preferred stimulus choice was selected). There were significant group differences in scan rate for both the standard (TD M = 1476.5 (103.8) msec, CP M = 1547.7 (252.00)), F (1,112) = 4.32, p < .05, pή2 = .04, and modified (TD M = 1476.5 (103.8) msec, CP M = 1585.7 (235.4)), F (1, 110) = 11.18, p < .01, pή2 = .09, conditions with slower scan rates in the group with CP. Response selection in the modified condition (G modified) was by pressure switch (BigRed®, AbleNet, Inc. Roseville, MN).

A brief manual was utilized to ensure standardized training for IT task completion was employed for all participants. Assessments were completed in one session. Participants were given breaks as needed either by direct request of the participant, or by observation of the examiner that the participant was fatigued or inadequately engaged in testing. Due to the novel nature of the approach, a validity metric of engagement for participation is not available, though considerable care was taken for examiner monitoring of behavioral engagement of participants during testing. Testing was completed on a single day to minimize missed school and travel burden for participants. We randomized standard vs. adapted administration order, and subsequently, participants completed neuropsychological measures.

Individual participant IT was determined by titration of the stimulus onset asynchrony, or, SOA (i.e., the time between the onset of the target stimulus and the mask). The SOA was modified after individual trials depending upon accuracy, with SOA increased by 17 ms after one incorrect response and decreased by 17 ms after a participant obtained 3 sequential correct responses at a given SOA. IT was calculated by averaging the SOA over the response data spanning eight directional reversals of SOA. This staircase time estimation technique is previously described by Wetherill and Levitt (Wetherill & Levitt, Reference Wetherill and Levitt1965). Group differences in mean number of trials and task duration were not statistically significant for either the standard or modified conditions.

Standard processing speed measures

All participants completed the Wechsler Intelligence Scale for Children – III (Wechsler, Reference Wechsler1991) PS subtests including Coding and Symbol Search for use in analyses of criterion validity. The Coding subtests requires participants to reference a symbol coding key to transcribe appropriate symbols into empty boxes corresponding with provided numbers. The Symbol Search subtests requires participants to survey a row of symbols and indicating with cancelation of a yes or no box whether provided item symbols are present in the row of symbols to the right of the target symbols. Both PS measures are speeded tasks in which performance is scored based on the number of items correct in 120 s for Coding, and the number correct minus the number incorrect in 120 s for Symbol Search. The PS Index, derived from the Coding and Symbol Search scores has significantly greater reliability than either subtest (Watkins & Smith, Reference Watkins and Smith2013).

Peabody picture vocabulary test – III (Dunn & Dunn, Reference Dunn and Dunn1997)

The PPVT–III is an individually administered test designed to measure single word receptive vocabulary. The PPVT-III has a test–retest reliability ranging from .91 to .94 (Mdn .92). The PPVT–III has excellent validity as demonstrated by its high correlations with other measures of verbal ability (Kaufman Brief Intelligence Test – Vocabulary, .81; Wechsler Intelligence Scale for Children – Third Edition Verbal Comprehension Index, .91).

Gross motor function classification system

Functional mobility was characterized using the Gross Motor Function Classification System (GMFCS; Palisano et al., Reference Palisano, Rosenbaum, Walter, Russell, Wood and Galuppi1997). The GMFCS, originally designed for use with children with CP, assesses gross motor functioning and activity limitations with a five-level ordinal scale. This scale differentiates between functional levels based on gross motor limitations and need for assistive devices for mobility. The GMFCS was administered by trained examiners at the time of study participation. Interrater reliability is .75, and both content and predictive validity have been well demonstrated in child and adult populations (Palisano et al., Reference Palisano, Rosenbaum, Walter, Russell, Wood and Galuppi1997; Sandstrom et al., Reference Sandstrom, Alinder and Oberg2004; Wood & Rosenbaum, Reference Wood and Rosenbaum2000).

Data analyses

Because of the non-normal distributions of the IT data, these variables were logarithmically transformed prior to any statistical analyses (Kaufman et al., Reference Kaufman, Donders and Warschausky2014). For the same reason, we used Spearman instead of Pearson correlations when comparing various psychometric measures.

Results

The average performances of the two groups on the psychometric variables of interest are presented in Table 2. There was a statistically significant main effect of group on the standard IT task, F (1, 113) = 21.82, p < .01, 2 = 0.16, as well as the modified IT task, F (1, 113) = 16.09, p < .01, 2 = 0.13, with the children with CP consistently having longer ITs than the TD group. In addition, the average performance of the group with CP on the WISC–III PS index was lower than that of the TD group, F (1, 113) = 58.04, p < .01, 2 = 0.34.

Table 2. Inspection time and processing speed by group

Note: CP = cerebral palsy; TD = typically developing; IT = Inspection Time; PSI = Processing. *p < .05; **p < .01.

In order to determine the extent to which IT tasks and WISC–III PS measured overlapping constructs, Spearman correlations were computed between the respective variables. Due to significant group differences in race and ethnicity proportions, TD race and ethnicity subgroup correlation matrices (African American, non-African American) were examined and subgroup differences were not statistically significant; therefore, analyses were conducted with the pooled TD sample. Table 3 presents Spearman correlation matrices, reflecting two potentially important phenomena. First, statistically significant correlations were noted only in the group with CP, including a significant difference in the correlations between ITmodified and PSI in the group with CP versus TD group, z = 2.19, p < .05. Second, in the group with CP, the correlations with PS were fairly similar for the Adapted as compared to the Standard IT task, with no statistically significant difference between them (z = 1.51, p = .61), reinforcing largely equivalent levels of concurrent validity. At the PSI subtest level of analyses, the bivariate correlations between IT tasks, Coding and Symbol Search yielded similar group differences in associations to those obtained with PSI, with the exception of a relatively weaker correlation between ITmodified and Symbol Search, r = 2.8, p < .05. Subsequent analyses were conducted with PSI scores, only. Interestingly, within the group with CP, MACS levels were significantly correlated with IT task performance as well as the PSI index and subtest scores, with lower performances associated with greater impairment in dexterity. Associations with length of gestation were not statistically significant. Finally, associations between the IT task performances and PPVT-III scores were marginally significant in only once instance and the between-group differences in strength of those associations was not statistically significant.

Table 3. Spearman correlations between inspection time variables and processing speed by group

Note: Cerebral Palsy group correlations are above the diagonals, whereas Typically Developing group correlations are below the diagonal. WISC–III = Wechsler Intelligence Scale for Children—Third Edition. Correlations with GMFCS and MACS are only provided for the group with CP; GMFCS is not calculated for typically developing peers.

*p < .05, ** p < .01.

We then explored the contribution of other variables to performance on the two IT tasks in the group with CP. Specifically, we wanted to determine what proportions of the variance in performance on the two IT tasks could be explained by, respectively, fine motor dexterity, and a traditional measure of PS. We computed two linear regression models, one for the Standard IT task, and one for the Modified IT task. Table 4 presents these findings. Inspection of this table suggests that, in both models, PS was the only statistically significant predictor of IT performance. The total amount of variance (R 2) accounted ranged from 0.23 for Standard IT, F (3, 41) = 4.12, p < .02, to 0.37 for Modified IT, F (3, 41) = 8.20, p < .001. Inspection of collinearity diagnostics did not reveal any threat to the validity of either model (e.g., all variance inflation factors < 1.25).

Table 4. Regression models for inspection time (IT) tasks in group with cerebral palsy (n = 45)

Note: SRC = standardized regression coefficient.

Finally, in the sample of children with CP for whom both traditional PS and IT tests were accessible, we evaluated the accuracy with which either of the two IT tasks could classify the children as having slowed speed of processing. For this purpose, we defined impairment on all variables (Standard IT, Modified IT and WISC–III PS) as a level of performance that would be below the 10th percentile in the distribution of scores of the TD group. Using this criterion, rates of impairment in the group with CP were 44.44% (n = 20) on Standard IT, 37.78% (n = 17) on Modified IT, and 48.99% (n = 22) on WISC–III PS. The Standard IT task correctly classified 68.89 of the children with CP with regard to the presence or absence of impairment on WISC–III PS, with a sensitivity of 63.64%, a specificity of 73.91%, a likelihood ratio of 2.44 and an area under the curve of 0.69, indicating adequate to good performance. The Modified IT task correctly classified 75.56% of the same children, with a sensitivity of 63.64%, a specificity of 86.96%, a likelihood ratio of 4.88 and an area under the curve of 0.75 indicating good performance.

Discussion

This study was conducted to examine the validity of IT tasks as accessible measures of PS in children with CP. Children with CP, compared to a group of typically developing peers who did not differ in age, gender, socioeconomic status or receptive vocabulary, show significantly slower IT and lower traditional PS performance (WISC-III PSI). Children with CP exhibited lower performance on WISC-III PSI and both IT tasks. Shank et al. (Reference Shank, Kaufman, Leffard and Warschausky2010) found slowed IT in children with CP with a standard IT task using participant samples that overlap with the present study samples. In this study, children with CP exhibited similarly slowed performance on both standard and modified IT tasks.

IT and PSI performances were significantly correlated only in the group with CP in the TD group; this suggested that in children with CP, but not necessarily in TD children, IT performance shared considerable variance with traditional paper-and-pencil tests of speed of processing. In a previous study, IT was significantly correlated with WISC-III Coding and Symbol Search subtests in a TD sample, but the correlation with the PS Index was not reported (Edmonds et al., Reference Edmonds, Isaacs, Visscher, Rogers, Lanigan, Singhal and Deary2008). As discussed in Kaufman et al. (Reference Kaufman, Donders and Warschausky2014), our IT approach designed for greater accessibility yields positive skew in the TD population that may hinder the ability to detect associations with other variables in this group. In addition, the group with CP exhibited much greater variability in IT performance than is noted in the TD group and the TD group had mildly restricted range in PSI scores which also may have attenuated IT-PSI correlations in the TD sample. In the group with CP, IT classification accuracy for impaired PSI included modest sensitivity and good specificity, particularly for the modified measure. Thus, as measures of PS in children with CP, IT tasks demonstrate adequate concurrent validity and would be valid proxy measures of PSI in this population This is particularly important because for a subset of children with CP, graphomotor tasks are inaccessible. However, due to limited sensitivity of IT to PSI impairment, IT tasks would not be first choice measures when PSI tasks are accessible. However, lack of significant concurrent validity in the TD group suggests the possibility that IT performance may measure somewhat different constructs in different populations.

Understanding of the neuropathological substrate of slowed PS associated with CP, is complicated by a limited understanding of the neural substrate of PS in the typically developing population, as well as the heterogeneity of etiology and overt manifestations of CP. In typically developing right-handed children, simple reaction time has been associated with the integrity of the right hemisphere, fronto-occipital fasciculus and left cortico-spinal tract (Scantlebury et al., Reference Scantlebury, Cunningham, Dockstader, Laughlin, Gaetz, Rockel, Dickson and Mabbott2014). In right-handed young adults, speed of performance on N-back tasks is associated with increased activation of broad frontoparietal regions, though note is made that this is not as robust as primary regions of activation including bilateral occipital, left pre- and post-central gyri, right fusiform and right thalamus (Takeuchi et al., Reference Takeuchi, Sugiura, Sassa, Sekiguchi, Yomogida, Taki, Kawashima and Valdes-Sosa2012). Slower processing has been associated with greater recruitment of prefrontal regions (Rypma et al., Reference Rypma, Berger, Prabhakaran, Bly, Kimberg, Biswal and D’Esposito2006). Periventricular leukomalacia (PVL), commonly associated with CP, frequently affects the retrolenticular portion of the internal capsule and posterior thalamic radiant tracts. While PVL is suspected as a risk factor for slowing (Bottcher et al., Reference Bottcher, Flachs and Uldall2010), there are no studies to date that clearly demonstrate this association.

In addition to findings using a traditional IT testing strategy in which a two-button response period with a blank screen follows presentation of test stimuli, this paper also presents findings for a modified task version which includes dichotomous choice scanning and a single button response format. While little is gained in the modified IT task from a performance perspective, for those who cannot do either the standard clinical PS measures or the traditional IT task version these data demonstrate that the further modification is similarly valid using basic existing switch technology that is often familiar to individuals with severe motor impairment. As the IT task does not serve as a perfect proxy measure, rather than suggesting utilization of the IT testing strategy as an ideal approach, it is offered as an alternative strategy for assessment for PS when necessary due to motor impairments.

There are a number of methodological limitations that affect the generalizability of these findings. The sample with CP was largely at GMFCS and MACS Levels I, II, and III with average cognitive ability and a higher percentage with history of preterm birth, and therefore was not representative of the entire population of children with CP. Similarly, the small sample size precluded examining CP subtype differences based on motor type and topography. It would not be possible to study concurrent validity of IT tasks using PSI tasks in children with more significant motor impairments; however, validation studies of IT tasks using other accessible tasks including auditory IT tasks would be important in future studies with children with CP with more significant motor impairments. Our efforts organize around maximally reducing the motor demands associated with completion of these measures. Because the study required participants to be able to complete both “gold standard” measures of clerical PS in addition to the IT measure, we do not have sufficient variability in MACS scores in this study to explore the influence of fine motor dexterity on performance. As this does not directly influence examinations of validity testing, a future examination of this distinct from a validation study could be of interest. While the current study focuses on validation of the IT measure, future studies examining utilization of this measure in the clinical population with CP more broadly would benefit from inclusion of a more granular measurement of motor impairment than the MACS, such as the Movement Assessment Battery for Children – 2 (Henderson et al., Reference Henderson, Sugden and Barnett2007).

The significant variability in CP IT task performance may stem from a number of factors including working memory demands, visual perceptual demands, and fatigue, each of which would have to be studied by controlled task manipulations. The IT task demands may entail greater working memory loads than typical clinical PSI tasks, as the target stimulus is not present at the time of response. Related, the modified IT task includes a serial scanning strategy in which both response options are presented for dichotomous choice selection; the presence of both choices likely modifies the processing demands during choice making relative to the standard administration version. This issue further adds to target construct concerns as slower scanning speeds and longer response consideration could change the memory burden. Children with CP, particularly those with PVL, are at risk for visual and visuoperceptual impairments that may confound IT task performance, highlighting the need for further study of IT with auditory stimuli. While PSI is strongly correlated with the PPVT, the PPVT-III correlations with IT task performance are much less compelling, which suggests that the IT task is assessing more elemental functions such as visualization speed, relative to the more complex demands of the graphomotor PS measures. The staircase titration to establish IT threshold may cause fatigue in a population already prone to daytime fatigue (Sandella et al., Reference Sandella, O’Brien, Shank and Warschausky2011). Similarly, impairments in vigilance may confound IT performance in a population that is at risk for ADHD symptoms (Shank et al., Reference Shank, Kaufman, Leffard and Warschausky2010). Lastly, neuroimaging was not included in the study protocol, precluding more detailed characterization of the sample, as well as within group study of the neural substrates of IT performance.

This study provides partial support for use of traditional and modified IT tasks as measures of aspects of PS in children with CP. Future studies of IT in children with CP will need to utilize nonvisual stimuli and control for factors such as working memory and vigilance. Working memory demands can be studied by varying response prompt delay time. Vigilance can be studied by comparing staircase titration to odd-ball procedures. Similar to traditional PS measures that rely on speeded motor response, IT task performance relies on a complex set of cognitive functions and speed cannot be separated from perceptual content.

Acknowledgements

We acknowledge the assistance of Shana Asbell, Donna Omichinski, Nicole Miller, Danielle Sandella, Stacie Leffard, Laura Shank, and Carolina Martinez. The authors thank two anonymous reviewers for their comments.

Funding statement

This study was funded by the US Department of Education, National Institute on Disability and Rehabilitation Research (H133G070044, H133G110015) and the National Institutes of Health (1 R21 HD0574344) and the Mildred E. Swanson Foundation.

Competing Interests

No conflict of interest exists for this research.

References

American Psychological Association (2022). Task Force on Guidelines for Assessment and Intervention with Persons with Disabilities: Guidelines for Assessment and Intervention with Persons with Disabilities. Retrieved from https://www.apa.org/about/policy/guidelines-assessment-intervention-disabilities.pdf Google Scholar
Berninger, V. W., Gans, B. M., St James, P., & Connors, T. (1988). Modified WAIS-R for patients with speech and/or hand dysfunction. Archives of Physical Medicine and Rehabilitation, 69(4), 250255.Google ScholarPubMed
Bottcher, L., Flachs, E. M., & Uldall, P. (2010). Attentional and executive impairments in children with spastic cerebral palsy. Developmental Medicine and Child Neurology, 52(2), e42e47.CrossRefGoogle ScholarPubMed
Burns, N. R., Nettelbeck, T., & Cooper, C. J. (1999). Inspection time correlates with general speed of processing but not with fluid ability. Intelligence, 27(1), 3744.CrossRefGoogle Scholar
Byrne, J. M., Dywan, C. A., & Connolly, J. F. (1995). An innovative method to assess the receptive vocabulary of children with cerebral palsy using event-related brain potentials. Journal of Clinical and Experimental Neuropsychology, 17(1), 919.CrossRefGoogle ScholarPubMed
Chaiken, S. (1994). The inspection time not studied: Processing speed ability unrelated to psychometric intelligence. Intelligence, 19(3), 295316.CrossRefGoogle Scholar
Coenen, M. A., Eggink, H., Tijssen, M. A., & Spikman, J. M. (2018). Cognition in childhood dystonia: A systematic review. Developmental Medicine & Child Neurology, 60(3), 244255.CrossRefGoogle ScholarPubMed
Donders, J., & Nesbit-Greene, K. (2004). Predictors of neuropsychological test performance after pediatric traumatic brain injury. Assessment, 11(4), 275284.CrossRefGoogle ScholarPubMed
Dunn, L. M., & Dunn, L. M. (1997). Examiner’s manual for the PPVT-III Peabody Picture Vocabulary Test. American Guidance Service Google Scholar
Edmonds, C. J., Isaacs, E. B., Visscher, P. M., Rogers, M., Lanigan, J., Singhal, A., & Deary, I. J. (2008). Inspection time and cognitive abilities in twins aged 7 to 17 years: Age-related changes, heritability and genetic covariance. Intelligence, 36(3), 210225.CrossRefGoogle Scholar
Eliasson, A. C., Krumlinde-Sundholm, L., Rosblad, B., Beckung, E., Arner, M., Ohrvall, A. M., & Rosenbaum, P. (2006). The manual ability classification system (MACS) for children with cerebral palsy: Scale development and evidence of validity and reliability. Developmental Medicine & Child Neurology, 48(7), 549554.CrossRefGoogle ScholarPubMed
Fry, A. F., & Hale, S. (2000). Relationships among processing speed, working memory, and fluid intelligence in children. Biological Psychology, 54(1-3), 134.CrossRefGoogle ScholarPubMed
Hammill, D. D., Pearson, N. A., & Wiederholt, J. L. (1997). Comprehensive Test of Nonverbal Intelligence. PRO-ED Google Scholar
Henderson, S. E., Sugden, D. A., & Barnett, A. L. (2007). Movement Assessment Battery for Children-2 [Movement ABC-2]. The Psychological Corporation Google Scholar
Hollingshead, A. B.Four-factor index of social status 1975, Yale University., Unpublished Manuscript.Google Scholar
Jacobson, L. A., Ryan, M., Martin, R. B., Ewen, J., Mostofsky, S. H., Denckla, M. B., & Mahone, E. M. (2011). Working memory influences processing speed and reading fluency in ADHD. Child Neuropsychology, 17(3), 209224.CrossRefGoogle ScholarPubMed
Kaufman, J. N., Donders, J., & Warschausky, S. (2014). A comparison of visual inspection time measures in children with cerebral palsy. Rehabilitation Psychology, 59(2), 147154.CrossRefGoogle ScholarPubMed
Laporta-Hoyos, O., Ballester-Plane, J., Leiva, D., Ribas, T., Miralbell, J., Torroja-Nualart, C., & Pueyo, R. (2019). Executive function and general intellectual functioning in dyskinetic cerebral palsy: Comparison with spastic cerebral palsy and typically developing controls. European Journal of Paediatric Neurology, 23(4), 546559.CrossRefGoogle ScholarPubMed
Luciano, M., Posthuma, D., Wright, M. J., de Geus, E. J., Smith, G. A., Geffen, G. M., & Martin, N. G. (2005). Perceptual speed does not cause intelligence, and intelligence does not cause perceptual speed. Biological Psychology, 70(1), 18. DOI: 10.1016/j.biopsycho.2004.11.011 Google Scholar
Marco, E. J., Harrell, K. M., Brown, W. S., Hill, S. S., Jeremy, R. J., Kramer, J. H., Sherr, E. H., & Paul, L. K. (2012). Processing speed delays contribute to executive function deficits in individuals with agenesis of the corpus callosum. J int Neuropsychol Soc, 18(3), 521529.CrossRefGoogle ScholarPubMed
O’Connor, T. A., & Burns, N. R. (2003). Inspection time and general speed of processing. Personality and Individual Differences, 35(3), 713724.CrossRefGoogle Scholar
Odding, E., Roebroeck, M. E., & Stam, H. J. (2006). The epidemiology of cerebral palsy: Incidence, impairments and risk factors. Disability and Rehabilitation, 28(4), 183191.CrossRefGoogle ScholarPubMed
O’Jile, J. R., Schrimsher, G. W., & O’Bryant, S. E. (2005). The California verbal learning test-children’s version: Relation to factor indices of the wechsler intelligence scale for children-third edition. Journal of Clinical and Experimental Neuropsychology, 27(7), 815822.CrossRefGoogle ScholarPubMed
Oprandi, M. C., Oldrati, V., Delle Fave, M., Panzeri, D., Gandola, L., Massimino, M., & Poggi, G. (2021). Processing speed and time since diagnosis predict adaptive functioning measured with WeeFIM in pediatric brain tumor survivors. Cancers (Basel), 13(19), 4776.CrossRefGoogle ScholarPubMed
Palisano, R., Rosenbaum, P., Walter, S., Russell, D., Wood, E., & Galuppi, B. (1997). Development and reliability of a system to classify gross motor function in children with cerebral palsy. Developmental Medicine & Child Neurology, 39(4), 214223.CrossRefGoogle ScholarPubMed
Paneth, N., Hong, T., & Korzeniewski, S. (2006). The descriptive epidemiology of cerebral palsy. Clinics in Perinatology, 33(2), 251267.CrossRefGoogle ScholarPubMed
Raven, J. C. (1998). Coloured Progressive Matrices (CPM). Pearson Educational, Inc Google Scholar
Roid, G. H., & Miller, L. J. (1995, 1997). Leiter International Performance Scale-Revised. Stoelting Co Google Scholar
Rypma, B., Berger, J. S., Prabhakaran, V., Bly, B. M., Kimberg, D. Y., Biswal, B. B., & D’Esposito, M. (2006). Neural correlates of cognitive efficiency. Neuroimage, 33(3), 969979.CrossRefGoogle ScholarPubMed
Sandella, D. E., O’Brien, L. M., Shank, L. K., & Warschausky, S. A. (2011). Sleep and quality of life in children with cerebral palsy. Sleep Medicine, 12(3), 252256.CrossRefGoogle ScholarPubMed
Sandstrom, K., Alinder, J., & Oberg, B. (2004). Descriptions of functioning and health and relations to a gross motor classification in adults with cerebral palsy. Disability and Rehabilitation, 26(17), 10231031.CrossRefGoogle ScholarPubMed
Scantlebury, N., Cunningham, T., Dockstader, C., Laughlin, S., Gaetz, W., Rockel, C., Dickson, J., & Mabbott, D. (2014). Relations between white matter maturation and reaction time in childhood. Journal of the International Neuropsychological Society, 20(1), 99112.CrossRefGoogle ScholarPubMed
Shank, L. K., Kaufman, J., Leffard, S., & Warschausky, S. (2010). Inspection time and attention-deficit/hyperactivity disorder symptoms in children with cerebral palsy. Rehabilitation Psychology, 55(2), 188193.CrossRefGoogle ScholarPubMed
Shultz, E. L., Hoskinson, K. R., Keim, M. C., Dennis, M., Taylor, H. G., Bigler, E. D., Rubin, K. H., Vannatta, K., Gerhardt, C. A., Stancin, T., & Yeates, K. O. (2016). Adaptive functioning following pediatric traumatic brain injury: Relationship to executive function and processing speed. Neuropsychology, 30(7), 830840.CrossRefGoogle ScholarPubMed
Stadskleiv, K. (2020). Cognitive functioning in children with cerebral palsy. Developmental Medicine & Child Neurology, 62(3), 283289.CrossRefGoogle ScholarPubMed
Takeuchi, H., Sugiura, M., Sassa, Y., Sekiguchi, A., Yomogida, Y., Taki, Y., Kawashima, R., & Valdes-Sosa, P. A. (2012). Neural correlates of the difference between working memory speed and simple sensorimotor speed: An fMRI study. Plos One, 7(1), e30579.CrossRefGoogle ScholarPubMed
Treble-Barna, A., Zang, H., Zhang, N., Taylor, H. G., Yeates, K. O., & Wade, S. (2017). Long-term neuropsychological profiles and their role as mediators of adaptive functioning after traumatic brain injury in early childhood. Journal of Neurotrauma, 34(2), 353362.CrossRefGoogle ScholarPubMed
Van Tubbergen, M., Warschausky, S., Birnholz, J., & Baker, S. (2008). Choice beyond preference: Conceptualization and assessment of choice-making skills in children with significant impairments. Rehabilitation Psychology, 53(1), 93100.CrossRefGoogle Scholar
Warschausky, S., Van Tubbergen, M., Asbell, S., Kaufman, J., Ayyangar, R., & Donders, J. (2011). Modified test administration using assistive technology : Preliminary psychometric findings. Assessment, 19(4), 472479.CrossRefGoogle ScholarPubMed
Watkins, M. W., & Smith, L. G. (2013). Long-term stability of the wechsler intelligence scale for children--fourth edition. Psychol Assess, 25(2), 477483.CrossRefGoogle ScholarPubMed
Wechsler, D. (1991). The Wechsler intelligence scale for children—third edition. The Psychological Corporation Google Scholar
Wetherill, G. B., & Levitt, H. (1965). Sequential estimation of points on a psychometric function. British Journal of Mathematical and Statistical Psychology, 18(1), 110.CrossRefGoogle ScholarPubMed
Wood, E., & Rosenbaum, P. (2000). The gross motor function classification system for cerebral palsy: A study of reliability and stability over time. Developmental Medicine and Child Neurology, 42(5), 292296.CrossRefGoogle ScholarPubMed
Figure 0

Table 1. Background characteristics by group

Figure 1

Figure 1. Standard (upper) and modified (lower) visual inspection time tasks. Note: In both standard (upper) and adapted (lower) versions of the IT task, participants are presented with a fixation point for 3000 ms (A) which briefly brightens for 1500 ms (B) then clears (C) to alert to pending stimulus presentation (D) of varying duration. Stimuli are immediately followed by a visual mask (E) to prevent visual rehearsal of the target stimulus. Standard administration (upper) followed with a blank screen (Fstandard) and keyboard response (Gstandard), while the adapted administration (lower) showed selection options with an alternating selection box (Fadapted) with pressure switch response to target (Gadapted).

Figure 2

Table 2. Inspection time and processing speed by group

Figure 3

Table 3. Spearman correlations between inspection time variables and processing speed by group

Figure 4

Table 4. Regression models for inspection time (IT) tasks in group with cerebral palsy (n = 45)