Aberrant reward functioning is implicated in depression. While attention precedes behavior and guides higher-order cognitive processes, reward learning from an attentional perspective – the effects of prior reward-learning on subsequent attention allocation – has been mainly overlooked.

The present study explored the effects of reward-based attentional learning in depression using two separate, yet complimentary, studies. In study 1, participants with high (HD) and low (LD) levels of depression symptoms were trained to divert their gaze toward one type of stimuli over another using a novel gaze-contingent music reward paradigm – music played when fixating the desired stimulus type and stopped when gazing the alternate one. Attention allocation was assessed before, during, and following training. In study 2, using negative reinforcement, the same attention allocation pattern was trained while substituting the appetitive music reward for gazing the desired stimulus type with the removal of an aversive sound (i.e. white noise).

In study 1 both groups showed the intended shift in attention allocation during training (online reward learning), while generalization of learning at post-training was only evident among LD participants. Conversely, in study 2 both groups showed post-training generalization. Results were maintained when introducing anxiety as a covariate, and when using a more powerful sensitivity analysis. Finally, HD participants showed higher learning speed than LD participants during initial online learning, but only when using negative, not positive, reinforcement.

Deficient generalization of learning characterizes the attentional system of HD individuals, but only when using reward-based positive reinforcement, not negative reinforcement.

Adolescent internalizing symptoms and trauma exposure have been linked with altered reward learning processes and decreased ventral striatal responses to rewarding cues. Recent computational work on decision-making highlights an important role for prospective representations of the imagined outcomes of different choices. This study tested whether internalizing symptoms and trauma exposure among youth impact the generation of prospective reward representations during decision-making and potentially mediate altered behavioral strategies during reward learning.

Sixty-one adolescent females with varying exposure to interpersonal violence exposure (n = 31 with histories of physical or sexual assault) and severity of internalizing symptoms completed a social reward learning task during fMRI. Multivariate pattern analyses (MVPA) were used to decode neural reward representations at the time of choice.

MVPA demonstrated that rewarding outcomes could accurately be decoded within several large-scale distributed networks (e.g. frontoparietal and striatum networks), that these reward representations were reactivated prospectively at the time of choice in proportion to the expected probability of receiving reward, and that youth with behavioral strategies that favored exploiting high reward options demonstrated greater prospective generation of reward representations. Youth internalizing symptoms, but not trauma exposure characteristics, were negatively associated with both the behavioral strategy of exploiting high reward options as well as the prospective generation of reward representations in the striatum.

These data suggest diminished prospective mental simulation of reward as a mechanism of altered reward learning strategies among youth with internalizing symptoms.

Depression and insomnia commonly co-occur. Yet, little is known about the mechanisms through which insomnia influences depression. Recent research and theory highlight reward system dysfunction as a potential mediator of the relationship between insomnia and depression. This study is the first to examine the impact of insomnia on reward learning, a key component of reward system functioning, in clinical depression.

The sample consisted of 72 veterans with unipolar depression who endorsed sleep disturbance symptoms. Participants completed the Structured Clinical Interview for DSM-IV, self-report measures of insomnia, depression, and reward processing, and a previously validated signal detection task (Pizzagalli et al., 2005, Biological Psychiatry, 57(4), 319–327). Trial-by-trial response bias (RB) estimates calculated for each of the 200 task trials were examined using linear mixed-model analyses to investigate change in reward learning.

Findings demonstrated diminished rate and magnitude of reward learning in the Insomnia group relative to the Hypersomnia/Mixed Symptom group across the task. Within the Insomnia group, participants with more severe insomnia evidenced the lowest rates of reward learning, with increased RB across the task with decreasing insomnia severity.

Among individuals with depression, insomnia is associated with decreased ability to learn associations between neutral stimuli and rewarding outcomes and/or modify behavior in response to differential receipt of reward. This attenuated reward learning may contribute to clinically meaningful decreases in motivation and increased withdrawal in this comorbid group. Results extend existing theory by highlighting impairments in reward learning specifically as a potential mediator of the association between insomnia and depression.

Treatment for major depressive disorder (MDD) is imprecise and often involves trial-and-error to determine the most effective approach. To facilitate optimal treatment selection and inform timely adjustment, the current study investigated whether neurocognitive variables could predict an antidepressant response in a treatment-specific manner.

In the two-stage Establishing Moderators and Biosignatures of Antidepressant Response for Clinical Care (EMBARC) trial, outpatients with non-psychotic recurrent MDD were first randomized to an 8-week course of sertraline selective serotonin reuptake inhibitor or placebo. Behavioral measures of reward responsiveness, cognitive control, verbal fluency, psychomotor, and cognitive processing speeds were collected at baseline and week 1. Treatment responders then continued on another 8-week course of the same medication, whereas non-responders to sertraline or placebo were crossed-over under double-blinded conditions to bupropion noradrenaline/dopamine reuptake inhibitor or sertraline, respectively. Hamilton Rating for Depression scores were also assessed at baseline, weeks 8, and 16.

Greater improvements in psychomotor and cognitive processing speeds within the first week, as well as better pretreatment performance in these domains, were specifically associated with higher likelihood of response to placebo. Moreover, better reward responsiveness, poorer cognitive control and greater verbal fluency were associated with greater likelihood of response to bupropion in patients who previously failed to respond to sertraline.

These exploratory results warrant further scrutiny, but demonstrate that quick and non-invasive behavioral tests may have substantial clinical value in predicting antidepressant treatment response.

Depression has been associated with abnormalities in neural underpinnings of Reward Learning (RL). However, inconsistencies have emerged, possibly owing to medication effects. Additionally, it remains unclear how neural RL signals relate to real-life behaviour. The current study, therefore, examined neural RL signals in young, mildly to moderately depressed – but non-help-seeking and unmedicated – individuals and how these signals are associated with depressive symptoms and real-life motivated behaviour.

Individuals with symptoms along the depression continuum (n = 87) were recruited from the community. They performed an RL task during functional Magnetic Resonance Imaging and were assessed with the Experience Sampling Method (ESM), completing short questionnaires on emotions and behaviours up to 10 times/day for 15 days. Q-learning model-derived Reward Prediction Errors (RPEs) were examined in striatal areas, and subsequently associated with depressive symptoms and an ESM measure capturing (non-linearly) how anticipation of reward experience corresponds to actual reward experience later on.

Significant RPE signals were found in the striatum, insula, amygdala, hippocampus, frontal and occipital cortices. Region-of-interest analyses revealed a significant association between RPE signals and (a) self-reported depressive symptoms in the right nucleus accumbens (b = −0.017, p = 0.006) and putamen (b = −0.013, p = .012); and (b) the quadratic ESM variable in the left (b = 0.010, p = .010) and right (b = 0.026, p = 0.011) nucleus accumbens and right putamen (b = 0.047, p < 0.001).

Striatal RPE signals are disrupted along the depression continuum. Moreover, they are associated with reward-related behaviour in real-life, suggesting that real-life coupling of reward anticipation and engagement in rewarding activities might be a relevant target of psychological therapies for depression.

Trauma exposure is associated with development of depression and anxiety; yet, some individuals are resilient to these trauma-associated effects. Differentiating mechanisms underlying development of negative affect and resilience following trauma is critical for developing effective interventions. One pathway through which trauma could exert its effects on negative affect is reward-learning networks. In this study, we examined relationships among lifetime trauma, reward-learning network function, and emotional states in young adults.

One hundred eleven young adults self-reported trauma and emotional states and underwent functional magnetic resonance imaging during a monetary reward task. Trauma-associated neural activation and functional connectivity were analyzed during reward prediction error (RPE). Relationships between trauma-associated neural functioning and affective and anxiety symptoms were examined.

Number of traumatic events was associated with greater ventral anterior cingulate cortex (vACC) activation, and lower vACC connectivity with the right insula, frontopolar, inferior parietal, and temporoparietal regions, during RPE. Lower trauma-associated vACC connectivity with frontoparietal regions implicated in regulatory and decision-making processes was associated with heightened affective and anxiety symptoms; lower vACC connectivity with insular regions implicated in interoception was associated with lower affective and anxiety symptoms.

In a young adult sample, two pathways linked the impact of trauma on reward-learning networks with higher v. lower negative affective and anxiety symptoms. The disconnection between vACC and regions implicated in decision-making and self-referential processes may reflect aberrant regulatory but appropriate self-focused mechanisms, respectively, conferring risk for v. resilience against negative affective and anxiety symptoms.

The significant proportion of schizophrenia patients refractory to treatment, primarily directed at the dopamine system, suggests that multiple mechanisms may underlie psychotic symptoms. Reinforcement learning tasks have been employed in schizophrenia to assess dopaminergic functioning and reward processing, but these have not directly compared groups of treatment-refractory and non-refractory patients.

In the current functional magnetic resonance imaging study, 21 patients with treatment-resistant schizophrenia (TRS), 21 patients with non-treatment-resistant schizophrenia (NTR), and 24 healthy controls (HC) performed a probabilistic reinforcement learning task, utilizing emotionally valenced face stimuli which elicit a social bias toward happy faces. Behavior was characterized with a reinforcement learning model. Trial-wise reward prediction error (RPE)-related neural activation and the differential impact of emotional bias on these reward signals were compared between groups.

Patients showed impaired reinforcement learning relative to controls, while all groups demonstrated an emotional bias favoring happy faces. The pattern of RPE signaling was similar in the HC and TRS groups, whereas NTR patients showed significant attenuation of RPE-related activation in striatal, thalamic, precentral, parietal, and cerebellar regions. TRS patients, but not NTR patients, showed a positive relationship between emotional bias and RPE signal during negative feedback in bilateral thalamus and caudate.

TRS can be dissociated from NTR on the basis of a different neural mechanism underlying reinforcement learning. The data support the hypothesis that a favorable response to antipsychotic treatment is contingent on dopaminergic dysfunction, characterized by aberrant RPE signaling, whereas treatment resistance may be characterized by an abnormality of a non-dopaminergic mechanism – a glutamatergic mechanism would be a possible candidate.