Previous studies have suggested that human impulsivity is an adaptive response to childhood environmental harshness: individuals from families of low socioeconomic status (SES) tend to be more impulsive. However, no studies have tested the evolvability of this reaction norm. This study examined whether (a) impulsivity is associated with higher fitness among individuals from low SES families, while (b) it is associated with lower fitness among individuals from high SES families. We assessed three indices of impulsivity (temporal discounting, risk taking and fast/slow life history strategy), childhood SES and five proxy indices of fitness (number of children, lifelong singlehood, annual household income, subjective SES and life satisfaction) of 692 middle-aged participants (40–45 years old). None of the results supported the evolvability of the impulsivity reaction norm, although low childhood SES was associated with lower fitness on every proxy measure. Impulsivity (operationalised as the fast life history strategy) was associated with lower fitness regardless of childhood SES.