Given the importance of prevention of complications in type 2 diabetes (T2D), we aimed to examine changes over time in consumption of fruits, vegetables and juice among men who were diagnosed with T2D in comparison with men without diabetes. The prospective Cohort of Swedish Men, aged 45–79 years in 1997, was used to examine changes in diet after diagnosis of T2D. Dietary intake was assessed using FFQ in 1997 and 2009. In all, 23 953 men who were diabetes free at baseline (1997) and completed both FFQ were eligible to participate in the study. Diagnosis of T2D was reported by subjects and ascertained through registers. Multivariable linear mixed models were used to examine changes in mean servings/week over time. In total, 1741 men developed T2D during the study period. Increased consumption of vegetables and fruits was observed among those who developed T2D (equivalent to 1·6 servings/week, 95 % CI 1·08, 2·03) and men who remained diabetes free (0·7 servings/week, 95 % CI 0·54, 0·84). Consumption of juice decreased by 0·6 servings/week (95 % CI −0·71, −0·39) among those who developed T2D and increased by 0·1 servings/week (95 % CI 0·05, 0·15) in those who were diabetes free. Changes over time and between groups were statistically significant. Although improvements in diet were observed, only 36 % of those with T2D and 35 % of those without diabetes consumed ≥5 servings of fruits and vegetables/d in 2009.