This study aimed to investigate the association between maternal birth weight (MBW) with preterm delivery (PTD) in the Japanese population. To this end, a total of 78,972 Japanese pregnant women were included in a prospective birth cohort study. Multiple logistic regression and multinominal logistic regression models were applied to investigate the associations of MBW with PTD (delivery from 22 to < 37 weeks of gestation), early PTD (delivery from 22 to < 34 weeks), and late PTD (delivery from 34 to < 37 weeks). The results showed that MBW was inversely associated with PTD, early PTD, and late PTD (p-for-trend < 0.0001, 0.0014, and < 0.0001, respectively). The adjusted odds ratios per each 500 g of MBW decrease were 1.167 (95% confidence interval [CI]: 1.118–1.218) for PTD, 1.174 (95% CI: 1.070–1.287) for early PTD and 1.151 (95% CI: 1.098–1.206) for late PTD. The effect size of the association of MBW with early PTD was similar to that with late PTD. This study demonstrated for the first time an association of a low MBW with PTD, early PTD, and late PTD in a Japanese nationwide cohort.