OBJECTIVE Locomotive syndrome (LS) encompasses conditions that may lead to the need for nursing services. We aimed to quantify the association between exercise habits during youth or the middle-age years and both physical function and the presence of LS in Japanese elderly people. METHODS We examined 460 participants of the eighth, ninth, and tenth iterations of the Miyagawa study. Participants were divided into an LS group and a no-LS group according to their scores on the 25-question Geriatric Locomotive Function Scale. The following physical function tests were performed: grip strength, 6-m walk at normal and maximum speed, single-leg stance time with eyes open, and chair stand time. The frequency of past physical activity was determined by interview. RESULTS Ninety-seven participants (21.1%) were classified as having LS. The LS group had worse physical function than the no-LS group. Exercise habits between the ages of 25 and 50 years were significantly related to later LS. CONCLUSIONS Participants with LS were less likely to report a regular exercise habit between the ages of 25 and 50 years than participants without LS. Participants who reported regular exercise habits in middle age had better physical function during old age. Regular exercise habits in middle age appear to protect against LS during the older years.