Speed perception tests are already used in several countries as part of the driver licensing curriculum; however, this test is not compulsively required in China. The purpose of this study was to investigate the relationship between speed perception and eye movement for different driver groups. Forty-eight drivers, including 28 crash-involved (CI), with rear-end or side collisions, and 20 crash-not-involved (CNI) drivers, were recruited for the speed perception experiments. Drivers' reaction characteristics as well as eye movement data were analyzed. The results showed that CI drivers were more likely to overestimate the speed of visual stimuli and react in advance. The speed perception of CI drivers was more accurate than that of CNI drivers for visual stimuli with middle to high moving speeds, indicating that CNI drivers are more cautious and conservative when driving. Regarding eye movement, significant differences in saccade speed were found between the CI and CNI drivers in the occlusion area under high speed and the occlusion ratio. The relationship between visual pattern and speed perception accuracy was found to some extent. Implications of the speed perception test for the driver aptitude test were discussed.