Dendritic spines form postsynaptic contact sites in the central nervous system. The rapid and spontaneous morphology changes of spines have been widely observed by neurobiologists. Determining the relationship between dendritic spine morphology change and its functional properties such as memory learning is a fundamental yet challenging problem in neurobiology research. In this paper, we propose a novel algorithm to track the morphology change of multiple spines simultaneously in time-lapse neuronal images based on nonrigid registration and integer programming. We also propose a robust scheme to link disappearing-and-reappearing spines. Performance comparisons with other state-of-the-art cell and spine tracking algorithms, and the ground truth show that our approach is more accurate and robust, and it is capable of tracking a large number of neuronal spines in time-lapse confocal microscopy images.