According to the organizational-activational hypothesis, testosterone or its metabolite estradiol, can organize the brain in a male direction (permanently or for long periods) if exposure occurs during a critical (sensitive) time of brain development like the prenatal period. Male rodents with insufficient levels of testosterone during such critical period would irreversibly fail to display sexual partner preference for receptive females in adulthood. However, exposure to testosterone during puberty is believed to function as a second critical period for organization of brain and behavior. Thus, in the present study we explored the effects of neonatal gonadectomy at postnatal day 1 (GNX) on the partner preference of adult males and the size of some sexually dimorphic regions in the brain like the SDN-MPOA, SCN, MeApd and VMH; and challenged its irreversibility by providing exogenous testosterone during puberty. Our results indicated that neonatal GNX impaired partner preference for females and reduced the size of SDN-MPOA, MeApd and VMH, but not SCN. GNX males restored with testosterone in PD30-PD59 (GNX + T) expressed partner preference for sexually receptive females and increased the size of SDN-MPOA and VMH, but not MeApd in adulthood. We conclude that neonatal castration and the lack of testosterone during the first month of life alters sexual behavior and brain dimorphism in adult male rats, but pubertal testosterone reverses the effects on behavior and brain dimorphism to some extent.