BACKGROUND To evaluate the safety of intracytoplasmic sperm injection (ICSI) with epididymal or testicular sperm, this study compared children born after ICSI treatment with epididymal or testicular sperm with children conceived after ICSI with ejaculated sperm. METHODS This retrospective study included 317 children born after ICSI with percutaneous epididymal sperm aspiration (PESA), 103 children born after ICSI with testicular sperm aspiration (TESA), and a control group of 1008 children born after ICSI with ejaculated sperm. All of the patients received their assisted reproductive treatment in the Reproductive Medicine Center of the First Affiliated Hospital of Zhengzhou University from January 2004 to December 2011. Data, such as the rate of stillbirths, perinatal mortality, gestational age, birth weight, and the rate of congenital malformations of the three groups, were compared. RESULTS PESA and TESA children were not different from ICSI children in the rate of stillbirths, perinatal mortality, infant mortality rate, gestational age, the rate of prematurity, and the rate of malformations (P > 0.05). A slight increase in birth defects was reported in the TESA group compared with those in the control group, but there was no significant difference between the groups (P > 0.05). CONCLUSIONS ICSI with epididymal or testicular sperm does not lead to more stillbirths or congenital malformations compared with ICSI using ejaculated sperm.