Among the most defining events of an individual's life, is the development of a human embryo into male or a female. The phenotypic sex of an individual depends on the type of gonad that develops in the embryo, a process which itself is determined by the genetic setting of the individual. The development of the gonads is different from any other organ, as they possess the potential to differentiate into two functionally distinct organs, testes, or ovaries. Sex development can be divided into two distinctive processes, "sex determination," which is the commitment of the undifferentiated gonad into either a testis or an ovary, a process that is genetically programmed in a critically timed manner and "sex differentiation," which takes place through hormones produced by the gonads, once the developmental sex determination decision has been made. Disruption of any of the genes involved in either the testicular or ovarian development pathway could lead to disorders of sex development. In this review, we provide an insight into the factors important for sex determination, their antagonistic actions and whenever possible, references on the "prismatic" clinical cases are given. Birth Defects Research (Part C) 108:365-379, 2016. © 2016 Wiley Periodicals, Inc.