The narrow host range of human immunodeficiency virus type 1 (HIV-1) is due in part to dominant acting restriction factors in humans (Ref1) and monkeys (Lv1). Here we show that gag encodes determinants of species-specific lentiviral infection, related in part to such restriction factors. Interaction between capsid and host cyclophilin A (CypA) protects HIV-1 from restriction in human cells but is essential for maximal restriction in simian cells. We show that sequence variation between HIV-1 isolates leads to variation in sensitivity to restriction factors in human and simian cells. We present further evidence for the importance of target cell CypA over CypA packaged in virions, specifically in the context of gp160 pseudotyped HIV-1 vectors. We also show that sensitivity to restriction is controlled by an H87Q mutation in the capsid, implicated in the immune control of HIV-1, possibly linking immune and innate control of HIV-1 infection.