Human immunodeficiency virus (HIV) is the primary infectious agent of acquired immunodeficiency syndrome (AIDS), and non-nucleoside reverse transcriptase inhibitors (NNRTIs) are the cornerstone of HIV treatment. In the last 20 years, our medicinal chemistry group has made great strides in developing several distinct novel NNRTIs, including 1-[(2-hydroxyethoxy)methyl]-6-(phenylthio)thymine (HEPT), thio-dihydro-alkoxy-benzyl-oxopyrimidine (S-DABO), diaryltriazine (DATA), diarylpyrimidine (DAPY) analogues, and their hybrid derivatives. Application of integrated modern medicinal strategies, including structure-based drug design, fragment-based optimization, scaffold/fragment hopping, molecular/fragment hybridization, and bioisosterism, led to the development of several highly potent analogues for further evaluations. In this paper, we review the development of NNRTIs in the last two decades using the above optimization strategies, including their structure-activity relationships, molecular modeling, and their binding modes with HIV-1 reverse transcriptase (RT). Future directions and perspectives on the design and associated challenges are also discussed.