Pathogenesis of viral infections of the central nervous system (CNS) is poorly understood, and this is partly due to the limitations of currently used preclinical models. Brain organoid models can overcome some of these limitations, as they are generated from human derived stem cells, differentiated in three dimensions (3D), and can mimic human neurodevelopmental characteristics. Therefore, brain organoids have been increasingly used as brain models in research on various viruses, such as Zika virus, severe acute respiratory syndrome coronavirus 2, human cytomegalovirus, and herpes simplex virus. Brain organoids allow for the study of viral tropism, the effect of infection on organoid function, size, and cytoarchitecture, as well as innate immune response; therefore, they provide valuable insight into the pathogenesis of neurotropic viral infections and testing of antivirals in a physiological model. In this review, we summarize the results of studies on viral CNS infection in brain organoids, and we demonstrate the broad application and benefits of using a human 3D model in virology research. At the same time, we describe the limitations of the studies in brain organoids, such as the heterogeneity in organoid generation protocols and age at infection, which result in differences in results between studies, as well as the lack of microglia and a blood brain barrier.