Various body sites of vertebrates provide stable and nutrient-rich ecosystems for a diverse range of commensal, opportunistic, and pathogenic microorganisms to thrive. The collective genomes of these microbial symbionts (the microbiome) provide host animals with several advantages, including metabolism of indigestible carbohydrates, biosynthesis of vitamins, and modulation of innate and adaptive immune systems. In the context of the bovine udder, however, the relationship between cow and microbes has been traditionally viewed strictly from the perspective of host-pathogen interactions, with intramammary infections by mastitis pathogens triggering inflammatory responses (i.e., mastitis) that are often detrimental to mammary tissues and cow physiology. This traditional view has been challenged by recent metagenomic studies indicating that mammary secretions of clinically healthy quarters can harbor genomic markers of diverse bacterial groups, the vast majority of which have not been associated with mastitis. These observations have given rise to the concept of "commensal mammary microbiota," the ecological properties of which can have important implications for understanding the pathogenesis of mastitis and offer opportunities for development of novel prophylactic or therapeutic products (or both) as alternatives to antimicrobials. Studies conducted to date have suggested that an optimum diversity of mammary microbiota is associated with immune homeostasis, whereas the microbiota of mastitic quarters, or those with a history of mastitis, are considerably less diverse. Whether disruption of the diversity of udder microbiota (dysbiosis) has a role in determining mastitis susceptibility remains unknown. Moreover, little is known about contributions of various biotic and abiotic factors in shaping overall diversity of udder microbiota. This review summarizes current understanding of the microbiota within various niches of the udder and highlights the need to view the microbiota of the teat apex, teat canal, and mammary secretions as interconnected niches of a highly dynamic microbial ecosystem. In addition, host-associated factors, including physiological and anatomical parameters, as well as genetic traits that may affect the udder microbiota are briefly discussed. Finally, current understanding of the effect of antimicrobials on the composition of intramammary microbiota is discussed, highlighting the resilience of udder microbiota to exogenous perturbants.