Clonal hematopoiesis (CH) occurs in hematopoietic stem cells with increased risks of progressing to hematologic malignancies. CH mutations are predominantly found in aged populations and correlate with an increased incidence of cardiovascular and other diseases. Increased lines of evidence demonstrate that CH mutations are closely related to the inflammatory bone marrow microenvironment. In this review, we summarize the recent advances in this topic starting from the discovery of CH and its mutations. We focus on the most commonly mutated and well-studied genes in CH and their contributions to the innate immune responses and inflammatory signaling, especially in the hematopoietic cells of bone marrow. We also aimed to discuss the interrelationship between inflammatory bone marrow microenvironment and CH mutations. Finally, we provide our perspectives on the challenges in the field and possible future directions to help understand the pathophysiology of CH.