The tumor microenvironment comprises multiple cell types, like cancer cells, endothelial cells, fibroblasts, and immune cells. In recent years, there have been massive research efforts focusing not only on cancer cells, but also on other cell types of the tumor microenvironment, thereby aiming to expand and determine novel treatment options. Fibroblasts represent a heterogenous cell family consisting of numerous subtypes, which can alter immune cell fractions, facilitate or inhibit tumor growth, build pre-metastatic niches, or stabilize vessels. These effects can be achieved through cell-cell interactions, which form the extracellular matrix, or via the secretion of cytokines or chemokines. The pro- or antitumorigenic fibroblast phenotypes show variability not only among different cancer entities, but also among intraindividual sites, including primary tumors or metastatic lesions. Commonly prescribed for arterial hypertension, the inhibitors of the renin-angiotensin system have recently been described as having an inhibitory effect on fibroblasts. This inhibition leads to modified immune cell fractions and increased tissue stiffness, thereby contributing to overcoming therapy resistance and ultimately inhibiting tumor growth. However, it is important to note that the inhibition of fibroblasts can also have the opposite effect, potentially resulting in increased tumor growth. We aim to summarize the latest state of research regarding fibroblast heterogeneity and its intricate impact on the tumor microenvironment and extracellular matrix. Specifically, we focus on highlighting recent advancements in the comprehension of intraindividual heterogeneity and therapy options within this context.