Tumor consists of heterogeneous cancer cells including cancer stem cells (CSCs) that can terminally differentiate into tumor bulk. Normal stem cells in normal organs regulate self-renewal within a stem cell niche. Likewise, accumulating evidence has also suggested that CSCs are maintained extrinsically within the tumor microenvironment, which includes both cellular and physical factors. Here, we review the significance of stromal cells, immune cells, extracellular matrix, tumor stiffness, and hypoxia in regulation of CSC plasticity and therapeutic resistance. With a better understanding of how CSC interacts with its niche, we are able to identify potential therapeutic targets for the development of more effective treatments against cancer.