Among the mechanisms set in motion by the tumor to escape the control of the immune system, MDSCs play a central role in inducing tolerance to a variety of anti-tumor effectors, including T lymphocytes. It has been demonstrated that MDSCs expand in tumor-bearing mice and in cancer patients, leading to an impairment of T cell reactivity against the tumor. However, as the presence of MDSCs is not correlated with a general immune suppression, it was advanced that a mechanism regulating the specificity of MDSC inhibition must be present. In this article, we review the literature showing that MDSCs exert their immune-suppressive function on Ag-specific T cell responses but at times, also on mitogen-activated T lymphocytes, therefore bypassing the Ag dependency. We propose that the features of MDSC-mediated immune suppression might be influenced not only by the specific microenvironment in which MDSCs expand and by the tumor characteristics but also by the levels of activation of the target lymphocytes.