Nearly all cases of human listeriosis have been associated with consumption of contaminated food, therefore the investigation of the virulence of Listeria (L.) monocytogenes after exposure to environmental conditions in food matrices is critical in order to understand and control its impact on public health. As milk and dairy products have been implicated in more than half of the listeriosis outbreaks, we investigated the in vitro virulence of L. monocytogenes incubated in different milk types at various storage conditions. Incubation in pasteurized milk at refrigeration conditions (4°C) revealed a higher invasion and intracellular proliferation of four different L. monocytogenes strains compared to raw milk using human intestinal epithelial Caco-2 cells. Furthermore the period of storage, which increased L. monocytogenes cell numbers, decreased in vitro virulence. However, L. monocytogenes stored for 3weeks at 4°C in milk are still able to invade and proliferate into the host cell. Interestingly abused storage temperatures (25°C and 30°C) for a short time period (2h) revealed an attenuated impact on the in vitro virulence of L. monocytogenes compared to the storage temperature of 4°C. Regarding the major milk compounds, the level of milk fat significantly affected the in vitro virulence of L. monocytogenes. Pre-incubation in milk with high fat content (3.6%) resulted in a lower invasion capability compared to milk with low fat content. In contrast casein and lactose did not influence the invasiveness of L. monocytogenes into the host cell. In conclusion our study shows that the milk environment and different storage conditions influence the in vitro virulence of L. monocytogenes, both of which have to be considered in the risk assessment of contaminated food.