Stormwater quality modelling is a useful tool in sewer systems management. Available models range from simple to detailed complex ones. The models need local data to be calibrated. In practice, calibration data are rather lacking. Only few measured events are commonly used. In this paper, the effect of the number and the variability of calibration data on models of various levels of complexity are investigated. The study is carried out on "Le Marais" catchment for suspended solids where 40 reliable measured events and good knowledge of the sewer system are available. The method used is based on resampling subsets of measured events among the 40 available ones. Three types of models were calibrated using subsets of events of different sizes and characteristics resampled among the 40 available ones. For each calibration, the model was validated against the remaining events to stand upon the quality of the model. It was found that the models are quite sensitive to calibration data, a problem neglected in practical studies. The use of more complex models does not necessarily improve modelling results since more problems and error sources are to be expected. The findings are specific to "Le Marais" catchment and the models used.