Picroside II, an iridoid compound extracted from Picrorhiza, exhibits anti-inflammatory and anti-apoptotic activities. We explored the protective effects and mechanisms of picroside II in a mouse model of sepsis induced by cecal ligation and puncture (CLP), using three groups of mice: Group A (sham), Group B (CLP+NS) and Group C (CLP+20 mg/kg picroside II). The mortality in mice with sepsis was decreased by the administration of picroside II, and lung injury was alleviated simultaneously. Picroside II treatment enhanced bacterial clearance in septic mice. Further, picroside II treatment alleviated the inflammatory response in sepsis and enhanced immune function by inhibiting the activation of NLRP3 inflammasome and NF-κB pathways. Picroside II may represent an anti-inflammatory drug candidate, providing novel insight into the treatment of sepsis.