Aerobic life is based on a molecular machinery that utilizes oxygen as a terminal electron sink. The membrane-bound cytochrome c oxidase (CcO) catalyzes the reduction of oxygen to water in mitochondria and many bacteria. The energy released in this reaction is conserved by pumping protons across the mitochondrial or bacterial membrane, creating an electrochemical proton gradient that drives production of ATP. A crucial question is how the protons pumped by CcO are prevented from flowing backwards during the process. Here, we show by molecular dynamics simulations that the conserved glutamic acid 242 near the active site of CcO undergoes a protonation state-dependent conformational change, which provides a valve in the pumping mechanism. The valve ensures that at any point in time, the proton pathway across the membrane is effectively discontinuous, thereby preventing thermodynamically favorable proton back-leakage while maintaining an overall high efficiency of proton translocation. Suppression of proton leakage is particularly important in mitochondria under physiological conditions, where production of ATP takes place in the presence of a high electrochemical proton gradient.