An alpha-mannosidase activity has been identified in a preparation of rat liver endoplasmic reticulum and shown to be distinct from the previously described Golgi alpha-mannosidases I and II and the lysosomal alpha-mannosidase. The enzyme was solubilized with deoxycholate and separated from other alpha-mannosidases by passage over concanavalin A-Sepharose to which it does not bind. The endoplasmic reticulum alpha-mannosidase cleaves alpha-1,2-linked mannoses from high mannose oligosaccharides and, unlike Golgi alpha-mannosidase I, is active against p-nitrophenyl-alpha-D-mannoside (Km = 0.17 mM). It has no activity toward GlcNAc-Man5GlcNAc2 peptide, the specific substrate of the Golgi alpha-mannosidase II. The endoplasmic reticulum alpha-mannosidase activity toward p-nitrophenyl-alpha-D-mannoside is relatively insensitive to swainsonine, an inhibitor of both the lysosomal alpha-mannosidase and Golgi alpha-mannosidase II. We propose that the endoplasmic reticulum alpha-mannosidase is responsible for the removal of mannose residues from asparagine-linked high mannose type oligosaccharides prior to their entry into the Golgi.