In this study, several chromatographic sorbents: porous graphitic carbon (PGC), aminopropyl hydrophilic interaction (aminopropyl-HILIC), and phenylboronic acid (PBA) were assessed for the analysis of glycopeptides by on-line solid-phase extraction capillary electrophoresis mass spectrometry (SPE-CE-MS). As the PBA sorbent provided the most promising results, a PBA-SPE-CE-MS method was developed for the selective and sensitive preconcentration of glycopeptides from enzymatic digests of glycoproteins. Recombinant human erythropoietin (rhEPO) was selected as the model glycoprotein and subjected to enzymatic digestion with several proteases. The tryptic O126 and N83 glycopeptides from rhEPO were targeted to optimize the methodology. Under the optimized conditions, intraday precision, linearity, limits of detection (LODs), and microcartridge lifetime were evaluated, obtaining improved results compared to that from a previously reported TiO2-SPE-CE-MS method, especially for LODs of N-glycopeptides (up to 500 times lower than by CE-MS and up to 200 times lower than by TiO2-SPE-CE-MS). Moreover, rhEPO Glu-C digests were also analyzed by PBA-SPE-CE-MS to better characterize N24 and N38 glycopeptides. Finally, the established method was used to analyze two rhEPO products (EPOCIM and NeuroEPO plus), demonstrating its applicability in biopharmaceutical analysis. The sensitivity of the proposed PBA-SPE-CE-MS method improves the existing CE-MS methodologies for glycopeptide analysis and shows a great potential in glycoprotein analysis to deeply characterize protein glycosites even at low concentrations of the protein digest.