Taking advantage of the high functionalization capacity of poly(vinyl alcohol) (PVA), bead-free homogeneous nanofibrous mats were produced. The addition of functional groups by means of grafting strategies such as the sulfonation and the addition of nanoparticles such as graphene oxide (GO) were considered to bring new features to PVA. Two series of sulfonated and nonsulfonated composite nanofibers, with different compositions of GO, were prepared by electrospinning. The use of sulfosuccinic acid (SSA) allowed crosslinked and functionalized mats with controlled size and morphology to be obtained. The functionalization of the main chain of the PVA and the determination of the optimum composition of GO were analyzed in terms of the nanofibrous morphology, the chemical structure, the thermal properties, and conductivity. The crosslinking and the sulfonation treatment decreased the average fiber diameter of the nanofibers, which were electrical insulators regardless of the composition. The addition of small amounts of GO contributed to the retention of humidity, which significantly increased the proton conductivity. Although the single sulfonation of the polymer matrix produced a decrease in the proton conductivity, the combination of the sulfonation, the crosslinking, and the addition of GO enhanced the proton conductivity. The proposed nanofibers can be considered as good candidates for being exploited as valuable components for ionic polyelectrolyte membranes.