Background: Cognitive dysfunction is one of the main symptoms of neurofibromatosis type 1 (NF1). As an important cognitive function, working memory (WM) has rarely been systematically analyzed in NF1 by isolating the particular domain of WM, and existing data involving WM in adult patients with NF1 are insufficient. This study aimed to investigate the characteristics of different types of WM in NF1 from the perspective of the adult population. Method: We comprehensively analyzed WM in both verbal and visuospatial WM domains by using the N-back task (including the verbal N-back task and the visuospatial N-back task) in 31 adults with NF1 and 34 healthy controls matched for age, gender, education levels, and general cognitive status. The accuracy and reaction times (RTs) in the N-back task were entered into mixed-design ANOVA. Results: Compared with healthy controls, adults with NF1 presented significantly lower mean accuracy and longer RTs in the visuospatial N-back task. However, no significant difference was found between the NF1 group and healthy controls in the verbal N-back task. Conclusions: The present study suggested that adults with NF1 might have deficits in visuospatial WM. We did not find evidence for verbal WM deficits in adult patients with NF1. Our findings supplement and refine the existing data on WM in the context of NF1.