Deep-Learning Approaches for Cervical Cytology Nuclei Segmentation in Whole Slide Images. 2025

Andrés Mosquera-Zamudio, and Sandra Cancino, and Guillermo Cárdenas-Montoya, and Juan D Garcia-Arteaga, and Carlos Zambrano-Betancourt, and Rafael Parra-Medina
Departamento de Patología, Instituto Nacional de Cancerología (INC), Bogotá 111511, Colombia.

Whole-slide imaging (WSI) in cytopathology poses challenges related to segmentation accuracy, computational efficiency, and image acquisition artifacts. This study aims to evaluate the performance of deep-learning models for instance segmentation in cervical cytology, benchmarking them against state-of-the-art methods on both public and institutional datasets. We tested three architectures-U-Net, vision transformer (ViT), and Detectron2-and evaluated their performance on the ISBI 2014 and CNseg datasets using panoptic quality (PQ), dice similarity coefficient (DSC), and intersection over union (IoU). All models were trained on CNseg and tested on an independent institutional dataset. Data preprocessing involved manual annotation using QuPath, patch extraction guided by GeoJSON files, and exclusion of regions containing less than 60% cytologic material. Our models achieved superior segmentation performance on public datasets, reaching up to 98% PQ. Performance decreased on the institutional dataset, likely due to differences in image acquisition and the presence of blurred nuclei. Nevertheless, the models were able to detect blurred nuclei, highlighting their robustness in suboptimal imaging conditions. In conclusion, the proposed models offer an accurate and efficient solution for instance segmentation in cytology WSI. These results support the development of reliable AI-powered tools for digital cytology, with potential applications in automated screening and diagnostic workflows.

UI MeSH Term Description Entries

Related Publications

Andrés Mosquera-Zamudio, and Sandra Cancino, and Guillermo Cárdenas-Montoya, and Juan D Garcia-Arteaga, and Carlos Zambrano-Betancourt, and Rafael Parra-Medina
February 2022, Cancers,
Andrés Mosquera-Zamudio, and Sandra Cancino, and Guillermo Cárdenas-Montoya, and Juan D Garcia-Arteaga, and Carlos Zambrano-Betancourt, and Rafael Parra-Medina
January 2025, Frontiers in oncology,
Andrés Mosquera-Zamudio, and Sandra Cancino, and Guillermo Cárdenas-Montoya, and Juan D Garcia-Arteaga, and Carlos Zambrano-Betancourt, and Rafael Parra-Medina
September 2022, Sensors (Basel, Switzerland),
Andrés Mosquera-Zamudio, and Sandra Cancino, and Guillermo Cárdenas-Montoya, and Juan D Garcia-Arteaga, and Carlos Zambrano-Betancourt, and Rafael Parra-Medina
November 2021, Scientific reports,
Andrés Mosquera-Zamudio, and Sandra Cancino, and Guillermo Cárdenas-Montoya, and Juan D Garcia-Arteaga, and Carlos Zambrano-Betancourt, and Rafael Parra-Medina
June 2023, Experimental dermatology,
Andrés Mosquera-Zamudio, and Sandra Cancino, and Guillermo Cárdenas-Montoya, and Juan D Garcia-Arteaga, and Carlos Zambrano-Betancourt, and Rafael Parra-Medina
February 2021, IEEE journal of biomedical and health informatics,
Andrés Mosquera-Zamudio, and Sandra Cancino, and Guillermo Cárdenas-Montoya, and Juan D Garcia-Arteaga, and Carlos Zambrano-Betancourt, and Rafael Parra-Medina
January 2023, PloS one,
Andrés Mosquera-Zamudio, and Sandra Cancino, and Guillermo Cárdenas-Montoya, and Juan D Garcia-Arteaga, and Carlos Zambrano-Betancourt, and Rafael Parra-Medina
November 2022, Computers in biology and medicine,
Andrés Mosquera-Zamudio, and Sandra Cancino, and Guillermo Cárdenas-Montoya, and Juan D Garcia-Arteaga, and Carlos Zambrano-Betancourt, and Rafael Parra-Medina
January 2017, Journal of pathology informatics,
Andrés Mosquera-Zamudio, and Sandra Cancino, and Guillermo Cárdenas-Montoya, and Juan D Garcia-Arteaga, and Carlos Zambrano-Betancourt, and Rafael Parra-Medina
June 2025, Bioengineering (Basel, Switzerland),
Copied contents to your clipboard!