Multiscale unsupervised domain adaptation for automatic pancreas segmentation in CT volumes using adversarial learning. 2022

Yan Zhu, and Peijun Hu, and Xiang Li, and Yu Tian, and Xueli Bai, and Tingbo Liang, and Jingsong Li
Engineering Research Center of EMR and Intelligent Expert System, Ministry of Education, College of Biomedical Engineering and Instrument Science, Zhejiang University, Hangzhou, China.

OBJECTIVE Computer-aided automatic pancreas segmentation is essential for early diagnosis and treatment of pancreatic diseases. However, the annotation of pancreas images requires professional doctors and considerable expenditure. Due to imaging differences among various institution population, scanning devices, imaging protocols, and so on, significant degradation in the performance of model inference results is prone to occur when models trained with domain-specific (usually institution-specific) datasets are directly applied to new (other centers/institutions) domain data. In this paper, we propose a novel unsupervised domain adaptation method based on adversarial learning to address pancreas segmentation challenges with the lack of annotations and domain shift interference. METHODS A 3D semantic segmentation model with attention module and residual module is designed as the backbone pancreas segmentation model. In both segmentation model and domain adaptation discriminator network, a multiscale progressively weighted structure is introduced to acquire different field of views. Features of labeled data and unlabeled data are fed in pairs into the proposed multiscale discriminator to learn domain-specific characteristics. Then the unlabeled data features with pseudodomain label are fed to the discriminator to acquire domain-ambiguous information. With this adversarial learning strategy, the performance of the segmentation network is enhanced to segment unseen unlabeled data. RESULTS Experiments were conducted on two public annotated datasets as source datasets, respectively, and one private dataset as target dataset, where annotations were not used for the training process but only for evaluation. The 3D segmentation model achieves comparative performance with state-of-the-art pancreas segmentation methods on source domain. After implementing our domain adaptation architecture, the average dice similarity coefficient (DSC) of the segmentation model trained on the NIH-TCIA source dataset increases from 58.79% to 72.73% on the local hospital dataset, while the performance of the target domain segmentation model transferred from the medical segmentation decathlon (MSD) source dataset rises from 62.34% to 71.17%. CONCLUSIONS Correlations of features across data domains are utilized to train the pancreas segmentation model on unlabeled data domain, improving the generalization of the model. Our results demonstrate that the proposed method enables the segmentation model to make meaningful segmentation for unseen data of the training set. In the future, the proposed method has the potential to apply segmentation model trained on public dataset to clinical unannotated CT images from local hospital, effectively assisting radiologists in clinical practice.

UI MeSH Term Description Entries
D007091 Image Processing, Computer-Assisted A technique of inputting two-dimensional or three-dimensional images into a computer and then enhancing or analyzing the imagery into a form that is more useful to the human observer. Biomedical Image Processing,Computer-Assisted Image Processing,Digital Image Processing,Image Analysis, Computer-Assisted,Image Reconstruction,Medical Image Processing,Analysis, Computer-Assisted Image,Computer-Assisted Image Analysis,Computer Assisted Image Analysis,Computer Assisted Image Processing,Computer-Assisted Image Analyses,Image Analyses, Computer-Assisted,Image Analysis, Computer Assisted,Image Processing, Biomedical,Image Processing, Computer Assisted,Image Processing, Digital,Image Processing, Medical,Image Processings, Medical,Image Reconstructions,Medical Image Processings,Processing, Biomedical Image,Processing, Digital Image,Processing, Medical Image,Processings, Digital Image,Processings, Medical Image,Reconstruction, Image,Reconstructions, Image
D010179 Pancreas A nodular organ in the ABDOMEN that contains a mixture of ENDOCRINE GLANDS and EXOCRINE GLANDS. The small endocrine portion consists of the ISLETS OF LANGERHANS secreting a number of hormones into the blood stream. The large exocrine portion (EXOCRINE PANCREAS) is a compound acinar gland that secretes several digestive enzymes into the pancreatic ductal system that empties into the DUODENUM.
D000077321 Deep Learning Supervised or unsupervised machine learning methods that use multiple layers of data representations generated by nonlinear transformations, instead of individual task-specific ALGORITHMS, to build and train neural network models. Hierarchical Learning,Learning, Deep,Learning, Hierarchical
D014057 Tomography, X-Ray Computed Tomography using x-ray transmission and a computer algorithm to reconstruct the image. CAT Scan, X-Ray,CT Scan, X-Ray,Cine-CT,Computerized Tomography, X-Ray,Electron Beam Computed Tomography,Tomodensitometry,Tomography, Transmission Computed,X-Ray Tomography, Computed,CAT Scan, X Ray,CT X Ray,Computed Tomography, X-Ray,Computed X Ray Tomography,Computerized Tomography, X Ray,Electron Beam Tomography,Tomography, X Ray Computed,Tomography, X-Ray Computer Assisted,Tomography, X-Ray Computerized,Tomography, X-Ray Computerized Axial,Tomography, Xray Computed,X Ray Computerized Tomography,X Ray Tomography, Computed,X-Ray Computer Assisted Tomography,X-Ray Computerized Axial Tomography,Beam Tomography, Electron,CAT Scans, X-Ray,CT Scan, X Ray,CT Scans, X-Ray,CT X Rays,Cine CT,Computed Tomography, Transmission,Computed Tomography, X Ray,Computed Tomography, Xray,Computed X-Ray Tomography,Scan, X-Ray CAT,Scan, X-Ray CT,Scans, X-Ray CAT,Scans, X-Ray CT,Tomographies, Computed X-Ray,Tomography, Computed X-Ray,Tomography, Electron Beam,Tomography, X Ray Computer Assisted,Tomography, X Ray Computerized,Tomography, X Ray Computerized Axial,Transmission Computed Tomography,X Ray Computer Assisted Tomography,X Ray Computerized Axial Tomography,X Ray, CT,X Rays, CT,X-Ray CAT Scan,X-Ray CAT Scans,X-Ray CT Scan,X-Ray CT Scans,X-Ray Computed Tomography,X-Ray Computerized Tomography,Xray Computed Tomography

Related Publications

Yan Zhu, and Peijun Hu, and Xiang Li, and Yu Tian, and Xueli Bai, and Tingbo Liang, and Jingsong Li
July 2022, Annual International Conference of the IEEE Engineering in Medicine and Biology Society. IEEE Engineering in Medicine and Biology Society. Annual International Conference,
Yan Zhu, and Peijun Hu, and Xiang Li, and Yu Tian, and Xueli Bai, and Tingbo Liang, and Jingsong Li
March 2024, Medical physics,
Yan Zhu, and Peijun Hu, and Xiang Li, and Yu Tian, and Xueli Bai, and Tingbo Liang, and Jingsong Li
November 2022, Medical & biological engineering & computing,
Yan Zhu, and Peijun Hu, and Xiang Li, and Yu Tian, and Xueli Bai, and Tingbo Liang, and Jingsong Li
December 2023, IEEE journal of biomedical and health informatics,
Yan Zhu, and Peijun Hu, and Xiang Li, and Yu Tian, and Xueli Bai, and Tingbo Liang, and Jingsong Li
November 2022, Medical image analysis,
Yan Zhu, and Peijun Hu, and Xiang Li, and Yu Tian, and Xueli Bai, and Tingbo Liang, and Jingsong Li
September 2021, Computers in biology and medicine,
Yan Zhu, and Peijun Hu, and Xiang Li, and Yu Tian, and Xueli Bai, and Tingbo Liang, and Jingsong Li
July 2022, Annual International Conference of the IEEE Engineering in Medicine and Biology Society. IEEE Engineering in Medicine and Biology Society. Annual International Conference,
Yan Zhu, and Peijun Hu, and Xiang Li, and Yu Tian, and Xueli Bai, and Tingbo Liang, and Jingsong Li
November 2022, IEEE transactions on neural networks and learning systems,
Yan Zhu, and Peijun Hu, and Xiang Li, and Yu Tian, and Xueli Bai, and Tingbo Liang, and Jingsong Li
August 2023, IEEE transactions on neural networks and learning systems,
Yan Zhu, and Peijun Hu, and Xiang Li, and Yu Tian, and Xueli Bai, and Tingbo Liang, and Jingsong Li
August 2022, Journal of imaging,
Copied contents to your clipboard!