Transformer based Generative Adversarial Network for Liver Segmentation. 2022

Ugur Demir, and Zheyuan Zhang, and Bin Wang, and Matthew Antalek, and Elif Keles, and Debesh Jha, and Amir Borhani, and Daniela Ladner, and Ulas Bagci
Northwestern University, IL 60201, USA.

Automated liver segmentation from radiology scans (CT, MRI) can improve surgery and therapy planning and follow-up assessment in addition to conventional use for diagnosis and prognosis. Although convolutional neural networks (CNNs) have became the standard image segmentation tasks, more recently this has started to change towards Transformers based architectures because Transformers are taking advantage of capturing long range dependence modeling capability in signals, so called attention mechanism. In this study, we propose a new segmentation approach using a hybrid approach combining the Transformer(s) with the Generative Adversarial Network (GAN) approach. The premise behind this choice is that the self-attention mechanism of the Transformers allows the network to aggregate the high dimensional feature and provide global information modeling. This mechanism provides better segmentation performance compared with traditional methods. Furthermore, we encode this generator into the GAN based architecture so that the discriminator network in the GAN can classify the credibility of the generated segmentation masks compared with the real masks coming from human (expert) annotations. This allows us to extract the high dimensional topology information in the mask for biomedical image segmentation and provide more reliable segmentation results. Our model achieved a high dice coefficient of 0.9433, recall of 0.9515, and precision of 0.9376 and outperformed other Transformer based approaches. The implementation details of the proposed architecture can be found at https://github.com/UgurDemir/tranformer_liver_segmentation.

UI MeSH Term Description Entries

Related Publications

Ugur Demir, and Zheyuan Zhang, and Bin Wang, and Matthew Antalek, and Elif Keles, and Debesh Jha, and Amir Borhani, and Daniela Ladner, and Ulas Bagci
January 2022, Frontiers in neuroscience,
Ugur Demir, and Zheyuan Zhang, and Bin Wang, and Matthew Antalek, and Elif Keles, and Debesh Jha, and Amir Borhani, and Daniela Ladner, and Ulas Bagci
July 2023, Annual International Conference of the IEEE Engineering in Medicine and Biology Society. IEEE Engineering in Medicine and Biology Society. Annual International Conference,
Ugur Demir, and Zheyuan Zhang, and Bin Wang, and Matthew Antalek, and Elif Keles, and Debesh Jha, and Amir Borhani, and Daniela Ladner, and Ulas Bagci
July 2019, Annual International Conference of the IEEE Engineering in Medicine and Biology Society. IEEE Engineering in Medicine and Biology Society. Annual International Conference,
Ugur Demir, and Zheyuan Zhang, and Bin Wang, and Matthew Antalek, and Elif Keles, and Debesh Jha, and Amir Borhani, and Daniela Ladner, and Ulas Bagci
November 2023, IEEE journal of biomedical and health informatics,
Ugur Demir, and Zheyuan Zhang, and Bin Wang, and Matthew Antalek, and Elif Keles, and Debesh Jha, and Amir Borhani, and Daniela Ladner, and Ulas Bagci
February 2023, Computers in biology and medicine,
Ugur Demir, and Zheyuan Zhang, and Bin Wang, and Matthew Antalek, and Elif Keles, and Debesh Jha, and Amir Borhani, and Daniela Ladner, and Ulas Bagci
November 2022, Sensors (Basel, Switzerland),
Ugur Demir, and Zheyuan Zhang, and Bin Wang, and Matthew Antalek, and Elif Keles, and Debesh Jha, and Amir Borhani, and Daniela Ladner, and Ulas Bagci
January 2023, Medicina (Kaunas, Lithuania),
Ugur Demir, and Zheyuan Zhang, and Bin Wang, and Matthew Antalek, and Elif Keles, and Debesh Jha, and Amir Borhani, and Daniela Ladner, and Ulas Bagci
April 2023, Medical image analysis,
Ugur Demir, and Zheyuan Zhang, and Bin Wang, and Matthew Antalek, and Elif Keles, and Debesh Jha, and Amir Borhani, and Daniela Ladner, and Ulas Bagci
April 2023, Diagnostics (Basel, Switzerland),
Ugur Demir, and Zheyuan Zhang, and Bin Wang, and Matthew Antalek, and Elif Keles, and Debesh Jha, and Amir Borhani, and Daniela Ladner, and Ulas Bagci
October 2023, Scientific reports,
Copied contents to your clipboard!