A General-Purpose Self-Supervised Model for Computational Pathology. 2023

Richard J Chen, and Tong Ding, and Ming Y Lu, and Drew F K Williamson, and Guillaume Jaume, and Bowen Chen, and Andrew Zhang, and Daniel Shao, and Andrew H Song, and Muhammad Shaban, and Mane Williams, and Anurag Vaidya, and Sharifa Sahai, and Lukas Oldenburg, and Luca L Weishaupt, and Judy J Wang, and Walt Williams, and Long Phi Le, and Georg Gerber, and Faisal Mahmood

Tissue phenotyping is a fundamental computational pathology (CPath) task in learning objective characterizations of histopathologic biomarkers in anatomic pathology. However, whole-slide imaging (WSI) poses a complex computer vision problem in which the large-scale image resolutions of WSIs and the enormous diversity of morphological phenotypes preclude large-scale data annotation. Current efforts have proposed using pretrained image encoders with either transfer learning from natural image datasets or self-supervised pretraining on publicly-available histopathology datasets, but have not been extensively developed and evaluated across diverse tissue types at scale. We introduce UNI, a general-purpose self-supervised model for pathology, pretrained using over 100 million tissue patches from over 100,000 diagnostic haematoxylin and eosin-stained WSIs across 20 major tissue types, and evaluated on 33 representative CPath clinical tasks in CPath of varying diagnostic difficulties. In addition to outperforming previous state-of-the-art models, we demonstrate new modeling capabilities in CPath such as resolution-agnostic tissue classification, slide classification using few-shot class prototypes, and disease subtyping generalization in classifying up to 108 cancer types in the OncoTree code classification system. UNI advances unsupervised representation learning at scale in CPath in terms of both pretraining data and downstream evaluation, enabling data-efficient AI models that can generalize and transfer to a gamut of diagnostically-challenging tasks and clinical workflows in anatomic pathology.

UI MeSH Term Description Entries

Related Publications

Richard J Chen, and Tong Ding, and Ming Y Lu, and Drew F K Williamson, and Guillaume Jaume, and Bowen Chen, and Andrew Zhang, and Daniel Shao, and Andrew H Song, and Muhammad Shaban, and Mane Williams, and Anurag Vaidya, and Sharifa Sahai, and Lukas Oldenburg, and Luca L Weishaupt, and Judy J Wang, and Walt Williams, and Long Phi Le, and Georg Gerber, and Faisal Mahmood
July 2023, ArXiv,
Richard J Chen, and Tong Ding, and Ming Y Lu, and Drew F K Williamson, and Guillaume Jaume, and Bowen Chen, and Andrew Zhang, and Daniel Shao, and Andrew H Song, and Muhammad Shaban, and Mane Williams, and Anurag Vaidya, and Sharifa Sahai, and Lukas Oldenburg, and Luca L Weishaupt, and Judy J Wang, and Walt Williams, and Long Phi Le, and Georg Gerber, and Faisal Mahmood
June 2014, Anesthesia and analgesia,
Richard J Chen, and Tong Ding, and Ming Y Lu, and Drew F K Williamson, and Guillaume Jaume, and Bowen Chen, and Andrew Zhang, and Daniel Shao, and Andrew H Song, and Muhammad Shaban, and Mane Williams, and Anurag Vaidya, and Sharifa Sahai, and Lukas Oldenburg, and Luca L Weishaupt, and Judy J Wang, and Walt Williams, and Long Phi Le, and Georg Gerber, and Faisal Mahmood
January 2024, Frontiers in neurology,
Richard J Chen, and Tong Ding, and Ming Y Lu, and Drew F K Williamson, and Guillaume Jaume, and Bowen Chen, and Andrew Zhang, and Daniel Shao, and Andrew H Song, and Muhammad Shaban, and Mane Williams, and Anurag Vaidya, and Sharifa Sahai, and Lukas Oldenburg, and Luca L Weishaupt, and Judy J Wang, and Walt Williams, and Long Phi Le, and Georg Gerber, and Faisal Mahmood
July 2022, EBioMedicine,
Richard J Chen, and Tong Ding, and Ming Y Lu, and Drew F K Williamson, and Guillaume Jaume, and Bowen Chen, and Andrew Zhang, and Daniel Shao, and Andrew H Song, and Muhammad Shaban, and Mane Williams, and Anurag Vaidya, and Sharifa Sahai, and Lukas Oldenburg, and Luca L Weishaupt, and Judy J Wang, and Walt Williams, and Long Phi Le, and Georg Gerber, and Faisal Mahmood
January 2024, IEEE journal of translational engineering in health and medicine,
Richard J Chen, and Tong Ding, and Ming Y Lu, and Drew F K Williamson, and Guillaume Jaume, and Bowen Chen, and Andrew Zhang, and Daniel Shao, and Andrew H Song, and Muhammad Shaban, and Mane Williams, and Anurag Vaidya, and Sharifa Sahai, and Lukas Oldenburg, and Luca L Weishaupt, and Judy J Wang, and Walt Williams, and Long Phi Le, and Georg Gerber, and Faisal Mahmood
December 2023, Journal of cancer research and clinical oncology,
Richard J Chen, and Tong Ding, and Ming Y Lu, and Drew F K Williamson, and Guillaume Jaume, and Bowen Chen, and Andrew Zhang, and Daniel Shao, and Andrew H Song, and Muhammad Shaban, and Mane Williams, and Anurag Vaidya, and Sharifa Sahai, and Lukas Oldenburg, and Luca L Weishaupt, and Judy J Wang, and Walt Williams, and Long Phi Le, and Georg Gerber, and Faisal Mahmood
January 2024, IEEE transactions on medical imaging,
Richard J Chen, and Tong Ding, and Ming Y Lu, and Drew F K Williamson, and Guillaume Jaume, and Bowen Chen, and Andrew Zhang, and Daniel Shao, and Andrew H Song, and Muhammad Shaban, and Mane Williams, and Anurag Vaidya, and Sharifa Sahai, and Lukas Oldenburg, and Luca L Weishaupt, and Judy J Wang, and Walt Williams, and Long Phi Le, and Georg Gerber, and Faisal Mahmood
January 2023, IEEE/ACM transactions on computational biology and bioinformatics,
Richard J Chen, and Tong Ding, and Ming Y Lu, and Drew F K Williamson, and Guillaume Jaume, and Bowen Chen, and Andrew Zhang, and Daniel Shao, and Andrew H Song, and Muhammad Shaban, and Mane Williams, and Anurag Vaidya, and Sharifa Sahai, and Lukas Oldenburg, and Luca L Weishaupt, and Judy J Wang, and Walt Williams, and Long Phi Le, and Georg Gerber, and Faisal Mahmood
January 2018, Frontiers in neuroscience,
Richard J Chen, and Tong Ding, and Ming Y Lu, and Drew F K Williamson, and Guillaume Jaume, and Bowen Chen, and Andrew Zhang, and Daniel Shao, and Andrew H Song, and Muhammad Shaban, and Mane Williams, and Anurag Vaidya, and Sharifa Sahai, and Lukas Oldenburg, and Luca L Weishaupt, and Judy J Wang, and Walt Williams, and Long Phi Le, and Georg Gerber, and Faisal Mahmood
May 2024, bioRxiv : the preprint server for biology,
Copied contents to your clipboard!