Deep learning-based framework for slide-based histopathological image analysis. 2022

Sai Kosaraju, and Jeongyeon Park, and Hyun Lee, and Jung Wook Yang, and Mingon Kang
Department of Computer Science, University of Nevada, Las Vegas, Las Vegas, NV, 89154, USA.

Digital pathology coupled with advanced machine learning (e.g., deep learning) has been changing the paradigm of whole-slide histopathological images (WSIs) analysis. Major applications in digital pathology using machine learning include automatic cancer classification, survival analysis, and subtyping from pathological images. While most pathological image analyses are based on patch-wise processing due to the extremely large size of histopathology images, there are several applications that predict a single clinical outcome or perform pathological diagnosis per slide (e.g., cancer classification, survival analysis). However, current slide-based analyses are task-dependent, and a general framework of slide-based analysis in WSI has been seldom investigated. We propose a novel slide-based histopathology analysis framework that creates a WSI representation map, called HipoMap, that can be applied to any slide-based problems, coupled with convolutional neural networks. HipoMap converts a WSI of various shapes and sizes to structured image-type representation. Our proposed HipoMap outperformed existing methods in intensive experiments with various settings and datasets. HipoMap showed the Area Under the Curve (AUC) of 0.96±0.026 (5% improved) in the experiments for lung cancer classification, and c-index of 0.787±0.013 (3.5% improved) and coefficient of determination ([Formula: see text]) of 0.978±0.032 (24% improved) in survival analysis and survival prediction with TCGA lung cancer data respectively, as a general framework of slide-based analysis with a flexible capability. The results showed significant improvement comparing to the current state-of-the-art methods on each task. We further discussed experimental results of HipoMap as pathological viewpoints and verified the performance using publicly available TCGA datasets. A Python package is available at https://pypi.org/project/hipomap , and the package can be easily installed using Python PIP. The open-source codes in Python are available at: https://github.com/datax-lab/HipoMap .

UI MeSH Term Description Entries
D007091 Image Processing, Computer-Assisted A technique of inputting two-dimensional or three-dimensional images into a computer and then enhancing or analyzing the imagery into a form that is more useful to the human observer. Biomedical Image Processing,Computer-Assisted Image Processing,Digital Image Processing,Image Analysis, Computer-Assisted,Image Reconstruction,Medical Image Processing,Analysis, Computer-Assisted Image,Computer-Assisted Image Analysis,Computer Assisted Image Analysis,Computer Assisted Image Processing,Computer-Assisted Image Analyses,Image Analyses, Computer-Assisted,Image Analysis, Computer Assisted,Image Processing, Biomedical,Image Processing, Computer Assisted,Image Processing, Digital,Image Processing, Medical,Image Processings, Medical,Image Reconstructions,Medical Image Processings,Processing, Biomedical Image,Processing, Digital Image,Processing, Medical Image,Processings, Digital Image,Processings, Medical Image,Reconstruction, Image,Reconstructions, Image
D008175 Lung Neoplasms Tumors or cancer of the LUNG. Cancer of Lung,Lung Cancer,Pulmonary Cancer,Pulmonary Neoplasms,Cancer of the Lung,Neoplasms, Lung,Neoplasms, Pulmonary,Cancer, Lung,Cancer, Pulmonary,Cancers, Lung,Cancers, Pulmonary,Lung Cancers,Lung Neoplasm,Neoplasm, Lung,Neoplasm, Pulmonary,Pulmonary Cancers,Pulmonary Neoplasm
D006801 Humans Members of the species Homo sapiens. Homo sapiens,Man (Taxonomy),Human,Man, Modern,Modern Man
D000069550 Machine Learning A type of ARTIFICIAL INTELLIGENCE that enable COMPUTERS to independently initiate and execute LEARNING when exposed to new data. Transfer Learning,Learning, Machine,Learning, Transfer
D000077321 Deep Learning Supervised or unsupervised machine learning methods that use multiple layers of data representations generated by nonlinear transformations, instead of individual task-specific ALGORITHMS, to build and train neural network models. Hierarchical Learning,Learning, Deep,Learning, Hierarchical
D016571 Neural Networks, Computer A computer architecture, implementable in either hardware or software, modeled after biological neural networks. Like the biological system in which the processing capability is a result of the interconnection strengths between arrays of nonlinear processing nodes, computerized neural networks, often called perceptrons or multilayer connectionist models, consist of neuron-like units. A homogeneous group of units makes up a layer. These networks are good at pattern recognition. They are adaptive, performing tasks by example, and thus are better for decision-making than are linear learning machines or cluster analysis. They do not require explicit programming. Computational Neural Networks,Connectionist Models,Models, Neural Network,Neural Network Models,Neural Networks (Computer),Perceptrons,Computational Neural Network,Computer Neural Network,Computer Neural Networks,Connectionist Model,Model, Connectionist,Model, Neural Network,Models, Connectionist,Network Model, Neural,Network Models, Neural,Network, Computational Neural,Network, Computer Neural,Network, Neural (Computer),Networks, Computational Neural,Networks, Computer Neural,Networks, Neural (Computer),Neural Network (Computer),Neural Network Model,Neural Network, Computational,Neural Network, Computer,Neural Networks, Computational,Perceptron

Related Publications

Sai Kosaraju, and Jeongyeon Park, and Hyun Lee, and Jung Wook Yang, and Mingon Kang
June 2021, Scientific reports,
Sai Kosaraju, and Jeongyeon Park, and Hyun Lee, and Jung Wook Yang, and Mingon Kang
May 2021, IEEE journal of biomedical and health informatics,
Sai Kosaraju, and Jeongyeon Park, and Hyun Lee, and Jung Wook Yang, and Mingon Kang
January 2019, Frontiers in medicine,
Sai Kosaraju, and Jeongyeon Park, and Hyun Lee, and Jung Wook Yang, and Mingon Kang
January 2022, Journal of pathology informatics,
Sai Kosaraju, and Jeongyeon Park, and Hyun Lee, and Jung Wook Yang, and Mingon Kang
January 2022, IEEE/ACM transactions on computational biology and bioinformatics,
Sai Kosaraju, and Jeongyeon Park, and Hyun Lee, and Jung Wook Yang, and Mingon Kang
January 2020, Frontiers in medicine,
Sai Kosaraju, and Jeongyeon Park, and Hyun Lee, and Jung Wook Yang, and Mingon Kang
June 2021, Computer methods and programs in biomedicine,
Sai Kosaraju, and Jeongyeon Park, and Hyun Lee, and Jung Wook Yang, and Mingon Kang
July 2018, IEEE transactions on medical imaging,
Sai Kosaraju, and Jeongyeon Park, and Hyun Lee, and Jung Wook Yang, and Mingon Kang
September 2020, IEEE transactions on cybernetics,
Sai Kosaraju, and Jeongyeon Park, and Hyun Lee, and Jung Wook Yang, and Mingon Kang
March 2023, Computerized medical imaging and graphics : the official journal of the Computerized Medical Imaging Society,
Copied contents to your clipboard!