Time-distanced gates in long short-term memory networks. 2020

Riqiang Gao, and Yucheng Tang, and Kaiwen Xu, and Yuankai Huo, and Shunxing Bao, and Sanja L Antic, and Emily S Epstein, and Steve Deppen, and Alexis B Paulson, and Kim L Sandler, and Pierre P Massion, and Bennett A Landman
Electrical Engineering and Computer Science, Vanderbilt University, Nashville, TN 37235, USA. Electronic address: riqiang.gao@vanderbilt.edu.

The Long Short-Term Memory (LSTM) network is widely used in modeling sequential observations in fields ranging from natural language processing to medical imaging. The LSTM has shown promise for interpreting computed tomography (CT) in lung screening protocols. Yet, traditional image-based LSTM models ignore interval differences, while recently proposed interval-modeled LSTM variants are limited in their ability to interpret temporal proximity. Meanwhile, clinical imaging acquisition may be irregularly sampled, and such sampling patterns may be commingled with clinical usages. In this paper, we propose the Distanced LSTM (DLSTM) by introducing time-distanced (i.e., time distance to the last scan) gates with a temporal emphasis model (TEM) targeting at lung cancer diagnosis (i.e., evaluating the malignancy of pulmonary nodules). Briefly, (1) the time distance of every scan to the last scan is modeled explicitly, (2) time-distanced input and forget gates in DLSTM are introduced across regular and irregular sampling sequences, and (3) the newer scan in serial data is emphasized by the TEM. The DLSTM algorithm is evaluated with both simulated data and real CT images (from 1794 National Lung Screening Trial (NLST) patients with longitudinal scans and 1420 clinical studied patients). Experimental results on simulated data indicate the DLSTM can capture families of temporal relationships that cannot be detected with traditional LSTM. Cross-validation on empirical CT datasets demonstrates that DLSTM achieves leading performance on both regularly and irregularly sampled data (e.g., improving LSTM from 0.6785 to 0.7085 on F1 score in NLST). In external-validation on irregularly acquired data, the benchmarks achieved 0.8350 (CNN feature) and 0.8380 (with LSTM) on AUC score, while the proposed DLSTM achieves 0.8905. In conclusion, the DLSTM approach is shown to be compatible with families of linear, quadratic, exponential, and log-exponential temporal models. The DLSTM can be readily extended with other temporal dependence interactions while hardly increasing overall model complexity.

UI MeSH Term Description Entries
D008570 Memory, Short-Term Remembrance of information for a few seconds to hours. Immediate Recall,Memory, Immediate,Working Memory,Memory, Shortterm,Immediate Memories,Immediate Memory,Immediate Recalls,Memories, Immediate,Memories, Short-Term,Memories, Shortterm,Memory, Short Term,Recall, Immediate,Recalls, Immediate,Short-Term Memories,Short-Term Memory,Shortterm Memories,Shortterm Memory,Working Memories
D009323 Natural Language Processing Computer processing of a language with rules that reflect and describe current usage rather than prescribed usage. Language Processing, Natural,Language Processings, Natural,Natural Language Processings,Processing, Natural Language,Processings, Natural Language
D006801 Humans Members of the species Homo sapiens. Homo sapiens,Man (Taxonomy),Human,Man, Modern,Modern Man
D000465 Algorithms A procedure consisting of a sequence of algebraic formulas and/or logical steps to calculate or determine a given task. Algorithm
D014057 Tomography, X-Ray Computed Tomography using x-ray transmission and a computer algorithm to reconstruct the image. CAT Scan, X-Ray,CT Scan, X-Ray,Cine-CT,Computerized Tomography, X-Ray,Electron Beam Computed Tomography,Tomodensitometry,Tomography, Transmission Computed,X-Ray Tomography, Computed,CAT Scan, X Ray,CT X Ray,Computed Tomography, X-Ray,Computed X Ray Tomography,Computerized Tomography, X Ray,Electron Beam Tomography,Tomography, X Ray Computed,Tomography, X-Ray Computer Assisted,Tomography, X-Ray Computerized,Tomography, X-Ray Computerized Axial,Tomography, Xray Computed,X Ray Computerized Tomography,X Ray Tomography, Computed,X-Ray Computer Assisted Tomography,X-Ray Computerized Axial Tomography,Beam Tomography, Electron,CAT Scans, X-Ray,CT Scan, X Ray,CT Scans, X-Ray,CT X Rays,Cine CT,Computed Tomography, Transmission,Computed Tomography, X Ray,Computed Tomography, Xray,Computed X-Ray Tomography,Scan, X-Ray CAT,Scan, X-Ray CT,Scans, X-Ray CAT,Scans, X-Ray CT,Tomographies, Computed X-Ray,Tomography, Computed X-Ray,Tomography, Electron Beam,Tomography, X Ray Computer Assisted,Tomography, X Ray Computerized,Tomography, X Ray Computerized Axial,Transmission Computed Tomography,X Ray Computer Assisted Tomography,X Ray Computerized Axial Tomography,X Ray, CT,X Rays, CT,X-Ray CAT Scan,X-Ray CAT Scans,X-Ray CT Scan,X-Ray CT Scans,X-Ray Computed Tomography,X-Ray Computerized Tomography,Xray Computed Tomography
D016571 Neural Networks, Computer A computer architecture, implementable in either hardware or software, modeled after biological neural networks. Like the biological system in which the processing capability is a result of the interconnection strengths between arrays of nonlinear processing nodes, computerized neural networks, often called perceptrons or multilayer connectionist models, consist of neuron-like units. A homogeneous group of units makes up a layer. These networks are good at pattern recognition. They are adaptive, performing tasks by example, and thus are better for decision-making than are linear learning machines or cluster analysis. They do not require explicit programming. Computational Neural Networks,Connectionist Models,Models, Neural Network,Neural Network Models,Neural Networks (Computer),Perceptrons,Computational Neural Network,Computer Neural Network,Computer Neural Networks,Connectionist Model,Model, Connectionist,Model, Neural Network,Models, Connectionist,Network Model, Neural,Network Models, Neural,Network, Computational Neural,Network, Computer Neural,Network, Neural (Computer),Networks, Computational Neural,Networks, Computer Neural,Networks, Neural (Computer),Neural Network (Computer),Neural Network Model,Neural Network, Computational,Neural Network, Computer,Neural Networks, Computational,Perceptron

Related Publications

Riqiang Gao, and Yucheng Tang, and Kaiwen Xu, and Yuankai Huo, and Shunxing Bao, and Sanja L Antic, and Emily S Epstein, and Steve Deppen, and Alexis B Paulson, and Kim L Sandler, and Pierre P Massion, and Bennett A Landman
February 2014, Biological cybernetics,
Riqiang Gao, and Yucheng Tang, and Kaiwen Xu, and Yuankai Huo, and Shunxing Bao, and Sanja L Antic, and Emily S Epstein, and Steve Deppen, and Alexis B Paulson, and Kim L Sandler, and Pierre P Massion, and Bennett A Landman
July 2021, Scientific reports,
Riqiang Gao, and Yucheng Tang, and Kaiwen Xu, and Yuankai Huo, and Shunxing Bao, and Sanja L Antic, and Emily S Epstein, and Steve Deppen, and Alexis B Paulson, and Kim L Sandler, and Pierre P Massion, and Bennett A Landman
April 2019, Physics in medicine and biology,
Riqiang Gao, and Yucheng Tang, and Kaiwen Xu, and Yuankai Huo, and Shunxing Bao, and Sanja L Antic, and Emily S Epstein, and Steve Deppen, and Alexis B Paulson, and Kim L Sandler, and Pierre P Massion, and Bennett A Landman
June 2020, Studies in health technology and informatics,
Riqiang Gao, and Yucheng Tang, and Kaiwen Xu, and Yuankai Huo, and Shunxing Bao, and Sanja L Antic, and Emily S Epstein, and Steve Deppen, and Alexis B Paulson, and Kim L Sandler, and Pierre P Massion, and Bennett A Landman
June 2020, Studies in health technology and informatics,
Riqiang Gao, and Yucheng Tang, and Kaiwen Xu, and Yuankai Huo, and Shunxing Bao, and Sanja L Antic, and Emily S Epstein, and Steve Deppen, and Alexis B Paulson, and Kim L Sandler, and Pierre P Massion, and Bennett A Landman
August 2018, International journal of neural systems,
Riqiang Gao, and Yucheng Tang, and Kaiwen Xu, and Yuankai Huo, and Shunxing Bao, and Sanja L Antic, and Emily S Epstein, and Steve Deppen, and Alexis B Paulson, and Kim L Sandler, and Pierre P Massion, and Bennett A Landman
November 2022, The journal of physical chemistry letters,
Riqiang Gao, and Yucheng Tang, and Kaiwen Xu, and Yuankai Huo, and Shunxing Bao, and Sanja L Antic, and Emily S Epstein, and Steve Deppen, and Alexis B Paulson, and Kim L Sandler, and Pierre P Massion, and Bennett A Landman
December 2021, Current genomics,
Riqiang Gao, and Yucheng Tang, and Kaiwen Xu, and Yuankai Huo, and Shunxing Bao, and Sanja L Antic, and Emily S Epstein, and Steve Deppen, and Alexis B Paulson, and Kim L Sandler, and Pierre P Massion, and Bennett A Landman
November 1997, Neural computation,
Riqiang Gao, and Yucheng Tang, and Kaiwen Xu, and Yuankai Huo, and Shunxing Bao, and Sanja L Antic, and Emily S Epstein, and Steve Deppen, and Alexis B Paulson, and Kim L Sandler, and Pierre P Massion, and Bennett A Landman
January 2016, PloS one,
Copied contents to your clipboard!