Continuous Timescale Long-Short Term Memory Neural Network for Human Intent Understanding. 2017

Zhibin Yu, and Dennis S Moirangthem, and Minho Lee
Department of Electrical Engineering, College of Information Science and Engineering, Ocean University of ChinaQingdao, China.

Understanding of human intention by observing a series of human actions has been a challenging task. In order to do so, we need to analyze longer sequences of human actions related with intentions and extract the context from the dynamic features. The multiple timescales recurrent neural network (MTRNN) model, which is believed to be a kind of solution, is a useful tool for recording and regenerating a continuous signal for dynamic tasks. However, the conventional MTRNN suffers from the vanishing gradient problem which renders it impossible to be used for longer sequence understanding. To address this problem, we propose a new model named Continuous Timescale Long-Short Term Memory (CTLSTM) in which we inherit the multiple timescales concept into the Long-Short Term Memory (LSTM) recurrent neural network (RNN) that addresses the vanishing gradient problem. We design an additional recurrent connection in the LSTM cell outputs to produce a time-delay in order to capture the slow context. Our experiments show that the proposed model exhibits better context modeling ability and captures the dynamic features on multiple large dataset classification tasks. The results illustrate that the multiple timescales concept enhances the ability of our model to handle longer sequences related with human intentions and hence proving to be more suitable for complex tasks, such as intention recognition.

UI MeSH Term Description Entries

Related Publications

Zhibin Yu, and Dennis S Moirangthem, and Minho Lee
February 2021, International journal of clinical pharmacology and therapeutics,
Zhibin Yu, and Dennis S Moirangthem, and Minho Lee
October 2021, Journal of neuroengineering and rehabilitation,
Zhibin Yu, and Dennis S Moirangthem, and Minho Lee
April 2021, Scientific reports,
Zhibin Yu, and Dennis S Moirangthem, and Minho Lee
December 2021, The Journal of chemical physics,
Zhibin Yu, and Dennis S Moirangthem, and Minho Lee
May 2019, Chemosphere,
Zhibin Yu, and Dennis S Moirangthem, and Minho Lee
July 2022, Optics letters,
Zhibin Yu, and Dennis S Moirangthem, and Minho Lee
October 2021, Scientific reports,
Zhibin Yu, and Dennis S Moirangthem, and Minho Lee
April 2019, Chemosphere,
Zhibin Yu, and Dennis S Moirangthem, and Minho Lee
June 2012, IEEE transactions on neural networks and learning systems,
Copied contents to your clipboard!