A Two-Layer Self-Organizing Map with Vector Symbolic Architecture for Spatiotemporal Sequence Learning and Prediction. 2024

Thimal Kempitiya, and Damminda Alahakoon, and Evgeny Osipov, and Sachin Kahawala, and Daswin De Silva
Centre for Data Analytics and Cognition, La Trobe University, Melbourne, VIC 3086, Australia.

We propose a new nature- and neuro-science-inspired algorithm for spatiotemporal learning and prediction based on sequential recall and vector symbolic architecture. A key novelty is the learning of spatial and temporal patterns as decoupled concepts where the temporal pattern sequences are constructed using the learned spatial patterns as an alphabet of elements. The decoupling, motivated by cognitive neuroscience research, provides the flexibility for fast and adaptive learning with dynamic changes to data and concept drift and as such is better suited for real-time learning and prediction. The algorithm further addresses several key computational requirements for predicting the next occurrences based on real-life spatiotemporal data, which have been found to be challenging with current state-of-the-art algorithms. Firstly, spatial and temporal patterns are detected using unsupervised learning from unlabeled data streams in changing environments; secondly, vector symbolic architecture (VSA) is used to manage variable-length sequences; and thirdly, hyper dimensional (HD) computing-based associative memory is used to facilitate the continuous prediction of the next occurrences in sequential patterns. The algorithm has been empirically evaluated using two benchmark and three time-series datasets to demonstrate its advantages compared to the state-of-the-art in spatiotemporal unsupervised sequence learning where the proposed ST-SOM algorithm is able to achieve 45% error reduction compared to HTM algorithm.

UI MeSH Term Description Entries

Related Publications

Thimal Kempitiya, and Damminda Alahakoon, and Evgeny Osipov, and Sachin Kahawala, and Daswin De Silva
June 2023, IEEE transactions on neural networks and learning systems,
Thimal Kempitiya, and Damminda Alahakoon, and Evgeny Osipov, and Sachin Kahawala, and Daswin De Silva
January 1995, IEEE transactions on neural networks,
Thimal Kempitiya, and Damminda Alahakoon, and Evgeny Osipov, and Sachin Kahawala, and Daswin De Silva
January 2017, Neural networks : the official journal of the International Neural Network Society,
Thimal Kempitiya, and Damminda Alahakoon, and Evgeny Osipov, and Sachin Kahawala, and Daswin De Silva
January 2011, Computational intelligence and neuroscience,
Thimal Kempitiya, and Damminda Alahakoon, and Evgeny Osipov, and Sachin Kahawala, and Daswin De Silva
December 2011, Toxicology in vitro : an international journal published in association with BIBRA,
Thimal Kempitiya, and Damminda Alahakoon, and Evgeny Osipov, and Sachin Kahawala, and Daswin De Silva
May 2003, Neural computation,
Thimal Kempitiya, and Damminda Alahakoon, and Evgeny Osipov, and Sachin Kahawala, and Daswin De Silva
January 2019, Frontiers in robotics and AI,
Thimal Kempitiya, and Damminda Alahakoon, and Evgeny Osipov, and Sachin Kahawala, and Daswin De Silva
January 2001, IEEE transactions on neural networks,
Thimal Kempitiya, and Damminda Alahakoon, and Evgeny Osipov, and Sachin Kahawala, and Daswin De Silva
January 2019, Computational intelligence and neuroscience,
Thimal Kempitiya, and Damminda Alahakoon, and Evgeny Osipov, and Sachin Kahawala, and Daswin De Silva
May 2014, IEEE transactions on neural networks and learning systems,
Copied contents to your clipboard!