Short-term memory in orthogonal neural networks. 2004

Olivia L White, and Daniel D Lee, and Haim Sompolinsky
Harvard University, Cambridge, Massachusetts 02138, USA.

We study the ability of linear recurrent networks obeying discrete time dynamics to store long temporal sequences that are retrievable from the instantaneous state of the network. We calculate this temporal memory capacity for both distributed shift register and random orthogonal connectivity matrices. We show that the memory capacity of these networks scales with system size.

UI MeSH Term Description Entries
D008570 Memory, Short-Term Remembrance of information for a few seconds to hours. Immediate Recall,Memory, Immediate,Working Memory,Memory, Shortterm,Immediate Memories,Immediate Memory,Immediate Recalls,Memories, Immediate,Memories, Short-Term,Memories, Shortterm,Memory, Short Term,Recall, Immediate,Recalls, Immediate,Short-Term Memories,Short-Term Memory,Shortterm Memories,Shortterm Memory,Working Memories
D008959 Models, Neurological Theoretical representations that simulate the behavior or activity of the neurological system, processes or phenomena; includes the use of mathematical equations, computers, and other electronic equipment. Neurologic Models,Model, Neurological,Neurologic Model,Neurological Model,Neurological Models,Model, Neurologic,Models, Neurologic
D009474 Neurons The basic cellular units of nervous tissue. Each neuron consists of a body, an axon, and dendrites. Their purpose is to receive, conduct, and transmit impulses in the NERVOUS SYSTEM. Nerve Cells,Cell, Nerve,Cells, Nerve,Nerve Cell,Neuron
D016571 Neural Networks, Computer A computer architecture, implementable in either hardware or software, modeled after biological neural networks. Like the biological system in which the processing capability is a result of the interconnection strengths between arrays of nonlinear processing nodes, computerized neural networks, often called perceptrons or multilayer connectionist models, consist of neuron-like units. A homogeneous group of units makes up a layer. These networks are good at pattern recognition. They are adaptive, performing tasks by example, and thus are better for decision-making than are linear learning machines or cluster analysis. They do not require explicit programming. Computational Neural Networks,Connectionist Models,Models, Neural Network,Neural Network Models,Neural Networks (Computer),Perceptrons,Computational Neural Network,Computer Neural Network,Computer Neural Networks,Connectionist Model,Model, Connectionist,Model, Neural Network,Models, Connectionist,Network Model, Neural,Network Models, Neural,Network, Computational Neural,Network, Computer Neural,Network, Neural (Computer),Networks, Computational Neural,Networks, Computer Neural,Networks, Neural (Computer),Neural Network (Computer),Neural Network Model,Neural Network, Computational,Neural Network, Computer,Neural Networks, Computational,Perceptron

Related Publications

Olivia L White, and Daniel D Lee, and Haim Sompolinsky
December 2021, Current genomics,
Olivia L White, and Daniel D Lee, and Haim Sompolinsky
January 2016, PloS one,
Olivia L White, and Daniel D Lee, and Haim Sompolinsky
April 2022, Cognitive neurodynamics,
Olivia L White, and Daniel D Lee, and Haim Sompolinsky
April 2021, IEEE transactions on pattern analysis and machine intelligence,
Olivia L White, and Daniel D Lee, and Haim Sompolinsky
January 2020, Frontiers in bioengineering and biotechnology,
Olivia L White, and Daniel D Lee, and Haim Sompolinsky
November 2010, Journal of cognitive neuroscience,
Olivia L White, and Daniel D Lee, and Haim Sompolinsky
December 2022, IEEE journal of biomedical and health informatics,
Olivia L White, and Daniel D Lee, and Haim Sompolinsky
April 2019, Journal of chemical information and modeling,
Olivia L White, and Daniel D Lee, and Haim Sompolinsky
January 2020, IEEE/ACM transactions on computational biology and bioinformatics,
Olivia L White, and Daniel D Lee, and Haim Sompolinsky
September 2022, Computers in biology and medicine,
Copied contents to your clipboard!