Spike-Timing-Dependent Plasticity With Activation-Dependent Scaling for Receptive Fields Development. 2022

Marcin Bialas, and Jacek Mandziuk

Spike-timing-dependent plasticity (STDP) is one of the most popular and deeply biologically motivated forms of unsupervised Hebbian-type learning. In this article, we propose a variant of STDP extended by an additional activation-dependent scale factor. The consequent learning rule is an efficient algorithm, which is simple to implement and applicable to spiking neural networks (SNNs). It is demonstrated that the proposed plasticity mechanism combined with competitive learning can serve as an effective mechanism for the unsupervised development of receptive fields (RFs). Furthermore, the relationship between synaptic scaling and lateral inhibition is explored in the context of the successful development of RFs. Specifically, we demonstrate that maintaining a high level of synaptic scaling followed by its rapid increase is crucial for the development of neuronal mechanisms of selectivity. The strength of the proposed solution is assessed in classification tasks performed on the Modified National Institute of Standards and Technology (MNIST) data set with an accuracy level of 94.65% (a single network) and 95.17% (a network committee)-comparable to the state-of-the-art results of single-layer SNN architectures trained in an unsupervised manner. Furthermore, the training process leads to sparse data representation and the developed RFs have the potential to serve as local feature detectors in multilayered spiking networks. We also prove theoretically that when applied to linear Poisson neurons, our rule conserves total synaptic strength, guaranteeing the convergence of the learning process.

UI MeSH Term Description Entries
D007858 Learning Relatively permanent change in behavior that is the result of past experience or practice. The concept includes the acquisition of knowledge. Phenomenography
D008959 Models, Neurological Theoretical representations that simulate the behavior or activity of the neurological system, processes or phenomena; includes the use of mathematical equations, computers, and other electronic equipment. Neurologic Models,Model, Neurological,Neurologic Model,Neurological Model,Neurological Models,Model, Neurologic,Models, Neurologic
D009473 Neuronal Plasticity The capacity of the NERVOUS SYSTEM to change its reactivity as the result of successive activations. Brain Plasticity,Plasticity, Neuronal,Axon Pruning,Axonal Pruning,Dendrite Arborization,Dendrite Pruning,Dendritic Arborization,Dendritic Pruning,Dendritic Remodeling,Neural Plasticity,Neurite Pruning,Neuronal Arborization,Neuronal Network Remodeling,Neuronal Pruning,Neuronal Remodeling,Neuroplasticity,Synaptic Plasticity,Synaptic Pruning,Arborization, Dendrite,Arborization, Dendritic,Arborization, Neuronal,Arborizations, Dendrite,Arborizations, Dendritic,Arborizations, Neuronal,Axon Prunings,Axonal Prunings,Brain Plasticities,Dendrite Arborizations,Dendrite Prunings,Dendritic Arborizations,Dendritic Prunings,Dendritic Remodelings,Network Remodeling, Neuronal,Network Remodelings, Neuronal,Neural Plasticities,Neurite Prunings,Neuronal Arborizations,Neuronal Network Remodelings,Neuronal Plasticities,Neuronal Prunings,Neuronal Remodelings,Neuroplasticities,Plasticities, Brain,Plasticities, Neural,Plasticities, Neuronal,Plasticities, Synaptic,Plasticity, Brain,Plasticity, Neural,Plasticity, Synaptic,Pruning, Axon,Pruning, Axonal,Pruning, Dendrite,Pruning, Dendritic,Pruning, Neurite,Pruning, Neuronal,Pruning, Synaptic,Prunings, Axon,Prunings, Axonal,Prunings, Dendrite,Prunings, Dendritic,Prunings, Neurite,Prunings, Neuronal,Prunings, Synaptic,Remodeling, Dendritic,Remodeling, Neuronal,Remodeling, Neuronal Network,Remodelings, Dendritic,Remodelings, Neuronal,Remodelings, Neuronal Network,Synaptic Plasticities,Synaptic Prunings
D009474 Neurons The basic cellular units of nervous tissue. Each neuron consists of a body, an axon, and dendrites. Their purpose is to receive, conduct, and transmit impulses in the NERVOUS SYSTEM. Nerve Cells,Cell, Nerve,Cells, Nerve,Nerve Cell,Neuron
D016571 Neural Networks, Computer A computer architecture, implementable in either hardware or software, modeled after biological neural networks. Like the biological system in which the processing capability is a result of the interconnection strengths between arrays of nonlinear processing nodes, computerized neural networks, often called perceptrons or multilayer connectionist models, consist of neuron-like units. A homogeneous group of units makes up a layer. These networks are good at pattern recognition. They are adaptive, performing tasks by example, and thus are better for decision-making than are linear learning machines or cluster analysis. They do not require explicit programming. Computational Neural Networks,Connectionist Models,Models, Neural Network,Neural Network Models,Neural Networks (Computer),Perceptrons,Computational Neural Network,Computer Neural Network,Computer Neural Networks,Connectionist Model,Model, Connectionist,Model, Neural Network,Models, Connectionist,Network Model, Neural,Network Models, Neural,Network, Computational Neural,Network, Computer Neural,Network, Neural (Computer),Networks, Computational Neural,Networks, Computer Neural,Networks, Neural (Computer),Neural Network (Computer),Neural Network Model,Neural Network, Computational,Neural Network, Computer,Neural Networks, Computational,Perceptron

Related Publications

Marcin Bialas, and Jacek Mandziuk
March 2008, The Journal of neuroscience : the official journal of the Society for Neuroscience,
Marcin Bialas, and Jacek Mandziuk
October 2001, Neuron,
Marcin Bialas, and Jacek Mandziuk
August 2004, Physical review. E, Statistical, nonlinear, and soft matter physics,
Marcin Bialas, and Jacek Mandziuk
May 2007, Biological cybernetics,
Marcin Bialas, and Jacek Mandziuk
January 2011, The Journal of neuroscience : the official journal of the Society for Neuroscience,
Marcin Bialas, and Jacek Mandziuk
January 2021, Frontiers in cellular neuroscience,
Marcin Bialas, and Jacek Mandziuk
June 2023, Current opinion in neurobiology,
Marcin Bialas, and Jacek Mandziuk
May 2012, Neural computation,
Marcin Bialas, and Jacek Mandziuk
June 2007, PLoS computational biology,
Copied contents to your clipboard!