Bayesian spiking neurons II: learning. 2008

Sophie Deneve
Département d'Etudes Cognitives, Ecole Normale Supérieure, College de France 75005 Paris, France. sophie.deneve@ens.fr

In the companion letter in this issue ("Bayesian Spiking Neurons I: Inference"), we showed that the dynamics of spiking neurons can be interpreted as a form of Bayesian integration, accumulating evidence over time about events in the external world or the body. We proceed to develop a theory of Bayesian learning in spiking neural networks, where the neurons learn to recognize temporal dynamics of their synaptic inputs. Meanwhile, successive layers of neurons learn hierarchical causal models for the sensory input. The corresponding learning rule is local, spike-time dependent, and highly nonlinear. This approach provides a principled description of spiking and plasticity rules maximizing information transfer, while limiting the number of costly spikes, between successive layers of neurons.

UI MeSH Term Description Entries
D007858 Learning Relatively permanent change in behavior that is the result of past experience or practice. The concept includes the acquisition of knowledge. Phenomenography
D008390 Markov Chains A stochastic process such that the conditional probability distribution for a state at any future instant, given the present state, is unaffected by any additional knowledge of the past history of the system. Markov Process,Markov Chain,Chain, Markov,Chains, Markov,Markov Processes,Process, Markov,Processes, Markov
D009415 Nerve Net A meshlike structure composed of interconnecting nerve cells that are separated at the synaptic junction or joined to one another by cytoplasmic processes. In invertebrates, for example, the nerve net allows nerve impulses to spread over a wide area of the net because synapses can pass information in any direction. Neural Networks (Anatomic),Nerve Nets,Net, Nerve,Nets, Nerve,Network, Neural (Anatomic),Networks, Neural (Anatomic),Neural Network (Anatomic)
D009435 Synaptic Transmission The communication from a NEURON to a target (neuron, muscle, or secretory cell) across a SYNAPSE. In chemical synaptic transmission, the presynaptic neuron releases a NEUROTRANSMITTER that diffuses across the synaptic cleft and binds to specific synaptic receptors, activating them. The activated receptors modulate specific ion channels and/or second-messenger systems in the postsynaptic cell. In electrical synaptic transmission, electrical signals are communicated as an ionic current flow across ELECTRICAL SYNAPSES. Neural Transmission,Neurotransmission,Transmission, Neural,Transmission, Synaptic
D009473 Neuronal Plasticity The capacity of the NERVOUS SYSTEM to change its reactivity as the result of successive activations. Brain Plasticity,Plasticity, Neuronal,Axon Pruning,Axonal Pruning,Dendrite Arborization,Dendrite Pruning,Dendritic Arborization,Dendritic Pruning,Dendritic Remodeling,Neural Plasticity,Neurite Pruning,Neuronal Arborization,Neuronal Network Remodeling,Neuronal Pruning,Neuronal Remodeling,Neuroplasticity,Synaptic Plasticity,Synaptic Pruning,Arborization, Dendrite,Arborization, Dendritic,Arborization, Neuronal,Arborizations, Dendrite,Arborizations, Dendritic,Arborizations, Neuronal,Axon Prunings,Axonal Prunings,Brain Plasticities,Dendrite Arborizations,Dendrite Prunings,Dendritic Arborizations,Dendritic Prunings,Dendritic Remodelings,Network Remodeling, Neuronal,Network Remodelings, Neuronal,Neural Plasticities,Neurite Prunings,Neuronal Arborizations,Neuronal Network Remodelings,Neuronal Plasticities,Neuronal Prunings,Neuronal Remodelings,Neuroplasticities,Plasticities, Brain,Plasticities, Neural,Plasticities, Neuronal,Plasticities, Synaptic,Plasticity, Brain,Plasticity, Neural,Plasticity, Synaptic,Pruning, Axon,Pruning, Axonal,Pruning, Dendrite,Pruning, Dendritic,Pruning, Neurite,Pruning, Neuronal,Pruning, Synaptic,Prunings, Axon,Prunings, Axonal,Prunings, Dendrite,Prunings, Dendritic,Prunings, Neurite,Prunings, Neuronal,Prunings, Synaptic,Remodeling, Dendritic,Remodeling, Neuronal,Remodeling, Neuronal Network,Remodelings, Dendritic,Remodelings, Neuronal,Remodelings, Neuronal Network,Synaptic Plasticities,Synaptic Prunings
D009474 Neurons The basic cellular units of nervous tissue. Each neuron consists of a body, an axon, and dendrites. Their purpose is to receive, conduct, and transmit impulses in the NERVOUS SYSTEM. Nerve Cells,Cell, Nerve,Cells, Nerve,Nerve Cell,Neuron
D002490 Central Nervous System The main information-processing organs of the nervous system, consisting of the brain, spinal cord, and meninges. Cerebrospinal Axis,Axi, Cerebrospinal,Axis, Cerebrospinal,Central Nervous Systems,Cerebrospinal Axi,Nervous System, Central,Nervous Systems, Central,Systems, Central Nervous
D003198 Computer Simulation Computer-based representation of physical systems and phenomena such as chemical processes. Computational Modeling,Computational Modelling,Computer Models,In silico Modeling,In silico Models,In silico Simulation,Models, Computer,Computerized Models,Computer Model,Computer Simulations,Computerized Model,In silico Model,Model, Computer,Model, Computerized,Model, In silico,Modeling, Computational,Modeling, In silico,Modelling, Computational,Simulation, Computer,Simulation, In silico,Simulations, Computer
D006801 Humans Members of the species Homo sapiens. Homo sapiens,Man (Taxonomy),Human,Man, Modern,Modern Man
D000200 Action Potentials Abrupt changes in the membrane potential that sweep along the CELL MEMBRANE of excitable cells in response to excitation stimuli. Spike Potentials,Nerve Impulses,Action Potential,Impulse, Nerve,Impulses, Nerve,Nerve Impulse,Potential, Action,Potential, Spike,Potentials, Action,Potentials, Spike,Spike Potential

Related Publications

Sophie Deneve
January 2009, Frontiers in computational neuroscience,
Sophie Deneve
January 2022, Frontiers in computational neuroscience,
Sophie Deneve
April 2022, eLife,
Sophie Deneve
January 2010, Frontiers in computational neuroscience,
Sophie Deneve
January 2019, IEEE transactions on cybernetics,
Sophie Deneve
March 2009, Nature neuroscience,
Sophie Deneve
January 2015, Journal of theoretical biology,
Copied contents to your clipboard!