Biomaterial Database

Reinforcement learning in populations of spiking neurons. 2009

Robert Urbanczik, and Walter Senn

Department of Physiology, University of Bern, Bühlplatz 5, CH-3012 Bern, Switzerland.

Population coding is widely regarded as an important mechanism for achieving reliable behavioral responses despite neuronal variability. However, standard reinforcement learning slows down with increasing population size, as the global reward signal becomes less and less related to the performance of any single neuron. We found that learning speeds up with increasing population size if, in addition to global reward, feedback about the population response modulates synaptic plasticity.

UI	MeSH Term	Description	Entries
D007858	Learning	Relatively permanent change in behavior that is the result of past experience or practice. The concept includes the acquisition of knowledge.	Phenomenography
D008959	Models, Neurological	Theoretical representations that simulate the behavior or activity of the neurological system, processes or phenomena; includes the use of mathematical equations, computers, and other electronic equipment.	Neurologic Models,Model, Neurological,Neurologic Model,Neurological Model,Neurological Models,Model, Neurologic,Models, Neurologic
D009473	Neuronal Plasticity	The capacity of the NERVOUS SYSTEM to change its reactivity as the result of successive activations.	Brain Plasticity,Plasticity, Neuronal,Axon Pruning,Axonal Pruning,Dendrite Arborization,Dendrite Pruning,Dendritic Arborization,Dendritic Pruning,Dendritic Remodeling,Neural Plasticity,Neurite Pruning,Neuronal Arborization,Neuronal Network Remodeling,Neuronal Pruning,Neuronal Remodeling,Neuroplasticity,Synaptic Plasticity,Synaptic Pruning,Arborization, Dendrite,Arborization, Dendritic,Arborization, Neuronal,Arborizations, Dendrite,Arborizations, Dendritic,Arborizations, Neuronal,Axon Prunings,Axonal Prunings,Brain Plasticities,Dendrite Arborizations,Dendrite Prunings,Dendritic Arborizations,Dendritic Prunings,Dendritic Remodelings,Network Remodeling, Neuronal,Network Remodelings, Neuronal,Neural Plasticities,Neurite Prunings,Neuronal Arborizations,Neuronal Network Remodelings,Neuronal Plasticities,Neuronal Prunings,Neuronal Remodelings,Neuroplasticities,Plasticities, Brain,Plasticities, Neural,Plasticities, Neuronal,Plasticities, Synaptic,Plasticity, Brain,Plasticity, Neural,Plasticity, Synaptic,Pruning, Axon,Pruning, Axonal,Pruning, Dendrite,Pruning, Dendritic,Pruning, Neurite,Pruning, Neuronal,Pruning, Synaptic,Prunings, Axon,Prunings, Axonal,Prunings, Dendrite,Prunings, Dendritic,Prunings, Neurite,Prunings, Neuronal,Prunings, Synaptic,Remodeling, Dendritic,Remodeling, Neuronal,Remodeling, Neuronal Network,Remodelings, Dendritic,Remodelings, Neuronal,Remodelings, Neuronal Network,Synaptic Plasticities,Synaptic Prunings
D009474	Neurons	The basic cellular units of nervous tissue. Each neuron consists of a body, an axon, and dendrites. Their purpose is to receive, conduct, and transmit impulses in the NERVOUS SYSTEM.	Nerve Cells,Cell, Nerve,Cells, Nerve,Nerve Cell,Neuron
D012054	Reinforcement, Psychology	The strengthening of a conditioned response.	Negative Reinforcement,Positive Reinforcement,Psychological Reinforcement,Reinforcement (Psychology),Negative Reinforcements,Positive Reinforcements,Psychological Reinforcements,Psychology Reinforcement,Psychology Reinforcements,Reinforcement, Negative,Reinforcement, Positive,Reinforcement, Psychological,Reinforcements (Psychology),Reinforcements, Negative,Reinforcements, Positive,Reinforcements, Psychological,Reinforcements, Psychology
D000200	Action Potentials	Abrupt changes in the membrane potential that sweep along the CELL MEMBRANE of excitable cells in response to excitation stimuli.	Spike Potentials,Nerve Impulses,Action Potential,Impulse, Nerve,Impulses, Nerve,Nerve Impulse,Potential, Action,Potential, Spike,Potentials, Action,Potentials, Spike,Spike Potential