Reward prediction in primate basal ganglia and frontal cortex. 1998

W Schultz, and L Tremblay, and J R Hollerman
Institute of Physiology and Program in Neuroscience, University of Fribourg, Switzerland. Wolfram.Schultz@unifr.ch

Reward information is processed in a limited number of brain structures, including fronto-basal ganglia systems. Dopamine neurons respond phasically to primary rewards and reward-predicting stimuli depending on reward unpredictability but without discriminating between rewards. These responses reflect 'errors' in the prediction of rewards in correspondence to learning theories and thus may constitute teaching signals for appetitive learning. Neurons in the striatum (caudate, putamen, ventral striatum) code reward predictions in a different manner. They are activated during several seconds when animals expect predicted rewards. During learning, these activations occur initially in rewarded and unrewarded trials and become subsequently restricted to rewarded trials. This occurs in parallel with the adaptation of reward expectations by the animals, as inferred from their behavioral reactions. Neurons in orbitofrontal cortex respond differentially to stimuli predicting different liquid rewards, without coding spatial or visual features. Thus, different structures process reward information processed in different ways. Whereas dopamine neurons emit a reward teaching signal without indicating the specific reward, striatal neurons adapt expectation activity to new reward situations, and orbitofrontal neurons process the specific nature of rewards. These reward signals need to cooperate in order for reward information to be used for learning and maintaining approach behavior.

UI MeSH Term Description Entries
D011323 Primates An order of mammals consisting of more than 300 species that include LEMURS; LORISIDAE; TARSIERS; MONKEYS; and HOMINIDS. They are characterized by a relatively large brain when compared with other terrestrial mammals, forward-facing eyes, the presence of a CALCARINE SULCUS, and specialized MECHANORECEPTORS in the hands and feet which allow the perception of light touch. Primate
D002540 Cerebral Cortex The thin layer of GRAY MATTER on the surface of the CEREBRAL HEMISPHERES that develops from the TELENCEPHALON and folds into gyri and sulci. It reaches its highest development in humans and is responsible for intellectual faculties and higher mental functions. Allocortex,Archipallium,Cortex Cerebri,Cortical Plate,Paleocortex,Periallocortex,Allocortices,Archipalliums,Cerebral Cortices,Cortex Cerebrus,Cortex, Cerebral,Cortical Plates,Paleocortices,Periallocortices,Plate, Cortical
D004193 Discrimination Learning Learning that is manifested in the ability to respond differentially to various stimuli. Discriminative Learning,Discrimination Learnings,Discriminative Learnings,Learning, Discrimination,Learning, Discriminative
D005625 Frontal Lobe The part of the cerebral hemisphere anterior to the central sulcus, and anterior and superior to the lateral sulcus. Brodmann Area 8,Brodmann's Area 8,Frontal Cortex,Frontal Eye Fields,Lobus Frontalis,Supplementary Eye Field,Area 8, Brodmann,Area 8, Brodmann's,Brodmanns Area 8,Cortex, Frontal,Eye Field, Frontal,Eye Field, Supplementary,Eye Fields, Frontal,Frontal Cortices,Frontal Eye Field,Frontal Lobes,Lobe, Frontal,Supplementary Eye Fields
D006801 Humans Members of the species Homo sapiens. Homo sapiens,Man (Taxonomy),Human,Man, Modern,Modern Man
D000818 Animals Unicellular or multicellular, heterotrophic organisms, that have sensation and the power of voluntary movement. Under the older five kingdom paradigm, Animalia was one of the kingdoms. Under the modern three domain model, Animalia represents one of the many groups in the domain EUKARYOTA. Animal,Metazoa,Animalia
D001479 Basal Ganglia Large subcortical nuclear masses derived from the telencephalon and located in the basal regions of the cerebral hemispheres. Basal Nuclei,Ganglia, Basal,Basal Nuclear Complex,Ganglion, Basal,Basal Nuclear Complices,Nuclear Complex, Basal,Nuclei, Basal
D012201 Reward An object or a situation that can serve to reinforce a response, to satisfy a motive, or to afford pleasure. Rewards

Related Publications

W Schultz, and L Tremblay, and J R Hollerman
January 1996, Critical reviews in neurobiology,
W Schultz, and L Tremblay, and J R Hollerman
January 2015, Frontiers in neuroscience,
W Schultz, and L Tremblay, and J R Hollerman
April 2004, Science (New York, N.Y.),
W Schultz, and L Tremblay, and J R Hollerman
September 2002, Cerebral cortex (New York, N.Y. : 1991),
W Schultz, and L Tremblay, and J R Hollerman
April 2013, Psychological review,
W Schultz, and L Tremblay, and J R Hollerman
June 2008, Nature neuroscience,
W Schultz, and L Tremblay, and J R Hollerman
May 2015, Nature,
W Schultz, and L Tremblay, and J R Hollerman
January 2019, Frontiers in neurology,
Copied contents to your clipboard!