Reward expectations direct learning and drive operant matching in Drosophila. 2023

Adithya E Rajagopalan, and Ran Darshan, and Karen L Hibbard, and James E Fitzgerald, and Glenn C Turner
Janelia Research Campus, HHMI, Ashburn, VA 20147.

Foraging animals must use decision-making strategies that dynamically adapt to the changing availability of rewards in the environment. A wide diversity of animals do this by distributing their choices in proportion to the rewards received from each option, Herrnstein's operant matching law. Theoretical work suggests an elegant mechanistic explanation for this ubiquitous behavior, as operant matching follows automatically from simple synaptic plasticity rules acting within behaviorally relevant neural circuits. However, no past work has mapped operant matching onto plasticity mechanisms in the brain, leaving the biological relevance of the theory unclear. Here, we discovered operant matching in Drosophila and showed that it requires synaptic plasticity that acts in the mushroom body and incorporates the expectation of reward. We began by developing a dynamic foraging paradigm to measure choices from individual flies as they learn to associate odor cues with probabilistic rewards. We then built a model of the fly mushroom body to explain each fly's sequential choice behavior using a family of biologically realistic synaptic plasticity rules. As predicted by past theoretical work, we found that synaptic plasticity rules could explain fly matching behavior by incorporating stimulus expectations, reward expectations, or both. However, by optogenetically bypassing the representation of reward expectation, we abolished matching behavior and showed that the plasticity rule must specifically incorporate reward expectations. Altogether, these results reveal the first synapse-level mechanisms of operant matching and provide compelling evidence for the role of reward expectation signals in the fly brain.

UI MeSH Term Description Entries
D007858 Learning Relatively permanent change in behavior that is the result of past experience or practice. The concept includes the acquisition of knowledge. Phenomenography
D009042 Motivation Those factors which cause an organism to behave or act in either a goal-seeking or satisfying manner. They may be influenced by physiological drives or by external stimuli. Incentives,Disincentives,Expectations,Disincentive,Expectation,Incentive,Motivations
D001921 Brain The part of CENTRAL NERVOUS SYSTEM that is contained within the skull (CRANIUM). Arising from the NEURAL TUBE, the embryonic brain is comprised of three major parts including PROSENCEPHALON (the forebrain); MESENCEPHALON (the midbrain); and RHOMBENCEPHALON (the hindbrain). The developed brain consists of CEREBRUM; CEREBELLUM; and other structures in the BRAIN STEM. Encephalon
D004330 Drosophila A genus of small, two-winged flies containing approximately 900 described species. These organisms are the most extensively studied of all genera from the standpoint of genetics and cytology. Fruit Fly, Drosophila,Drosophila Fruit Flies,Drosophila Fruit Fly,Drosophilas,Flies, Drosophila Fruit,Fly, Drosophila Fruit,Fruit Flies, Drosophila
D000818 Animals Unicellular or multicellular, heterotrophic organisms, that have sensation and the power of voluntary movement. Under the older five kingdom paradigm, Animalia was one of the kingdoms. Under the modern three domain model, Animalia represents one of the many groups in the domain EUKARYOTA. Animal,Metazoa,Animalia
D012201 Reward An object or a situation that can serve to reinforce a response, to satisfy a motive, or to afford pleasure. Rewards

Related Publications

Adithya E Rajagopalan, and Ran Darshan, and Karen L Hibbard, and James E Fitzgerald, and Glenn C Turner
July 2007, Learning & memory (Cold Spring Harbor, N.Y.),
Adithya E Rajagopalan, and Ran Darshan, and Karen L Hibbard, and James E Fitzgerald, and Glenn C Turner
May 2002, Science (New York, N.Y.),
Adithya E Rajagopalan, and Ran Darshan, and Karen L Hibbard, and James E Fitzgerald, and Glenn C Turner
December 2006, Proceedings. Biological sciences,
Adithya E Rajagopalan, and Ran Darshan, and Karen L Hibbard, and James E Fitzgerald, and Glenn C Turner
January 1997, Learning & memory (Cold Spring Harbor, N.Y.),
Adithya E Rajagopalan, and Ran Darshan, and Karen L Hibbard, and James E Fitzgerald, and Glenn C Turner
March 1983, Proceedings of the National Academy of Sciences of the United States of America,
Adithya E Rajagopalan, and Ran Darshan, and Karen L Hibbard, and James E Fitzgerald, and Glenn C Turner
January 2018, Journal of cognitive neuroscience,
Adithya E Rajagopalan, and Ran Darshan, and Karen L Hibbard, and James E Fitzgerald, and Glenn C Turner
August 2009, Die Naturwissenschaften,
Adithya E Rajagopalan, and Ran Darshan, and Karen L Hibbard, and James E Fitzgerald, and Glenn C Turner
January 2018, PloS one,
Adithya E Rajagopalan, and Ran Darshan, and Karen L Hibbard, and James E Fitzgerald, and Glenn C Turner
June 2015, Learning & memory (Cold Spring Harbor, N.Y.),
Adithya E Rajagopalan, and Ran Darshan, and Karen L Hibbard, and James E Fitzgerald, and Glenn C Turner
September 2008, Neuron,
Copied contents to your clipboard!