Sound Improves Neuronal Encoding of Visual Stimuli in Mouse Primary Visual Cortex. 2023

Aaron M Williams, and Christopher F Angeloni, and Maria N Geffen
Department of Otorhinolaryngology, University of Pennsylvania, Philadelphia, Pennsylvania, 19104.

In everyday life, we integrate visual and auditory information in routine tasks such as navigation and communication. While concurrent sound can improve visual perception, the neuronal correlates of audiovisual integration are not fully understood. Specifically, it remains unclear whether neuronal firing patters in the primary visual cortex (V1) of awake animals demonstrate similar sound-induced improvement in visual discriminability. Furthermore, presentation of sound is associated with movement in the subjects, but little is understood about whether and how sound-associated movement affects audiovisual integration in V1. Here, we investigated how sound and movement interact to modulate V1 visual responses in awake, head-fixed mice and whether this interaction improves neuronal encoding of the visual stimulus. We presented visual drifting gratings with and without simultaneous auditory white noise to awake mice while recording mouse movement and V1 neuronal activity. Sound modulated activity of 80% of light-responsive neurons, with 95% of neurons increasing activity when the auditory stimulus was present. A generalized linear model (GLM) revealed that sound and movement had distinct and complementary effects of the neuronal visual responses. Furthermore, decoding of the visual stimulus from the neuronal activity was improved with sound, an effect that persisted even when controlling for movement. These results demonstrate that sound and movement modulate visual responses in complementary ways, improving neuronal representation of the visual stimulus. This study clarifies the role of movement as a potential confound in neuronal audiovisual responses and expands our knowledge of how multimodal processing is mediated at a neuronal level in the awake brain.SIGNIFICANCE STATEMENT Sound and movement are both known to modulate visual responses in the primary visual cortex; however, sound-induced movement has largely remained unaccounted for as a potential confound in audiovisual studies in awake animals. Here, authors found that sound and movement both modulate visual responses in an important visual brain area, the primary visual cortex, in distinct, yet complementary ways. Furthermore, sound improved encoding of the visual stimulus even when accounting for movement. This study reconciles contrasting theories on the mechanism underlying audiovisual integration and asserts the primary visual cortex as a key brain region participating in tripartite sensory interactions.

UI MeSH Term Description Entries
D009068 Movement The act, process, or result of passing from one place or position to another. It differs from LOCOMOTION in that locomotion is restricted to the passing of the whole body from one place to another, while movement encompasses both locomotion but also a change of the position of the whole body or any of its parts. Movement may be used with reference to humans, vertebrate and invertebrate animals, and microorganisms. Differentiate also from MOTOR ACTIVITY, movement associated with behavior. Movements
D009474 Neurons The basic cellular units of nervous tissue. Each neuron consists of a body, an axon, and dendrites. Their purpose is to receive, conduct, and transmit impulses in the NERVOUS SYSTEM. Nerve Cells,Cell, Nerve,Cells, Nerve,Nerve Cell,Neuron
D010775 Photic Stimulation Investigative technique commonly used during ELECTROENCEPHALOGRAPHY in which a series of bright light flashes or visual patterns are used to elicit brain activity. Stimulation, Photic,Visual Stimulation,Photic Stimulations,Stimulation, Visual,Stimulations, Photic,Stimulations, Visual,Visual Stimulations
D000087642 Primary Visual Cortex An area comprised of parts of OCCIPITAL LOBE and the CALCARINE SULCUS of the visual cortex in humans with direct connectivity to the LATERAL GENICULATE NUCLEUS. It is the end organ where visual stimuli are received in the visual cortex. Area V1,Brodmann Area 17,Brodmann's Area 17,Calcarine Cortex,Cortical Area V1,Striate Cortex,Visual Cortex V1,Visual Cortex Primary,Area 17, Brodmann,Area 17, Brodmann's,Area V1, Cortical,Brodmanns Area 17,Calcarine Cortices,Cortex Primary, Visual,Cortex V1, Visual,Cortex, Calcarine,Cortex, Primary Visual,Cortex, Striate,Primary Visual Cortices,Primary, Visual Cortex,V1, Area,V1, Cortical Area,V1, Visual Cortex,Visual Cortex, Primary
D000818 Animals Unicellular or multicellular, heterotrophic organisms, that have sensation and the power of voluntary movement. Under the older five kingdom paradigm, Animalia was one of the kingdoms. Under the modern three domain model, Animalia represents one of the many groups in the domain EUKARYOTA. Animal,Metazoa,Animalia
D001303 Auditory Cortex The region of the cerebral cortex that receives the auditory radiation from the MEDIAL GENICULATE BODY. Brodmann Area 41,Brodmann Area 42,Brodmann's Area 41,Heschl Gyrus,Heschl's Gyrus,Auditory Area,Heschl's Convolutions,Heschl's Gyri,Primary Auditory Cortex,Temporal Auditory Area,Transverse Temporal Gyri,Area 41, Brodmann,Area 41, Brodmann's,Area 42, Brodmann,Area, Auditory,Area, Temporal Auditory,Auditory Areas,Auditory Cortex, Primary,Brodmanns Area 41,Cortex, Auditory,Cortex, Primary Auditory,Gyrus, Heschl,Gyrus, Heschl's,Gyrus, Transverse Temporal,Heschl Convolutions,Heschl Gyri,Heschls Convolutions,Heschls Gyri,Heschls Gyrus,Primary Auditory Cortices,Temporal Auditory Areas,Temporal Gyrus, Transverse,Transverse Temporal Gyrus
D013016 Sound A type of non-ionizing radiation in which energy is transmitted through solid, liquid, or gas as compression waves. Sound (acoustic or sonic) radiation with frequencies above the audible range is classified as ultrasonic. Sound radiation below the audible range is classified as infrasonic. Acoustic Waves,Elastic Waves,Sonic Radiation,Sound Waves,Acoustic Wave,Elastic Wave,Radiation, Sonic,Radiations, Sonic,Sonic Radiations,Sound Wave,Sounds,Wave, Acoustic,Wave, Elastic,Wave, Sound,Waves, Acoustic,Waves, Elastic,Waves, Sound
D014796 Visual Perception The selecting and organizing of visual stimuli based on the individual's past experience. Visual Processing,Perception, Visual,Processing, Visual
D051379 Mice The common name for the genus Mus. Mice, House,Mus,Mus musculus,Mice, Laboratory,Mouse,Mouse, House,Mouse, Laboratory,Mouse, Swiss,Mus domesticus,Mus musculus domesticus,Swiss Mice,House Mice,House Mouse,Laboratory Mice,Laboratory Mouse,Mice, Swiss,Swiss Mouse,domesticus, Mus musculus

Related Publications

Aaron M Williams, and Christopher F Angeloni, and Maria N Geffen
July 2015, Scientific reports,
Aaron M Williams, and Christopher F Angeloni, and Maria N Geffen
March 2023, Nature communications,
Aaron M Williams, and Christopher F Angeloni, and Maria N Geffen
May 2023, Nature communications,
Aaron M Williams, and Christopher F Angeloni, and Maria N Geffen
August 2022, Nan fang yi ke da xue xue bao = Journal of Southern Medical University,
Aaron M Williams, and Christopher F Angeloni, and Maria N Geffen
October 2018, Neuroinformatics,
Aaron M Williams, and Christopher F Angeloni, and Maria N Geffen
February 1965, Doklady Akademii nauk SSSR,
Aaron M Williams, and Christopher F Angeloni, and Maria N Geffen
February 2022, Proceedings of the National Academy of Sciences of the United States of America,
Aaron M Williams, and Christopher F Angeloni, and Maria N Geffen
September 2010, The Journal of neuroscience : the official journal of the Society for Neuroscience,
Aaron M Williams, and Christopher F Angeloni, and Maria N Geffen
December 2018, Scientific reports,
Aaron M Williams, and Christopher F Angeloni, and Maria N Geffen
January 2017, Frontiers in neural circuits,
Copied contents to your clipboard!