Multimodal motion processing in area V5/MT: evidence from an artificial class of audio-visual events. 2009

Lukas Scheef, and Henning Boecker, and Marcel Daamen, and Ursula Fehse, and Martin W Landsberg, and Dirk-Oliver Granath, and Heinz Mechling, and Alfred O Effenberg
Department of Radiology, University of Bonn, Germany. Lukas.Scheef@ukb.uni-bonn.de

Audio-visual integration in the human brain influences perception and precision of motor tasks. We tested audio-visual integration during height estimation when presenting video clips of counter movement jumps (CMJ), using sparse sampling fMRI at 3T. Employing the technique of "sonification", we created artificial auditory-visual motion events by transforming the ground reaction force of the CMJs into the auditory domain, modulating frequency and amplitude of the standard pitch "A" (440 Hz). We combined these "sonificated" movements with either concordant or discordant visual movement displays. We hypothesized that processing of concordant audio-visual stimuli would enhance neural activity in audio-visual integration areas. Therefore, four conditions were compared: 1. unimodal visual, 2. unimodal auditory, 3. auditory+visual concordant, and 4. auditory+visual discordant. The unimodal conditions, when compared against each other, resulted in expected activation maxima in primary visual and auditory cortex, respectively. Enhanced activation was found in area V5/MT bilaterally for the concordant multimodal, as compared to both unimodal, conditions. This effect was specific for the concordant bimodal condition, as evidenced by a direct comparison between concordant and discordant bimodal conditions. Using "sonification", we provide evidence that area V5/MT is modulated by concordant auditory input, albeit the artificial nature of the stimuli, which argues for a role of this region in multimodal motion integration, beyond the pure visual domain. This may explain previous behavioral evidence of facilitatory effects exerted by auditory motion stimuli on the perception of visual motion, and may provide the basis for future applications in motor learning and rehabilitation.

UI MeSH Term Description Entries
D008279 Magnetic Resonance Imaging Non-invasive method of demonstrating internal anatomy based on the principle that atomic nuclei in a strong magnetic field absorb pulses of radiofrequency energy and emit them as radiowaves which can be reconstructed into computerized images. The concept includes proton spin tomographic techniques. Chemical Shift Imaging,MR Tomography,MRI Scans,MRI, Functional,Magnetic Resonance Image,Magnetic Resonance Imaging, Functional,Magnetization Transfer Contrast Imaging,NMR Imaging,NMR Tomography,Tomography, NMR,Tomography, Proton Spin,fMRI,Functional Magnetic Resonance Imaging,Imaging, Chemical Shift,Proton Spin Tomography,Spin Echo Imaging,Steady-State Free Precession MRI,Tomography, MR,Zeugmatography,Chemical Shift Imagings,Echo Imaging, Spin,Echo Imagings, Spin,Functional MRI,Functional MRIs,Image, Magnetic Resonance,Imaging, Magnetic Resonance,Imaging, NMR,Imaging, Spin Echo,Imagings, Chemical Shift,Imagings, Spin Echo,MRI Scan,MRIs, Functional,Magnetic Resonance Images,Resonance Image, Magnetic,Scan, MRI,Scans, MRI,Shift Imaging, Chemical,Shift Imagings, Chemical,Spin Echo Imagings,Steady State Free Precession MRI
D008297 Male Males
D009039 Motion Perception The real or apparent movement of objects through the visual field. Movement Perception,Perception, Motion,Perception, Movement
D009778 Occipital Lobe Posterior portion of the CEREBRAL HEMISPHERES responsible for processing visual sensory information. It is located posterior to the parieto-occipital sulcus and extends to the preoccipital notch. Annectant Gyrus,Calcarine Fissure,Calcarine Sulcus,Cuneate Lobule,Cuneus,Cuneus Cortex,Cuneus Gyrus,Gyrus Lingualis,Lingual Gyrus,Lunate Sulcus,Medial Occipitotemporal Gyrus,Occipital Cortex,Occipital Gyrus,Occipital Region,Occipital Sulcus,Sulcus Calcarinus,Calcarine Fissures,Calcarinus, Sulcus,Cortex, Cuneus,Cortex, Occipital,Cortices, Cuneus,Cortices, Occipital,Cuneate Lobules,Cuneus Cortices,Fissure, Calcarine,Fissures, Calcarine,Gyrus Linguali,Gyrus, Annectant,Gyrus, Cuneus,Gyrus, Lingual,Gyrus, Medial Occipitotemporal,Gyrus, Occipital,Linguali, Gyrus,Lingualis, Gyrus,Lobe, Occipital,Lobes, Occipital,Lobule, Cuneate,Lobules, Cuneate,Occipital Cortices,Occipital Lobes,Occipital Regions,Occipitotemporal Gyrus, Medial,Region, Occipital,Regions, Occipital,Sulcus, Calcarine,Sulcus, Lunate,Sulcus, Occipital
D001921 Brain The part of CENTRAL NERVOUS SYSTEM that is contained within the skull (CRANIUM). Arising from the NEURAL TUBE, the embryonic brain is comprised of three major parts including PROSENCEPHALON (the forebrain); MESENCEPHALON (the midbrain); and RHOMBENCEPHALON (the hindbrain). The developed brain consists of CEREBRUM; CEREBELLUM; and other structures in the BRAIN STEM. Encephalon
D001931 Brain Mapping Imaging techniques used to colocalize sites of brain functions or physiological activity with brain structures. Brain Electrical Activity Mapping,Functional Cerebral Localization,Topographic Brain Mapping,Brain Mapping, Topographic,Functional Cerebral Localizations,Mapping, Brain,Mapping, Topographic Brain
D005260 Female Females
D006801 Humans Members of the species Homo sapiens. Homo sapiens,Man (Taxonomy),Human,Man, Modern,Modern Man
D000328 Adult A person having attained full growth or maturity. Adults are of 19 through 44 years of age. For a person between 19 and 24 years of age, YOUNG ADULT is available. Adults
D001307 Auditory Perception The process whereby auditory stimuli are selected, organized, and interpreted by the organism. Auditory Processing,Perception, Auditory,Processing, Auditory

Related Publications

Lukas Scheef, and Henning Boecker, and Marcel Daamen, and Ursula Fehse, and Martin W Landsberg, and Dirk-Oliver Granath, and Heinz Mechling, and Alfred O Effenberg
January 2004, Ceskoslovenska fysiologie,
Lukas Scheef, and Henning Boecker, and Marcel Daamen, and Ursula Fehse, and Martin W Landsberg, and Dirk-Oliver Granath, and Heinz Mechling, and Alfred O Effenberg
May 2008, The Journal of neuroscience : the official journal of the Society for Neuroscience,
Lukas Scheef, and Henning Boecker, and Marcel Daamen, and Ursula Fehse, and Martin W Landsberg, and Dirk-Oliver Granath, and Heinz Mechling, and Alfred O Effenberg
February 2001, Brain research,
Lukas Scheef, and Henning Boecker, and Marcel Daamen, and Ursula Fehse, and Martin W Landsberg, and Dirk-Oliver Granath, and Heinz Mechling, and Alfred O Effenberg
October 2002, NeuroImage,
Lukas Scheef, and Henning Boecker, and Marcel Daamen, and Ursula Fehse, and Martin W Landsberg, and Dirk-Oliver Granath, and Heinz Mechling, and Alfred O Effenberg
January 2015, Brain : a journal of neurology,
Lukas Scheef, and Henning Boecker, and Marcel Daamen, and Ursula Fehse, and Martin W Landsberg, and Dirk-Oliver Granath, and Heinz Mechling, and Alfred O Effenberg
June 2002, Brain research. Cognitive brain research,
Lukas Scheef, and Henning Boecker, and Marcel Daamen, and Ursula Fehse, and Martin W Landsberg, and Dirk-Oliver Granath, and Heinz Mechling, and Alfred O Effenberg
December 2001, Vision research,
Lukas Scheef, and Henning Boecker, and Marcel Daamen, and Ursula Fehse, and Martin W Landsberg, and Dirk-Oliver Granath, and Heinz Mechling, and Alfred O Effenberg
December 2006, Cerebral cortex (New York, N.Y. : 1991),
Lukas Scheef, and Henning Boecker, and Marcel Daamen, and Ursula Fehse, and Martin W Landsberg, and Dirk-Oliver Granath, and Heinz Mechling, and Alfred O Effenberg
June 2014, NeuroImage,
Lukas Scheef, and Henning Boecker, and Marcel Daamen, and Ursula Fehse, and Martin W Landsberg, and Dirk-Oliver Granath, and Heinz Mechling, and Alfred O Effenberg
November 2023, The Journal of neuroscience : the official journal of the Society for Neuroscience,
Copied contents to your clipboard!