Visual-haptic cue integration with spatial and temporal disparity during pointing movements. 2011

Sascha Serwe, and Konrad P Körding, and Julia Trommershäuser
Department of Psychology, Giessen University, Otto-Behaghel-Str. 10F, 35394 Giessen, Germany. sascha.serwe@fernuni-hagen.de

Many perceptual cue combination studies have shown that humans can integrate sensory information across modalities as well as within a modality in a manner that is close to optimal. While the limits of sensory cue integration have been extensively studied in the context of perceptual decision tasks, the evidence obtained in the context of motor decisions provides a less consistent picture. Here, we studied the combination of visual and haptic information in the context of human arm movement control. We implemented a pointing task in which human subjects pointed at an invisible unknown target position whose vertical position varied randomly across trials. In each trial, we presented a haptic and a visual cue that provided noisy information about the target position half-way through the reach. We measured pointing accuracy as function of haptic and visual cue onset and compared pointing performance to the predictions of a multisensory decision model. Our model accounts for pointing performance by computing the maximum a posteriori estimate, assuming minimum variance combination of uncertain sensory cues. Synchronicity of cue onset has previously been demonstrated to facilitate the integration of sensory information. We tested this in trials in which visual and haptic information was presented with temporal disparity. We found that for our sensorimotor task temporal disparity between visual and haptic cue had no effect. Sensorimotor learning appears to use all available information and to apply the same near-optimal rules for cue combination that are used by perception.

UI MeSH Term Description Entries
D008297 Male Males
D009068 Movement The act, process, or result of passing from one place or position to another. It differs from LOCOMOTION in that locomotion is restricted to the passing of the whole body from one place to another, while movement encompasses both locomotion but also a change of the position of the whole body or any of its parts. Movement may be used with reference to humans, vertebrate and invertebrate animals, and microorganisms. Differentiate also from MOTOR ACTIVITY, movement associated with behavior. Movements
D010775 Photic Stimulation Investigative technique commonly used during ELECTROENCEPHALOGRAPHY in which a series of bright light flashes or visual patterns are used to elicit brain activity. Stimulation, Photic,Visual Stimulation,Photic Stimulations,Stimulation, Visual,Stimulations, Photic,Stimulations, Visual,Visual Stimulations
D010812 Physical Stimulation Act of eliciting a response from a person or organism through physical contact. Stimulation, Physical,Physical Stimulations,Stimulations, Physical
D011597 Psychomotor Performance The coordination of a sensory or ideational (cognitive) process and a motor activity. Perceptual Motor Performance,Sensory Motor Performance,Visual Motor Coordination,Coordination, Visual Motor,Coordinations, Visual Motor,Motor Coordination, Visual,Motor Coordinations, Visual,Motor Performance, Perceptual,Motor Performance, Sensory,Motor Performances, Perceptual,Motor Performances, Sensory,Perceptual Motor Performances,Performance, Perceptual Motor,Performance, Psychomotor,Performance, Sensory Motor,Performances, Perceptual Motor,Performances, Psychomotor,Performances, Sensory Motor,Psychomotor Performances,Sensory Motor Performances,Visual Motor Coordinations
D003463 Cues Signals for an action; that specific portion of a perceptual field or pattern of stimuli to which a subject has learned to respond. Cue
D005260 Female Females
D006801 Humans Members of the species Homo sapiens. Homo sapiens,Man (Taxonomy),Human,Man, Modern,Modern Man
D000328 Adult A person having attained full growth or maturity. Adults are of 19 through 44 years of age. For a person between 19 and 24 years of age, YOUNG ADULT is available. Adults
D013028 Space Perception The awareness of the spatial properties of objects; includes physical space. Perception, Space,Perceptions, Space,Space Perceptions

Related Publications

Sascha Serwe, and Konrad P Körding, and Julia Trommershäuser
February 2001, Vision research,
Sascha Serwe, and Konrad P Körding, and Julia Trommershäuser
January 2002, Perception,
Sascha Serwe, and Konrad P Körding, and Julia Trommershäuser
January 1994, Experimental brain research,
Sascha Serwe, and Konrad P Körding, and Julia Trommershäuser
January 2004, Perception & psychophysics,
Sascha Serwe, and Konrad P Körding, and Julia Trommershäuser
January 2017, The Behavioral and brain sciences,
Sascha Serwe, and Konrad P Körding, and Julia Trommershäuser
October 2009, Journal of neurophysiology,
Sascha Serwe, and Konrad P Körding, and Julia Trommershäuser
July 2023, Memory & cognition,
Sascha Serwe, and Konrad P Körding, and Julia Trommershäuser
January 2009, Visual neuroscience,
Sascha Serwe, and Konrad P Körding, and Julia Trommershäuser
July 2008, Perception & psychophysics,
Sascha Serwe, and Konrad P Körding, and Julia Trommershäuser
December 1993, Perceptual and motor skills,
Copied contents to your clipboard!