The effects of stereo disparity on the behavioural and electrophysiological correlates of audio-visual motion in depth.

Harrison, Neil and Witheridge, Sian and Makin, Alexis and Pegna, Alan and Wuerger, Sophie M. and Meyer, Georg (2015) The effects of stereo disparity on the behavioural and electrophysiological correlates of audio-visual motion in depth. Neuropsychologia, 78. pp. 51-62. ISSN 0028-3932

[thumbnail of Harrison_2015 (1).pdf]
Preview
Text
Harrison_2015 (1).pdf

Download (1MB) | Preview

Abstract

Motion is represented by low-level signals, such as size-expansion in vision or loudness changes in the auditory modality. The visual and auditory signals from the same object or event may be integrated and facilitate detection. We explored behavioural and electrophysiological correlates of congruent and incongruent audio-visual depth motion in conditions where auditory level changes, visual expansion, and visual disparity cues were manipulated. In Experiment 1 participants discriminated auditory motion direction whilst viewing looming or receding, 2D or 3D, visual stimuli. Responses were faster and more accurate for congruent than for incongruent audio-visual cues, and the congruency effect (i.e., difference between incongruent and congruent conditions) was larger for visual 3D cues compared to 2D cues. In Experiment 2, event-related potentials (ERPs) were collected during presentation of the 2D and 3D, looming and receding, audio-visual stimuli, while participants detected an infrequent deviant sound. Our main finding was that audio-visual congruity was affected by retinal disparity at an early processing stage (135 – 160 ms) over occipito-parietal scalp. Topographic analyses suggested that similar brain networks were activated for the 2D and 3D congruity effects, but that cortical responses were stronger in the 3D condition. Differences between congruent and incongruent conditions were observed between 140 – 200 ms, 220 – 280 ms, and 350 – 500 ms after stimulus onset.

Item Type: Article
Additional Information and Comments: “NOTICE: this is the author’s version of a work that was accepted for publication in Neuropsychologia. Changes resulting from the publishing process, such as peer review, editing, corrections, structural formatting, and other quality control mechanisms may not be reflected in this document. Changes may have been made to this work since it was submitted for publication. A definitive version was subsequently published in Neuropsychologia, Vol. 78, November 2015, p.51-62. DOI: 10.1016/j.neuropsychologia.2015.09.023¨
Faculty / Department: Faculty of Human and Digital Sciences > School of Psychology
Depositing User: Pauline Bray
Date Deposited: 04 Feb 2016 08:53
Last Modified: 18 Sep 2016 00:15
URI: https://hira.hope.ac.uk/id/eprint/643

Actions (login required)

View Item View Item