Accumulation and decay of visual capture and the ventriloquism aftereffect caused by brief audio-visual disparities

Adam K. Bosen, Justin T. Fleming, Paul D. Allen, William E. O‘Neill, Gary D. Paige

Research output: Contribution to journalArticlepeer-review

25 Scopus citations

Abstract

Visual capture and the ventriloquism aftereffect resolve spatial disparities of incongruent auditory visual (AV) objects by shifting auditory spatial perception to align with vision. Here, we demonstrated the distinct temporal characteristics of visual capture and the ventriloquism aftereffect in response to brief AV disparities. In a set of experiments, subjects localized either the auditory component of AV targets (A within AV) or a second sound presented at varying delays (1–20 s) after AV exposure (A2 after AV). AV targets were trains of brief presentations (1 or 20), covering a ±30° azimuthal range, and with ±8° (R or L) disparity. We found that the magnitude of visual capture generally reached its peak within a single AV pair and did not dissipate with time, while the ventriloquism aftereffect accumulated with repetitions of AV pairs and dissipated with time. Additionally, the magnitude of the auditory shift induced by each phenomenon was uncorrelated across listeners and visual capture was unaffected by subsequent auditory targets, indicating that visual capture and the ventriloquism aftereffect are separate mechanisms with distinct effects on auditory spatial perception. Our results indicate that visual capture is a ‘sample-and-hold’ process that binds related objects and stores the combined percept in memory, whereas the ventriloquism aftereffect is a ‘leaky integrator’ process that accumulates with experience and decays with time to compensate for cross-modal disparities.

Original languageEnglish (US)
Pages (from-to)585-595
Number of pages11
JournalExperimental Brain Research
Volume235
Issue number2
DOIs
StatePublished - Feb 1 2017
Externally publishedYes

Keywords

  • Auditory
  • Cross-modal
  • Ventriloquism
  • Ventriloquism aftereffect
  • Visual
  • Visual capture

ASJC Scopus subject areas

  • General Neuroscience

Fingerprint

Dive into the research topics of 'Accumulation and decay of visual capture and the ventriloquism aftereffect caused by brief audio-visual disparities'. Together they form a unique fingerprint.

Cite this