Perceptual weighting of binaural information: Toward an auditory perceptual "spatial codec" for auditory augmented reality

G. Christopher Stecker, Anna C. Diedesch

Research output: Chapter in Book/Report/Conference proceedingConference contribution

1 Scopus citations

Abstract

Auditory augmented reality (AR) requires accurate estimation of spatial information conveyed in the natural scene, coupled with accurate spatial synthesis of virtual sounds to be integrated within it. Solutions to both problems should consider the capabilities and limitations of the human binaural system, in order to maximize relevant over distracting acoustic information and enhance perceptual integration across AR layers. Recent studies have measured how human listeners integrate spatial information across multiple conflicting cues, revealing patterns of "perceptual weighting" that sample the auditory scene in a robust but spectrotemporally sparse manner. Such patterns can be exploited for binaural analysis and synthesis, much as time-frequency masking patterns are exploited by perceptual audio codecs, to improve efficiency and enhance perceptual integration.

Original languageEnglish (US)
Title of host publicationProceedings of the 2016 AES International Conference
Subtitle of host publicationAudio for Virtual and Augmented Reality
EditorsLinda Gedemer, Andres Mayo
PublisherAudio Engineering Society
ISBN (Electronic)9781942220107
StatePublished - 2016
Externally publishedYes
Event2016 AES International Conference on Audio for Virtual and Augmented Reality - Los Angeles, United States
Duration: Sep 30 2016Oct 1 2016

Publication series

NameProceedings of the AES International Conference
Volume2016-September

Conference

Conference2016 AES International Conference on Audio for Virtual and Augmented Reality
Country/TerritoryUnited States
CityLos Angeles
Period9/30/1610/1/16

ASJC Scopus subject areas

  • Electrical and Electronic Engineering
  • Acoustics and Ultrasonics

Fingerprint

Dive into the research topics of 'Perceptual weighting of binaural information: Toward an auditory perceptual "spatial codec" for auditory augmented reality'. Together they form a unique fingerprint.

Cite this