Statistics of natural reverberation enable perceptual separation of sound and space

TitleStatistics of natural reverberation enable perceptual separation of sound and space
Publication TypeJournal Article
Year of Publication2016
AuthorsTraer, J, McDermott, JH
JournalProceedings of the National Academy of Sciences
Volume113
Issue48
PaginationE7856 - E7865
Date Published09/2016
ISSN0027-8424
Keywordsauditory scene analysis, environmental acoustics, natural scene statistics, psychoacoustics, Psychophysics
Abstract

In everyday listening, sound reaches our ears directly from a source as well as indirectly via reflections known as reverberation. Reverberation profoundly distorts the sound from a source, yet humans can both identify sound sources and distinguish environments from the resulting sound, via mechanisms that remain unclear. The core computational challenge is that the acoustic signatures of the source and environment are combined in a single signal received by the ear. Here we ask whether our recognition of sound sources and spaces reflects an ability to separate their effects and whether any such separation is enabled by statistical regularities of real-world reverberation. To first determine whether such statistical regularities exist, we measured impulse responses (IRs) of 271 spaces sampled from the distribution encountered by humans during daily life. The sampled spaces were diverse, but their IRs were tightly constrained, exhibiting exponential decay at frequency-dependent rates: Mid frequencies reverberated longest whereas higher and lower frequencies decayed more rapidly, presumably due to absorptive properties of materials and air. To test whether humans leverage these regularities, we manipulated IR decay characteristics in simulated reverberant audio. Listeners could discriminate sound sources and environments from these signals, but their abilities degraded when reverberation characteristics deviated from those of real-world environments. Subjectively, atypical IRs were mistaken for sound sources. The results suggest the brain separates sound into contributions from the source and the environment, constrained by a prior on natural reverberation. This separation process may contribute to robust recognition while providing information about spaces around us.

URLhttp://www.pnas.org/lookup/doi/10.1073/pnas.1612524113
DOI10.1073/pnas.1612524113
Short TitleProc Natl Acad Sci USA

Research Area: 

CBMM Relationship: 

  • CBMM Funded