Abstract
This disclosure describes augmented reality (AR) techniques that spatially track audio signals to enable AR interactivity based on audio and on the relationship of the objects that the audio is attached to. An AR object responds interactively based on the properties and the classification of spatially-tracked audio as well as the intent and sentiment inferred from the audio. Spatially separated microphones are leveraged to localize sounds to objects. Alternatively, video object detection is combined with audio processing to localize sounds to objects. AR objects are tagged with spatial audio classification information as they move such that audio information of the object can be used for natural interactions in the scene.
Creative Commons License
This work is licensed under a Creative Commons Attribution 4.0 License.
Recommended Citation
Allen, Corville and Lavery, Andy, "Enriching Audio Signals in Augmented Reality with Spatial Attributes of Sound", Technical Disclosure Commons, (July 05, 2022)
https://www.tdcommons.org/dpubs_series/5240