This disclosure describes techniques to generate an audio experience or soundscape corresponding to the visual field of a user. With user permission, objects within the feed of a head-mounted camera are semantically identified using computer vision techniques. Based on the detected objects, a unique audio experience, shaped by the world around a user and by the physical items they engage with, is generated.
Creative Commons License
This work is licensed under a Creative Commons Attribution 4.0 License.
Nattinger, Elly; Oktem, Meltem; and Lee, Isabel, "Synesthetic Soundtrack", Technical Disclosure Commons, (May 29, 2020)