Augmented reality (AR) technology today doesn’t incorporate sound, nor does it enable the interactivity of AR objects with Internet-of-Things (IoT) devices. This results in user experiences that are less engaging than would be possible with accurate sound or IoT device interactions. This disclosure describes techniques that enable information from IoT devices to be classified along multiple dimensions. Such information can be used to obtain classifications to trigger an action in AR or physical space. In an AR scene, the action can be taken by a virtual object such as a virtual or AR assistant. In a physical scene, the action can be taken by, e.g., a physical robot or assistant. Physical and/or digital signals generated by IoT devices are used to trigger actions by virtual or physical objects.

Creative Commons License

Creative Commons License
This work is licensed under a Creative Commons Attribution 4.0 License.