Abstract
Interacting with a digital surface currently relies on a device with a touchscreen, where digital objects are displayed and can be manipulated via gestures. Augmented reality wearable devices can display virtual objects together with the real world. This disclosure describes the use of augmented reality wearable devices to turn everyday physical objects into projection surfaces onto which user interfaces are displayed for user interaction. Per the techniques, bounding boxes are determined for real-world objects and used to map objects to UI features of one or more apps. Upon user activation of projection, the selected app UI is projected onto the mapped surfaces. Voice commands and/or gestures from the user are detected and used to perform actions within the app. By virtually projecting the UI of apps on physical objects, the described techniques enable users to privately use apps while wearing AR glasses.
Creative Commons License
This work is licensed under a Creative Commons Attribution 4.0 License.
Recommended Citation
Babu, Manasa; Sedouram, Ramprasad; Barve, Sanika; and Brahmavar Pattanshet, Puneetha Pai, "Augmented Reality Projected Interfaces on Real-World Objects via Wearable Devices", Technical Disclosure Commons, (May 20, 2025)
https://www.tdcommons.org/dpubs_series/8140