Performing certain operations when viewing an application via virtual reality devices, such as VR glasses, can be cumbersome. This disclosure utilizes a mixed reality display to provide application-specific virtual overlays for a physical keyboard. User interface elements of the application currently active are identified and displayed as virtual overlays atop a physical keyboard. The overlay matches the UI elements displayed by the application icons and allows the user to activate a UI element by simply pressing a physical key. The virtual overlay provides a contextual keyboard and can be utilized for fast navigation, accessing system functions, setting up shortcuts, playing games, and other functions.
Creative Commons License
This work is licensed under a Creative Commons Attribution 4.0 License.
Anonymous, "Mixed Reality Interaction With Physical Keyboard", Technical Disclosure Commons, (December 28, 2018)