Performing certain operations when viewing an application via virtual reality devices, such as VR glasses, can be cumbersome. This disclosure utilizes a mixed reality display to provide application-specific virtual overlays for a physical keyboard. User interface elements of the application currently active are identified and displayed as virtual overlays atop a physical keyboard. The overlay matches the UI elements displayed by the application icons and allows the user to activate a UI element by simply pressing a physical key. The virtual overlay provides a contextual keyboard and can be utilized for fast navigation, accessing system functions, setting up shortcuts, playing games, and other functions.

Creative Commons License

Creative Commons License
This work is licensed under a Creative Commons Attribution 4.0 License.