Audio input and output is used in a wide variety of mobile applications that provide a visual user interface that enables users to provide input. Visual UI often includes a number of elements that may be difficult to discover or not immediately available to the user at a time when the user needs them.

This disclosure describes the use of a lightweight hotword detector to make relevant app UI elements easily distinguishable and discoverable at opportune times during voice calls and other interaction in which user-provided audio is available. User-facing visual UI elements within each app are tagged and associated with hotwords. When a hotword is detected in user-provided audio, the corresponding app is notified and can visually enhance the UI element associated with the hotword. Implementation of the described techniques can improve user experience by facilitating quick discovery and use of contextually relevant functions.

Creative Commons License

Creative Commons License
This work is licensed under a Creative Commons Attribution 4.0 License.