Automation of actions within a software application can improve user experience, e.g., by enabling repetitive complex sequences to be performed with no user effort. Such actions can include high-level operations, such as actions to be performed via the user interface (UI) of the app. Automation is typically achieved by requesting that a trusted automation service perform each of the high-level actions, including UI input in non-privileged apps running in user space, in the desired sequence on behalf of the user. This disclosure describes techniques to display appropriate UI indicators and get user consent when needed when a sequence of higher-level actions within an app is automated via a trusted automation service, such as a virtual assistant. If any action within the automated sequence of actions requires user consent, such consent is obtained via the automation service.

Creative Commons License

Creative Commons License
This work is licensed under a Creative Commons Attribution 4.0 License.