Abstract
Users of smartphones, tablets, and other devices often perform multi-step tasks involving transfer of key pieces of information from one application to another. The tedium of such routine, information-seeking tasks can create friction. This disclosure describes techniques that automate the multiple steps typically required to retrieve a piece of information, unifying into a single user interaction, steps such as copying data from one app, determining a second relevant app to transition to, navigating to the second app, pasting the data into the second app, retrieving results, etc. The multiple, repetitive steps habitually performed by a user can be automated by using machine learning, by arriving at a semantic understanding of the steps, etc. Automation scripts can be triggered based on automatic entity recognition, user input highlighting an entity, user voice input, or via operating system affordances.
Creative Commons License
This work is licensed under a Creative Commons Attribution 4.0 License.
Recommended Citation
Kuang, Cliff; Andreica, Mugurel-Ionut; Oh, Michael; and Coimbra, Adam, "Suggesting and Executing Automation Scripts in Response to User Actions", Technical Disclosure Commons, (February 14, 2023)
https://www.tdcommons.org/dpubs_series/5679