Smart assistants utilize speech recognition, sensing, artificial intelligence, and networking technologies to enable improved human-machine interaction. However, there remain use cases where smart assistants are not easily usable by humans. For example, voice-activated assistants are not accessible to those that are hearing or speech impaired. Touchscreen based assistants are not usable by those who lack fine motor skills and/or reading ability.

This disclosure adds to the modalities by which humans can control and communicate with smart assistants by enabling use of physical objects, facial expressions, gross motor skills, body movements, etc. to provide commands. Collectively, these techniques of control and communication are referred to as alternative and augmentative communication (AAC).

Creative Commons License

Creative Commons License
This work is licensed under a Creative Commons Attribution 4.0 License.