Fine-grained gestures such as eye gaze, facial expressions, etc., can be useful as input mechanisms for smart devices. However, single gesture inputs such as eye gaze are inefficient, and it is difficult to perform complex operations with such inputs. This disclosure describes techniques to fuse multiple head gestures, e.g., head, eye, mouth, or eyebrow movement, to provide superior user interaction. Head gestures are classified as analog (e.g., eye movements, which provide continuous input) or binary (e.g., frowns, which indicate one-time operation). An analog gesture is fused with multiple binary gestures to improve efficiency. For example, to move an object, the user selects the object by looking and frowning at it; moves the object using eye gaze; and frowns again to set it in position. Different facial expressions can be flexibly assigned to accommodate varied user abilities and preferences.

Creative Commons License

Creative Commons License
This work is licensed under a Creative Commons Attribution 4.0 License.