Abstract

A system and a method are disclosed to electronically assist a visually impaired user. The system includes an augmented reality computing platform hardware, text to speech APIs, a camera and a bot-like assistant. The system is configured to understand user’s voice request, determine device orientation, determine the user’s direction of focus, and identify context of the request. Based on context of the request, the system retrieves information and sends voice feedback to assist the visually impaired person. The system may use a machine learning approach to assist the users. The assistant device for the visually impaired provides assistance with only voice input from the user and enables them to live more independently.

Creative Commons License

Creative Commons License
This work is licensed under a Creative Commons Attribution 4.0 License.

Share

COinS