Communication between conventionally-abled and hearing-challenged individuals can pose difficulties. Although sign language partially alleviates problems, it requires an interlocutor to know sign language. Sign language varies with region of the world, and while a conventionally-abled interlocutor can learn a particular sign language, it is difficult or impractical to learn more than one sign language.

This disclosure describes an audiovisual to sign language translator. The translator captures, with user permission, speech and video of a conventionally-abled speaker and translates it in real time to a video of the speaker acting out a sign language in an emotion-preserving manner. The sign language video can be presented to the hearing-challenged person, e.g., in a picture-in-picture format, such that sign language symbolisms appear in one window, while raw video of the interlocutor appears in another. The techniques of this disclosure enable a conventionally-abled speaker to communicate with a hearing-challenged individual without needing to learn a sign language.

Creative Commons License

Creative Commons License
This work is licensed under a Creative Commons Attribution 4.0 License.