Visual performances often include audio portions, including spoken words. The verbal content can be difficult to hear or otherwise understand for individuals that have hearing impairments or are not fluent in the language of the verbal content. This disclosure provides a solutions to make verbal content of visual performances accessible to audience members. The described assistive techniques utilize a smartphone to present to audience members, closed captions or American Sign Language (ASL) interpreters of the verbal content portion, simultaneously as the audience members view the performance. The translation can be presented as an overlay with a view of the performance (AR), as an overlay on a projected image of the performance, (VR), or on a display screen of the smartphone (side-channel).

Creative Commons License

Creative Commons License
This work is licensed under a Creative Commons Attribution 4.0 License.