Abstract

Linear media consumption can be a passive experience, and some interactive media formats may be limited by pre-scripted decision trees. This disclosure describes systems and methods for the generative alteration of media streams. A system can analyze a playing media program's visual, auditory, and metadata streams to build a temporal, multimodal understanding of the narrative context. When a user provides an open-ended query, such as a what-if scenario, the system can use this ingested context to interpret the request and a generative rendering engine may synthesize a new, stylistically coherent audio-visual segment reflecting the proposed alteration. This approach can allow for user-driven narrative exploration, facilitating the generation of alternative plot outcomes that are not pre-authored while seeking to maintain consistency with the original work.

Creative Commons License

Creative Commons License
This work is licensed under a Creative Commons Attribution 4.0 License.

Share

COinS