Abstract
Linear media consumption can be a passive experience, and some interactive media formats may be limited by pre-scripted decision trees. This disclosure describes systems and methods for the generative alteration of media streams. A system can analyze a playing media program's visual, auditory, and metadata streams to build a temporal, multimodal understanding of the narrative context. When a user provides an open-ended query, such as a what-if scenario, the system can use this ingested context to interpret the request and a generative rendering engine may synthesize a new, stylistically coherent audio-visual segment reflecting the proposed alteration. This approach can allow for user-driven narrative exploration, facilitating the generation of alternative plot outcomes that are not pre-authored while seeking to maintain consistency with the original work.
Creative Commons License

This work is licensed under a Creative Commons Attribution 4.0 License.
Recommended Citation
Rajotiya, Harsh and Verma, Akash, "Generative Alteration of Linear Media Streams via Multimodal Context Analysis", Technical Disclosure Commons, ()
https://www.tdcommons.org/dpubs_series/11335