Abstract

Systems and techniques are described for dynamically generating personalized, context-aware media segments for insertion into media streams. A system can analyze user profile data in conjunction with the primary media content, such as its audio transcript and visual elements, to establish a specific context. A script generation module may then author a new script based on this context, which a multimodal synthesis model can use to create a new audiovisual segment, for instance, employing voice cloning and conditional video generation. This new segment may then be inserted into the primary media stream, such as by manipulating a streaming manifest file, potentially providing a more cohesive and relevant consumption experience.

Creative Commons License

Creative Commons License
This work is licensed under a Creative Commons Attribution 4.0 License.

Share

COinS