Rotoscoping is a commonly used animation technique that involves taking live action filmed material and sketching on top of it to produce an animation. Rotoscoping is expensive and time consuming, but can produce smooth, eye-catching, and realistic animation. This disclosure describes rotoscoping techniques based on generative AI. Frames of a live action source video are obtained. Each frame is passed through generative AI with hyperparameters tuned for rotoscoping. A text prompt (or other suitable prompt) that specifies the type of output is provided to the generative AI. Frames generated by generative AI are re-assembled into a rotoscoped video. The techniques reduce the cost of producing animation while improving its quality and appeal.
Creative Commons License
This work is licensed under a Creative Commons Attribution 4.0 License.
Moroney, Laurence, "Generative Artificial Intelligence for Rotoscoping", Technical Disclosure Commons, (May 16, 2023)