Videos captured with smartphones or other handheld cameras can include shaking due to motion of the user’s hand during capture. When such videos are transformed into 3D for rendering in a virtual reality environment, the shaking in the 2D video can cause the viewer of the VR scene to experience a roller coaster feeling where the virtual world shakes. This disclosure describes techniques to track points across multiple frames of a 2D video. When the video is transformed into 3D, a 3D coordinate is established for each pixel of the video. The tracked points are used as input to optimization techniques that determine rotation and/or translation operations to transform the coordinate system such that the 3D world is stabilized.

Creative Commons License

Creative Commons License
This work is licensed under a Creative Commons Attribution 4.0 License.