Abstract
In Mixed Reality (MR) environments, interacting with virtual objects using bare hands often breaks the immersive illusion because the user’s hands can pass through virtual objects without visual consequence. This effect disrupts the user’s sense of realism and makes it difficult to perform precise interactions. Without haptic feedback or visual cues, it is difficult to accurately grasp or press virtual objects. Existing solutions rely on cumbersome hardware like haptic gloves or apply virtual shadows that offer only depth cues without conveying physical resistance. This disclosure describes a software to configure an MR system to visually simulate physical contact between the user’s hand and a virtual object with real-time visual effects. These visual effects can include skin deformation, color changes (blanching), and microscopic visual vibrations. These added effects can create a compelling illusion of physical resistance, texture, and friction without requiring additional hardware.
Creative Commons License
This work is licensed under a Creative Commons Attribution 4.0 License.
Recommended Citation
Singh, Ashish and Öztireli, Ahmet Cengiz, "Simulating Physical Touch in Mixed Reality Through Visual Skin Deformation and Color Changes", Technical Disclosure Commons, (July 27, 2026)
https://www.tdcommons.org/dpubs_series/11146