Abstract
Users interacting with head-wearable optical see-through augmented reality (AR) devices frequently experience visual disconnect when digital objects appear to float unnaturally above physical surfaces. Optical see-through displays often function as additive-only systems that project light into the user's field of view but cannot physically block real-world light to create true subtractive darkness or realistic shadows. Conventional software attempts to simulate shadows by projecting bright white rings around intended shadow areas, which wash out real-world surface colors and create glowing visual anomalies. Hardware solutions incorporate secondary physical dimming layers, such as LCD panels, which add excessive bulk, weight, cost, and power consumption while reducing overall optical display transparency.
The disclosed technology describes a software-based perceptual shadow simulation framework for head-wearable optical see-through AR devices that tricks human visual perception into perceiving realistic dark shadows without requiring physical light-blocking hardware. An integrated environmental sensing architecture processes outward-facing camera streams and spatial depth telemetry using machine learning models and depth estimation engines to generate real-time color and texture maps of physical diffusive surfaces while evaluating ambient lighting vectors. To induce perceptual darkening, the system provides adaptive surround brightening and complementary color pattern synthesis. The system brightens the region exterior to the shadow boundary by projecting light matching the analyzed hue, color, and texture of the physical surface, while projecting a pattern of sub-visual dots inside the shadow region using the complementary color of the physical surface.
When the sub-visual complementary color dots are projected onto a physical surface, the human eye and visual cortex blend them with physical surface illumination, perceiving a realistic shadow without physical light subtraction. The software pipeline continuously recalculates surround brightness multipliers and complementary dot chromaticity in real time as virtual objects move, user head position shifts, or ambient lighting conditions change. Implemented within operating environments such as extended reality systems, this architecture grounds virtual content seamlessly on head-wearable optical see-through devices while preserving display transparency and eliminating hardware overhead. Furthermore, external high-speed optical capture can identify the sub-visual complementary dot patterns to verify system implementation.
Creative Commons License
This work is licensed under a Creative Commons Attribution 4.0 License.
Recommended Citation
Singh, Ashish and Öztireli, Ahmet Cengiz, "Perceptual Shadow Simulation in Augmented Reality Using Complementary Color Patterns and Surround Brightening", Technical Disclosure Commons, ()
https://www.tdcommons.org/dpubs_series/12228