Abstract
Certain laptops and other devices do not include built-in touchscreen capability. This disclosure describes an optical accessory that enables such devices to recognize touch inputs. The accessory includes a fisheye lens attached to a holder, and a tilt plane mirror placed within the accessory that reflects incident light towards the camera of the device to which the accessory is attached. A one-time calibration is performed at a setup time of setup and at runtime, camera images that capture the user’s finger position relative to the screen are received. A neural finger pose is estimated by detecting fingers and utilizing a skeletal finger pose detector. A touch event is determined based on an Euclidean distance between the tip joint coordinates of real and virtual fingers. The touch coordinate in the optical view is determined and is mapped to a display coordinate using a conformal mapping.
Creative Commons License
This work is licensed under a Creative Commons Attribution 4.0 License.
Recommended Citation
Shin, D and Xue, Shirley, "Optical Accessory to Add Touch Capability to a Non-touchscreen Device", Technical Disclosure Commons, (November 05, 2020)
https://www.tdcommons.org/dpubs_series/3750