This disclosure describes techniques for utilizing a user’s natural perception of their environment to obtain information about the local environment. With user permission, eye positions and eye movements of a user as they interact with their environment are utilized to substitute for and/or augment machine-based perception of the environment. Eye movement information such as vergence, fixation/gaze points, saccade patterns, etc. are obtained from eye tracking sensors. A 3D volumetric map of the environment is created based on the eye movement information. Based on identified user fixations, an interest map of the room is generated. 3D spatial information can be obtained in user environments where an outward facing camera is infeasible, since mapping can be performed based only on vergence information obtained from the eyes.

Creative Commons License

Creative Commons License
This work is licensed under a Creative Commons Attribution 4.0 License.