Abstract
A system and method that repurposes an ordinary smartphone (including a retired one) as the input devices and camera for an AI agent operating a separate, unmodified computer. The phone acts as the hands by presenting itself as a keyboard and mouse to the target, over Bluetooth HID, a USB serial-to-HID bridge such as a CH9329, or other transports, and as the eyes by aiming its camera at the target's screen and streaming frames or live video to a controlling agent. No software is installed on the target, which sees only a standard input device. A host coordinates the loop: the agent observes the screen, decides, emits keystrokes and pointer actions, and verifies the result visually. A persistent on-device indicator shows whenever the camera is active. The disclosure describes many variants, including other helper devices (tablets, laptops repairing another computer down to firmware, AR/VR headsets, smart glasses), wired, wireless, and network transports, cloud or local AI brains, still-image or live-video vision, a self-contained on-device visual agent, and accessibility use for blind and low-vision people. Published as a defensive publication to establish prior art.
Creative Commons License
This work is licensed under a Creative Commons Attribution 4.0 License.
Recommended Citation
Hacker, Traveler, "Helpful Potato: Using a Smartphone as the Hands and Eyes for an AI Agent to Operate a Separate Computer", Technical Disclosure Commons, ()
https://www.tdcommons.org/dpubs_series/12661