While personal photo collections can be searched based on image labels assigned to images in the collection, such searches can fail when the user specifies a search query for rare images or specifies concepts that do not have matching labels, e.g., in a language different from the language of the image labels. This disclosure describes techniques to search a personal collection of photos based on visual similarity with images obtained from a public image search. Machine learning techniques are used to generate representation vectors from the personal images. A public image search is performed based on the user's natural language query to identify matching images. Representation vectors for the matching images are compared to those for the user’s personal images to identify images in the user’s photo collection that are visually similar. The identified images are returned as search results.
Creative Commons License
This work is licensed under a Creative Commons Attribution 4.0 License.
Tran, Duc-Hieu, "Searching Personal Photo Collections via Similar Visual Searches", Technical Disclosure Commons, (August 25, 2023)