Abstract
Systems, methods, and computer program products are provided for automatically scraping categorical data from a plurality of websites. These include: determining a product category; identifying a first website including data associated with the product category; automatically scraping the first website to compile first product data associated with the product category; generating a plurality of web queries based on the compiled first product data; executing the plurality of web queries to identify a plurality of websites; automatically scraping at least a portion of the plurality of websites to compile supplier data associated with suppliers in the product category; and storing at least a portion of the compiled supplier data in a database.
Creative Commons License
This work is licensed under a Creative Commons Attribution 4.0 License.
Recommended Citation
FLANAGAN, PATRICK RYAN and BUTLER CLOUGH, PIERS WILLIAM, "SYSTEM, METHOD, AND COMPUTER PROGRAM PRODUCT FOR AUTOMATICALLY SCRAPING CATEGORICAL DATA FROM A PLURALITY OF WEBSITES", Technical Disclosure Commons, (May 30, 2023)
https://www.tdcommons.org/dpubs_series/5933