Methods And System For Efficient Crawling Of Advertiser Landing Page URLs

摘要

A method and apparatus for the efficient storage, retrieval, and processing of landing pages and related metadata for use in a paid search advertising business model is provided. These techniques promote efficient crawling in situations including one landing page associated with multiple sponsored listings belonging to the same or different accounts. One or more landing pages may be crawled, based at least in part on one or more of the landing page URLs represented in a table. In an embodiment, each URL identifier is placed in an active or inactive queue, with only entries in the active queue crawled.