Skip to content
This repository was archived by the owner on Dec 18, 2024. It is now read-only.

Milestones

List view

  • All necessary quotas are approved and the pipeline passes a smoke test at a rate of at least 100 million desktop and mobile URLs per month. At its current size, the crawl should complete in less than 60 hours. At this stage the test pipeline is fully tested, documented, and monitorable.

    Due by May 1, 2022
    20/20 issues closed
  • A proof of concept pipeline is successfully tested using a small sample set of URLs.

    Due by April 15, 2022
    7/7 issues closed