This repository was archived by the owner on Apr 24, 2020. It is now read-only.
Graph crawling indexes the index page twice #97
Description
Both www.domain.com/index.html and www.domain.com are indexed as different documents, resulting in duplicate search results (the index page is indexed twice)