Skip to content

Sitemap for Large sites with filter date/year #649

@advwebin

Description

@advwebin

Hello, The sitemap feature can be optimized a little more.
It takes over 30 seconds to generate.

For large websites, like news websites which host a lot of old data, the sitemap generation can take a lot of processing power and waste resources.

I have seen this approach from metro.co.uk/sitemap.xml

They have developed https://github.com/Automattic/msm-sitemap in collaboration with automatic.

With this approach, you are hitting two issues.

  1. Your crawl budget is optimized as Crawling takes place with only the newer or updated sitemaps.
  2. Generation of new sitemaps is faster as it ads only the sitemap with a newer date, month, year. As per your setup.

Metadata

Metadata

Assignees

Labels

[Component] Sitemap[Impact] GrowthChanges helping the plugin grow, not necessarily helping the current users.[Type] FeatureSomething new we need to write from the ground up.

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions